00010000:00010000:3.0F:1784191785.045135:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191785.301480:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191785.301535:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191785.301586:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191785.301620:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812297856 00000100:00100000:3.0:1784191785.301630:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812297856 00000100:00100000:3.0:1784191785.301708:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812297984 00000100:00100000:3.0:1784191785.301712:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812297984 00000100:00100000:3.0:1784191785.301743:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 201 00000100:00100000:3.0:1784191785.301754:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+12:69111:x1870858812297856:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191785.301836:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+12:69111:x1870858812297856:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 84us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191785.301844:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 201 00000100:00100000:3.0:1784191785.301861:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 202 00000100:00100000:3.0:1784191785.301867:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:69111:x1870858812297984:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191785.301890:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:69111:x1870858812297984:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 23us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191785.301896:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 202 00000100:00080000:3.0:1784191785.301910:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784191785.301914:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0F:1784191785.302373:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812297728 00000100:00100000:1.0:1784191785.302390:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812297728 00000100:00100000:1.0:1784191785.302428:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 189 00000100:00100000:1.0:1784191785.302436:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af206b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf092482-e55f-41b2-a9bc-7eac002d231d+10:69110:x1870858812297728:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191785.302474:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af206b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf092482-e55f-41b2-a9bc-7eac002d231d+10:69110:x1870858812297728:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 39us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191785.302481:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 189 00000100:00100000:3.0:1784191785.484957:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827844096:0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.485036:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191785.485122:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827844608:0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.485147:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191785.485165:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858827845120:0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.485188:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191785.485213:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784191785.485233:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827844224:0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.485260:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191785.485281:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827844736:0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.485300:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191785.485330:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858827845248:0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.485351:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191785.485370:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827845632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784191785.485370:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827844352:0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.485394:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191785.485394:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191785.485409:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827844864:0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.485428:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827845120 00000100:00100000:1.0:1784191785.485428:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191785.485434:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827845120 00000100:00100000:1.0:1784191785.485443:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858827845376:0@lo:400:kworker.0 00000100:00100000:1.0:1784191785.485460:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191785.485488:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827845248 00000100:00100000:1.0:1784191785.485490:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1784191785.485491:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827845248 00000100:00100000:1.0:1784191785.485496:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827843968:0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.485507:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827845376 00000100:00100000:3.0:1784191785.485509:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827845376 00000100:00100000:1.0:1784191785.485522:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191785.485524:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1784191785.485532:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858827845120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191785.485541:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827844480:0@lo:400:kworker.0 00000100:00100000:1.0:1784191785.485574:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191785.485586:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827844992:0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.485595:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858827845120:12345-0@lo:400:kworker.0 Request processed in 64us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191785.485603:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1784191785.485604:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191785.485612:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827845504:0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.485620:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827844480 00000100:00100000:3.0:1784191785.485623:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827844480 00000100:00100000:1.0:1784191785.485629:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191785.485635:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827844992 00000100:00100000:3.0:1784191785.485637:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827844992 00000100:00100000:3.0:1784191785.485646:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827845504 00000100:00100000:3.0:1784191785.485648:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827845504 00000100:00100000:1.0:1784191785.485648:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827844224 00000100:00100000:1.0:1784191785.485650:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827844224 00000100:00100000:3.0:1784191785.485660:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1784191785.485665:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858827845248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191785.485674:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827844736 00000100:00100000:1.0:1784191785.485677:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827844736 00000100:00100000:3.0:1784191785.485714:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858827845248:12345-0@lo:400:kworker.0 Request processed in 48us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191785.485720:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827844352 00000100:00100000:1.0:1784191785.485722:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827844352 00000100:00100000:3.0:1784191785.485725:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1784191785.485736:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1784191785.485742:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858827845376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191785.485750:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827844864 00000100:00100000:1.0:1784191785.485753:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827844864 00000100:00100000:1.0:1784191785.485769:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784191785.485775:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827844224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.485776:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858827845376:12345-0@lo:400:kworker.0 Request processed in 34us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191785.485781:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1784191785.485793:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1784191785.485798:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827844480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191785.485803:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827844224:12345-0@lo:400:kworker.0 Request processed in 29us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191785.485809:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784191785.485820:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784191785.485822:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827844480:12345-0@lo:400:kworker.0 Request processed in 24us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191785.485825:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827844736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.485827:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1784191785.485837:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1784191785.485842:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827844992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191785.485846:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827844736:12345-0@lo:400:kworker.0 Request processed in 22us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191785.485852:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784191785.485862:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784191785.485864:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827844992:12345-0@lo:400:kworker.0 Request processed in 22us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191785.485867:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827844352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.485870:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1784191785.485879:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1784191785.485884:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827845504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191785.485888:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827844352:12345-0@lo:400:kworker.0 Request processed in 22us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191785.485893:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784191785.485902:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784191785.485905:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827845504:12345-0@lo:400:kworker.0 Request processed in 21us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191785.485907:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827844864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.485911:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1784191785.485929:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827844864:12345-0@lo:400:kworker.0 Request processed in 22us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191785.485935:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1784191785.485936:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784191785.485939:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784191785.485942:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784191785.485944:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784191785.485968:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827844224:0@lo:400:kworker.0 00000100:00100000:1.0:1784191785.485968:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827844480:0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.485977:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827844736:0@lo:400:kworker.0 00000100:00100000:1.0:1784191785.485978:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827844992:0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.485985:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858827845248:0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.485994:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858827845120:0@lo:400:kworker.0 00000100:00100000:1.0:1784191785.485995:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827845504:0@lo:400:kworker.0 00000100:00100000:1.0:1784191785.486002:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827844352:0@lo:400:kworker.0 00000100:00100000:1.0:1784191785.486009:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827844864:0@lo:400:kworker.0 00000100:00100000:1.0:1784191785.486016:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858827845376:0@lo:400:kworker.0 00000100:00100000:0.0F:1784191785.486267:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827845760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784191785.486317:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191785.486361:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827844096 00000100:00100000:0.0:1784191785.486366:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827844096 00000100:00100000:0.0:1784191785.486394:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827844608 00000100:00100000:0.0:1784191785.486396:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827844608 00000100:00100000:0.0:1784191785.486413:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1784191785.486420:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827844096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191785.486457:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827844096:12345-0@lo:400:kworker.0 Request processed in 38us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191785.486463:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1784191785.486479:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1784191785.486485:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827844608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191785.486512:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827844608:12345-0@lo:400:kworker.0 Request processed in 27us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191785.486518:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1784191785.486546:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827845632 00000100:00100000:0.0:1784191785.486549:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827845632 00000100:00100000:0.0:1784191785.486579:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827845760 00000100:00100000:0.0:1784191785.486582:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827845760 00000100:00100000:0.0:1784191785.486591:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784191785.486597:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827845632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784191785.486619:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71184384 avail 64016384 00000100:00100000:0.0:1784191785.486650:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827845632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191785.486656:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784191785.486667:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784191785.486672:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827845760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784191785.486710:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71184384 avail 64016384 00000100:00100000:0.0:1784191785.486742:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827845760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191785.486748:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784191785.486765:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827843968 00000100:00100000:0.0:1784191785.486768:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827843968 00000100:00100000:0.0:1784191785.486794:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1784191785.486800:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af206b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827843968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191785.486835:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af206b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827843968:12345-0@lo:400:kworker.0 Request processed in 35us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191785.486842:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1784191785.486915:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827845760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784191785.486940:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827843968:0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.487084:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827845632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191785.487096:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827844096:0@lo:400:kworker.0 00000100:00100000:3.0:1784191785.487106:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827844608:0@lo:400:kworker.0 00000001:00100000:2.0F:1784191786.011981:0:160160:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8c2c50be-ac0a-45d2-a88f-69ee938110a0 00000020:00000080:2.0:1784191786.012008:0:160160:0:(genops.c:906:class_export_put()) final put ffff8af1093aa800/8c2c50be-ac0a-45d2-a88f-69ee938110a0 00000020:00000080:1.0:1784191786.012082:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8af1093aa800/8c2c50be-ac0a-45d2-a88f-69ee938110a0 for lustre-OST0000 00000020:00000080:1.0:1784191786.012144:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af1093af000 for lustre-OST0000 00010000:00010000:1.0:1784191786.060094:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191787.084846:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191788.044994:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827845888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784191788.045071:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191788.047050:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827845888 00000100:00100000:2.0:1784191788.047065:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827845888 00000100:00100000:2.0:1784191788.047152:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784191788.047165:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827845888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784191788.047202:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71049216 avail 63881216 00000100:00100000:2.0:1784191788.047298:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827845888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (2227us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191788.047305:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1784191788.047465:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191788.047597:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827845888:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784191788.108877:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191788.557838:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827846016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784191788.557918:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191788.557996:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827846016 00000100:00100000:3.0:1784191788.558003:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827846016 00000100:00100000:3.0:1784191788.558059:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1784191788.558081:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858827846016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784191788.558122:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42647552 avail 36515840 00000100:00100000:3.0:1784191788.558174:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858827846016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191788.558182:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1784191788.558238:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827846016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784191788.558836:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827846144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784191788.558889:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191788.558941:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827846144 00000100:00100000:3.0:1784191788.558946:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827846144 00000100:00100000:3.0:1784191788.559034:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1784191788.559045:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827846144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784191788.559075:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42786816 avail 36655104 00000100:00100000:3.0:1784191788.559116:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827846144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191788.559122:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1784191788.566470:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827846144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784191789.077124:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827846272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784191789.077215:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191789.078086:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827846272 00000100:00100000:0.0:1784191789.078096:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827846272 00000100:00100000:0.0:1784191789.078167:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784191789.078179:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827846272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784191789.078205:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71049216 avail 63881216 00000100:00100000:0.0:1784191789.078266:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827846272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191789.078283:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784191789.078340:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827846272:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784191789.078438:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784191789.131951:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191790.156134:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191790.419931:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191790.419986:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191790.420082:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191790.420130:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812298240 00000100:00100000:3.0:1784191790.420143:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812298240 00000100:00100000:3.0:1784191790.420220:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812298368 00000100:00100000:3.0:1784191790.420223:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812298368 00000100:00100000:3.0:1784191790.420249:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 209 00000100:00100000:3.0:1784191790.420275:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+12:69109:x1870858812298240:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191790.420389:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+12:69109:x1870858812298240:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 129us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191790.420398:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 209 00000100:00100000:3.0:1784191790.420420:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 210 00000100:00100000:3.0:1784191790.420427:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:69111:x1870858812298368:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191790.420490:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:69111:x1870858812298368:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 63us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191790.420497:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 210 00000100:00080000:3.0:1784191790.420521:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784191790.420526:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784191790.421411:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812298112 00000100:00100000:2.0:1784191790.421420:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812298112 00000100:00100000:2.0:1784191790.421488:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 191 00000100:00100000:2.0:1784191790.421498:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af206b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf092482-e55f-41b2-a9bc-7eac002d231d+10:69109:x1870858812298112:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191790.421569:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af206b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf092482-e55f-41b2-a9bc-7eac002d231d+10:69109:x1870858812298112:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 73us (1669us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191790.421577:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 191 00000100:00100000:3.0:1784191790.604173:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827846400:0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.604280:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191790.604406:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827846400 00000100:00100000:3.0:1784191790.604417:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827846400 00000100:00100000:3.0:1784191790.604490:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1784191790.604502:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827846400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.604571:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827846400:12345-0@lo:400:kworker.0 Request processed in 71us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191790.604580:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1784191790.604643:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827846400:0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.604726:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827846528:0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.604925:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191790.605003:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827846656:0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.605037:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191790.605153:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827846528 00000100:00100000:2.0:1784191790.605173:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827846528 00000100:00100000:3.0:1784191790.605175:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827846784:0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.605221:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191790.605264:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1784191790.605278:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827846528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.605303:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827846912:0@lo:400:kworker.0 00000100:00100000:1.0:1784191790.605447:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827846656 00000100:00100000:1.0:1784191790.605452:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827846656 00000100:00100000:1.0:1784191790.605505:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827846784 00000100:00100000:1.0:1784191790.605508:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827846784 00000100:00100000:1.0:1784191790.605545:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784191790.605553:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827846656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.605869:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191790.605897:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784191790.605925:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827847040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191790.605957:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191790.605998:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827846912 00000100:00100000:3.0:1784191790.606003:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827846912 00000100:00100000:3.0:1784191790.606039:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1784191790.606047:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827846912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.606106:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827846912:12345-0@lo:400:kworker.0 Request processed in 60us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191790.606113:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1784191790.606138:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827847040 00000100:00100000:3.0:1784191790.606142:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827847040 00000100:00100000:3.0:1784191790.606170:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784191790.606176:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:106501:x1870858827847040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784191790.606207:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71184384 avail 64016384 00000100:00100000:3.0:1784191790.606245:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:106501:x1870858827847040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191790.606253:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784191790.606300:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827847040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191790.606312:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827846912:0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.606864:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827847168:0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.606912:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191790.606984:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827847296:0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.607013:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191790.607050:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827847296 00000100:00100000:3.0:1784191790.607056:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827847296 00000100:00100000:3.0:1784191790.607479:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784191790.607507:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827846784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.607569:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827846784:12345-0@lo:400:kworker.0 Request processed in 64us (2347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191790.607577:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784191790.607594:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784191790.607600:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827847296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.607634:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827847296:12345-0@lo:400:kworker.0 Request processed in 34us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191790.607641:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784191790.608252:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827847296:0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.608277:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827846784:0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.608311:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827847424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784191790.608354:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191790.608521:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827847424 00000100:00100000:3.0:1784191790.608528:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827847424 00000100:00100000:3.0:1784191790.608570:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784191790.608579:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827847424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784191790.608602:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71184384 avail 64016384 00000100:00100000:3.0:1784191790.608647:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827847424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191790.608654:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784191790.608916:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827847424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784191790.608966:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827847552:0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.608998:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191790.609050:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827847552 00000100:00100000:3.0:1784191790.609054:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827847552 00000100:00100000:3.0:1784191790.611469:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784191790.611506:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827847552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.611646:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827847552:12345-0@lo:400:kworker.0 Request processed in 159us (2647us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191790.611655:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784191790.611762:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827846656:12345-0@lo:400:kworker.0 Request processed in 6207us (6721us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191790.611866:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1784191790.612000:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784191790.612008:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784191790.612035:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827847168 00000100:00100000:1.0:1784191790.612046:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827847168 00000100:00100000:1.0:1784191790.612095:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1784191790.612102:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827847168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191790.612151:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827847168:12345-0@lo:400:kworker.0 Request processed in 49us (5239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191790.612158:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1784191790.614270:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827847552:0@lo:400:kworker.0 00000100:00100000:2.0:1784191790.616135:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827846528:12345-0@lo:400:kworker.0 Request processed in 10834us (11347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191790.616151:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858827847680:0@lo:400:kworker.0 00000100:00100000:2.0:1784191790.616165:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1784191790.616257:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191790.616326:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827847168:0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.616344:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827846656:0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.616413:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827847680 00000100:00100000:3.0:1784191790.616421:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827847680 00000100:00100000:2.0:1784191790.616456:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827846528:0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.616503:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1784191790.616515:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858827847680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.616594:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858827847680:12345-0@lo:400:kworker.0 Request processed in 81us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191790.616602:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1784191790.616643:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858827847680:0@lo:400:kworker.0 00000100:00100000:0.0:1784191790.617095:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:106501:1870858827847936:0@lo:400:kworker.0 00000100:00100000:0.0:1784191790.617141:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191790.617214:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858827847808:0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.617242:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191790.617276:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827847936 00000100:00100000:3.0:1784191790.617280:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827847936 00000100:00100000:3.0:1784191790.617320:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827847808 00000100:00100000:3.0:1784191790.617323:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827847808 00000100:00100000:3.0:1784191790.617344:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1784191790.617370:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:106501:x1870858827847936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.617419:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:106501:x1870858827847936:12345-0@lo:400:kworker.0 Request processed in 61us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191790.617427:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1784191790.617441:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1784191790.617446:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858827847808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.617489:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858827847808:12345-0@lo:400:kworker.0 Request processed in 42us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191790.617495:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:3.0:1784191790.617518:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784191790.617524:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191790.617548:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858827847808:0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.617575:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:106501:1870858827847936:0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.625028:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784191790.625065:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858827848064:0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.625170:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191790.625226:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858827848192:0@lo:400:kworker.0 00000100:00100000:2.0:1784191790.625310:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191790.626233:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827848064 00000100:00100000:0.0:1784191790.626238:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827848192 00000100:00100000:0.0:1784191790.626250:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827848192 00000100:00100000:3.0:1784191790.626251:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827848064 00000100:00100000:3.0:1784191790.626351:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1784191790.626365:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858827848064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191790.626477:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858827848064:12345-0@lo:400:kworker.0 Request processed in 115us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191790.626486:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1784191790.626551:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858827848064:0@lo:400:kworker.0 00000100:00100000:0.0:1784191790.636734:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1784191790.636769:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858827848192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191790.636934:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858827848192:12345-0@lo:400:kworker.0 Request processed in 186us (11624us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191790.636943:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:2.0:1784191790.637349:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784191790.637407:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858827848192:0@lo:400:kworker.0 00000100:00080000:2.0:1784191790.637478:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784191791.181934:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191792.205526:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191793.167860:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784191793.167890:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827848320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784191793.167969:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191793.168218:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827848320 00000100:00100000:0.0:1784191793.168227:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827848320 00000100:00100000:0.0:1784191793.168297:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784191793.168309:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827848320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784191793.168342:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71049216 avail 63881216 00000100:00100000:0.0:1784191793.168396:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827848320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191793.168403:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1784191793.168593:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784191793.168633:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827848320:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784191793.227892:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191793.678668:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827848448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191793.678778:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191793.678841:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827848448 00000100:00100000:2.0:1784191793.678849:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827848448 00000100:00100000:2.0:1784191793.679119:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1784191793.679131:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827848448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784191793.679177:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42647552 avail 36515840 00000100:00100000:2.0:1784191793.679229:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827848448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191793.679236:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1784191793.679282:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827848448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191793.680461:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827848576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784191793.680521:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191793.680796:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827848576 00000100:00100000:1.0:1784191793.680805:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827848576 00000100:00100000:1.0:1784191793.680854:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1784191793.680864:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827848576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784191793.680903:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42786816 avail 36655104 00000100:00100000:1.0:1784191793.680954:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827848576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191793.680961:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1784191793.684538:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827848576:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1784191793.868904:0:164506:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-lfsck test 42: LFSCK repairs inconsistent MDT-object/OST-object encryption flags ========================================================== 04:49:51 (1784191791) 00000100:00100000:0.0:1784191794.032610:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191794.038320:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812298496 00000100:00100000:2.0:1784191794.038345:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812298496 00000100:00080000:1.0:1784191794.038430:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784191794.038579:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 307 00000100:00100000:2.0:1784191794.038593:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+12:121656:x1870858812298496:12345-192.168.204.16@tcp:101:bash.0 00010000:00010000:2.0:1784191794.038619:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191794.038645:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a003 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b37c expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.038742:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a00a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.038757:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a00a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.038773:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a00a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191794.038831:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191794.038835:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191794.038856:0:158667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a00a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.038880:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a003 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b37c expref: 14 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.038895:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a00a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b37c expref: 13 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.038904:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191794.038907:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191794.038910:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5c00, rc 0) 00000100:00100000:2.0:1784191794.038991:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+13:121656:x1870858812298496:12345-192.168.204.16@tcp:101:bash.0 Request processed in 402us (6393us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191794.038998:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 307 00000100:00100000:0.0:1784191794.052954:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191794.053022:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812298624 00000100:00100000:2.0:1784191794.053032:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812298624 00000100:00100000:2.0:1784191794.053092:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 80 00000100:00100000:2.0:1784191794.053102:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+13:121656:x1870858812298624:12345-192.168.204.16@tcp:37:bash.0 00000100:00100000:3.0:1784191794.063905:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+13:121656:x1870858812298624:12345-192.168.204.16@tcp:37:bash.0 Request processed in 10789us (10943us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191794.063932:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 80 00000100:00100000:2.0:1784191794.096036:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191794.096442:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812298752 00000100:00100000:0.0:1784191794.096457:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812298752 00000100:00100000:0.0:1784191794.096537:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 308 00000100:00100000:0.0:1784191794.096549:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+13:121808:x1870858812298752:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191794.096573:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191794.096599:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4a011 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b383 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.096681:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a018 lrc: 3/1,0 mode: --/PR res: [0x200003ab2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.096719:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a018 lrc: 3/1,0 mode: PR/PR res: [0x200003ab2:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.096732:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a018 lrc: 3/1,0 mode: PR/PR res: [0x200003ab2:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191794.096785:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab2:0x7:0x0]: returning size 4096 00000004:00200000:0.0:1784191794.096790:0:161504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784191794.096811:0:161504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a018 lrc: 3/1,0 mode: PR/PR res: [0x200003ab2:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.096836:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4a011 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b383 expref: 15 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.096855:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a018 lrc: 3/0,0 mode: PR/PR res: [0x200003ab2:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b383 expref: 14 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.096874:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0x7:0x0].0x0 (ffff8af202c46300) 00010000:00010000:0.0:1784191794.096877:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784191794.096880:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5800, rc 0) 00000100:00100000:0.0:1784191794.096945:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+14:121808:x1870858812298752:12345-192.168.204.16@tcp:101:rm.0 Request processed in 399us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191794.096952:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 308 00000100:00100000:3.0:1784191794.103033:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191794.103110:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812299008 00000100:00100000:2.0:1784191794.103121:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812299008 00000100:00100000:2.0:1784191794.103187:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 309 00000100:00100000:2.0:1784191794.103199:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+14:121808:x1870858812299008:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191794.103231:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191794.103254:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a01f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b38a expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191794.103365:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab2:0x7:0x0]: returning size 4096 00010000:00010000:2.0:1784191794.103512:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a01f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b38a expref: 16 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.103527:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191794.103530:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191794.103536:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a01f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b38a expref: 16 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.103549:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5000, rc 0) 00000100:00100000:2.0:1784191794.103609:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+15:121808:x1870858812299008:12345-192.168.204.16@tcp:101:rm.0 Request processed in 412us (623us total) trans 34359738575 rc 301/301 00000100:00100000:2.0:1784191794.103628:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 309 00000100:00100000:2.0:1784191794.108883:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191794.108999:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812299136 00000100:00100000:0.0:1784191794.109012:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812299136 00000100:00100000:0.0:1784191794.109102:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 81 00000100:00100000:0.0:1784191794.109113:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cfd3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+15:121808:x1870858812299136:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:0.0:1784191794.115379:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cfd3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+15:121808:x1870858812299136:12345-192.168.204.16@tcp:37:rm.0 Request processed in 6257us (6491us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191794.115403:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 81 00000100:00100000:0.0:1784191794.120374:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191794.120475:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812299392 00000100:00100000:2.0:1784191794.120486:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812299392 00000100:00100000:2.0:1784191794.122335:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 82 00000100:00100000:2.0:1784191794.122346:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+15:121808:x1870858812299392:12345-192.168.204.16@tcp:35:rm.0 00000100:00100000:2.0:1784191794.122603:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+16:121808:x1870858812299392:12345-192.168.204.16@tcp:35:rm.0 Request processed in 257us (2238us total) trans 34359738576 rc 0/0 00000100:00100000:2.0:1784191794.122611:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 82 00000100:00100000:2.0:1784191794.128381:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191794.128489:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812299648 00000100:00100000:0.0:1784191794.128500:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812299648 00000100:00100000:0.0:1784191794.128580:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 310 00000100:00100000:0.0:1784191794.128592:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+16:121808:x1870858812299648:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191794.128618:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191794.128645:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a02d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b391 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.128806:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a034 lrc: 3/1,0 mode: --/CR res: [0x200003ab2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.128823:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a034 lrc: 3/1,0 mode: CR/CR res: [0x200003ab2:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.128852:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a034 lrc: 3/1,0 mode: CR/CR res: [0x200003ab2:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191794.128865:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab2:0x7:0x0]: returning size 4096 00010000:00010000:0.0:1784191794.128980:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a02d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b391 expref: 19 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.129118:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a034 lrc: 3/0,0 mode: CR/CR res: [0x200003ab2:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b391 expref: 18 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.129129:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0x7:0x0].0x0 (ffff8af202c46300) 00010000:00010000:0.0:1784191794.129132:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784191794.129136:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4a00, rc 0) 00000100:00100000:0.0:1784191794.129210:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+18:121808:x1870858812299648:12345-192.168.204.16@tcp:101:rm.0 Request processed in 614us (833us total) trans 34359738577 rc 0/0 00000100:00100000:0.0:1784191794.129218:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 310 00000100:00100000:3.0:1784191794.141903:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191794.142021:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812299776 00000100:00100000:2.0:1784191794.142033:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812299776 00000100:00100000:2.0:1784191794.142095:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 311 00000100:00100000:2.0:1784191794.142106:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+18:121808:x1870858812299776:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191794.142131:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191794.142151:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a042 lrc: 2/0,0 mode: --/CR res: [0x200003ab2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b398 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.142218:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a049 lrc: 3/1,0 mode: --/PR res: [0x200003ab2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.142232:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a049 lrc: 3/1,0 mode: PR/PR res: [0x200003ab2:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.142244:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a049 lrc: 3/1,0 mode: PR/PR res: [0x200003ab2:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191794.142589:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab2:0x8:0x0]: returning size 4096 00000004:00200000:2.0:1784191794.142595:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191794.142617:0:158667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a049 lrc: 3/1,0 mode: PR/PR res: [0x200003ab2:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.142646:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a042 lrc: 0/0,0 mode: --/CR res: [0x200003ab2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b398 expref: 20 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.142665:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a049 lrc: 3/0,0 mode: PR/PR res: [0x200003ab2:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b398 expref: 19 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.142673:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0x8:0x0].0x0 (ffff8af2331f1100) 00010000:00010000:2.0:1784191794.142676:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191794.142680:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4600, rc 0) 00000100:00100000:2.0:1784191794.142842:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+19:121808:x1870858812299776:12345-192.168.204.16@tcp:101:rm.0 Request processed in 738us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191794.142851:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 311 00000100:00100000:2.0:1784191794.148088:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191794.148219:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812300032 00000100:00100000:3.0:1784191794.148229:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812300032 00000100:00100000:3.0:1784191794.148301:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 312 00000100:00100000:3.0:1784191794.148313:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+19:121808:x1870858812300032:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:3.0:1784191794.148350:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191794.148376:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a050 lrc: 2/0,0 mode: --/CR res: [0x200003ab2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b39f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191794.148564:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab2:0x8:0x0]: returning size 4096 00010000:00010000:3.0:1784191794.148678:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a050 lrc: 1/0,0 mode: --/CR res: [0x200003ab2:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b39f expref: 21 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.148720:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0x7:0x0].0x0 (ffff8af202c46300) 00010000:00010000:3.0:1784191794.148723:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784191794.148729:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a050 lrc: 0/0,0 mode: --/CR res: [0x200003ab2:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b39f expref: 21 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.148748:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7ce00, rc 0) 00000100:00100000:3.0:1784191794.148818:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+20:121808:x1870858812300032:12345-192.168.204.16@tcp:101:rm.0 Request processed in 507us (740us total) trans 34359738578 rc 301/301 00000100:00100000:3.0:1784191794.148835:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 312 00000100:00100000:1.0:1784191794.163156:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191794.163254:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812300160 00000100:00100000:2.0:1784191794.163265:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812300160 00000100:00100000:2.0:1784191794.163341:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 83 00000100:00100000:2.0:1784191794.163353:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+20:121808:x1870858812300160:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:2.0:1784191794.172783:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+20:121808:x1870858812300160:12345-192.168.204.16@tcp:37:rm.0 Request processed in 9418us (9625us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191794.172799:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 83 00000100:00100000:0.0:1784191794.177623:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191794.178275:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812300416 00000100:00100000:2.0:1784191794.178295:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812300416 00000100:00100000:2.0:1784191794.178474:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 84 00000100:00100000:2.0:1784191794.178484:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+20:121808:x1870858812300416:12345-192.168.204.16@tcp:35:rm.0 00000100:00100000:2.0:1784191794.179072:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+21:121808:x1870858812300416:12345-192.168.204.16@tcp:35:rm.0 Request processed in 586us (1455us total) trans 34359738579 rc 0/0 00000100:00100000:2.0:1784191794.179081:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 84 00000100:00100000:1.0:1784191794.185136:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191794.185448:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812300672 00000100:00100000:3.0:1784191794.185460:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812300672 00000100:00100000:3.0:1784191794.185597:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 313 00000100:00100000:3.0:1784191794.185608:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+21:121808:x1870858812300672:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:3.0:1784191794.185637:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191794.185673:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a05e lrc: 2/0,0 mode: --/CR res: [0x200003ab2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b3a6 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.186039:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a065 lrc: 3/1,0 mode: --/CR res: [0x200003ab2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.186054:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a065 lrc: 3/1,0 mode: CR/CR res: [0x200003ab2:0x8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.186065:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a065 lrc: 3/1,0 mode: CR/CR res: [0x200003ab2:0x8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191794.186075:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab2:0x8:0x0]: returning size 4096 00010000:00010000:3.0:1784191794.186191:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a05e lrc: 0/0,0 mode: --/CR res: [0x200003ab2:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3a6 expref: 24 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.186214:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a065 lrc: 3/0,0 mode: CR/CR res: [0x200003ab2:0x8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3a6 expref: 23 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.186222:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0x8:0x0].0x0 (ffff8af2331f1100) 00010000:00010000:3.0:1784191794.186225:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784191794.186228:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7c200, rc 0) 00000100:00100000:3.0:1784191794.186296:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+23:121808:x1870858812300672:12345-192.168.204.16@tcp:101:rm.0 Request processed in 689us (1172us total) trans 34359738580 rc 0/0 00000100:00100000:3.0:1784191794.186304:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 313 00000100:00100000:0.0:1784191794.187876:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827848704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784191794.187953:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191794.188013:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827848704 00000100:00100000:0.0:1784191794.188020:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827848704 00000100:00100000:0.0:1784191794.188070:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784191794.188078:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827848704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784191794.188100:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71049216 avail 63881216 00000100:00100000:0.0:1784191794.188142:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827848704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191794.188177:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1784191794.188199:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191794.188236:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827848704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784191794.194065:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191794.194262:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812300800 00000100:00100000:3.0:1784191794.194280:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812300800 00000100:00100000:3.0:1784191794.194437:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 314 00000100:00100000:3.0:1784191794.194448:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+23:121808:x1870858812300800:12345-192.168.204.16@tcp:41:rm.0 00000004:00000024:3.0:1784191794.194504:0:158665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 142233600 avail 127897600 00000100:00100000:3.0:1784191794.194582:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+23:121808:x1870858812300800:12345-192.168.204.16@tcp:41:rm.0 Request processed in 135us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191794.194590:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 314 00000100:00100000:0.0:1784191794.199666:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191794.199823:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812300928 00000100:00100000:2.0:1784191794.199834:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812300928 00000100:00100000:2.0:1784191794.200003:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 315 00000100:00100000:2.0:1784191794.200015:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+23:121808:x1870858812300928:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191794.200036:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191794.200058:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a073 lrc: 2/0,0 mode: --/CR res: [0x200003ab0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b3ad expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200128:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a07a lrc: 3/1,0 mode: --/CR res: [0x200003ab0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200153:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a07a lrc: 3/1,0 mode: CR/CR res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200165:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a07a lrc: 3/1,0 mode: CR/CR res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200181:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a081 lrc: 3/1,0 mode: --/PR res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200188:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a081 lrc: 3/1,0 mode: PR/PR res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200194:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a081 lrc: 3/1,0 mode: PR/PR res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200266:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a088 lrc: 3/1,0 mode: --/PR res: [0x200003ab2:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200274:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a088 lrc: 3/1,0 mode: PR/PR res: [0x200003ab2:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200280:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a088 lrc: 3/1,0 mode: PR/PR res: [0x200003ab2:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191794.200331:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab2:0x9:0x0]: returning size 0 00000004:00200000:2.0:1784191794.200335:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191794.200355:0:158667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a088 lrc: 3/1,0 mode: PR/PR res: [0x200003ab2:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200366:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a088 lrc: 3/1,0 mode: PR/PR res: [0x200003ab2:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200375:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a07a lrc: 3/1,0 mode: CR/CR res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200382:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a07a lrc: 2/0,0 mode: CR/CR res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200389:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a07a lrc: 3/0,0 mode: CR/CR res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200403:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191794.200407:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a07a lrc: 3/0,0 mode: CR/CR res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200414:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a07a lrc: 4/0,0 mode: CR/CR res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200431:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab0:0x4:0x0].0x0 (ffff8af216687300) 00010000:00010000:2.0:1784191794.200434:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191794.200438:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a07a lrc: 2/0,0 mode: --/CR res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200445:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a07a lrc: 0/0,0 mode: --/CR res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200456:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a081 lrc: 3/1,0 mode: PR/PR res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200462:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a081 lrc: 2/0,0 mode: PR/PR res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200468:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a081 lrc: 3/0,0 mode: PR/PR res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200473:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191794.200476:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a081 lrc: 3/0,0 mode: PR/PR res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200481:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a081 lrc: 4/0,0 mode: PR/PR res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200487:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab0:0x4:0x0].0x1cda55a (ffff8af216636d00) 00010000:00010000:2.0:1784191794.200489:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191794.200491:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a081 lrc: 2/0,0 mode: --/PR res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200496:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a081 lrc: 0/0,0 mode: --/PR res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200533:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a073 lrc: 0/0,0 mode: --/CR res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3ad expref: 25 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200545:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a088 lrc: 3/0,0 mode: PR/PR res: [0x200003ab2:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3ad expref: 24 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.200553:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0x9:0x0].0x0 (ffff8af216636500) 00010000:00010000:2.0:1784191794.200555:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191794.200557:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5200, rc 0) 00000100:00100000:2.0:1784191794.200626:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+24:121808:x1870858812300928:12345-192.168.204.16@tcp:101:rm.0 Request processed in 613us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191794.200633:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 315 00000100:00100000:2.0:1784191794.204678:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191794.204945:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812301184 00000100:00100000:1.0:1784191794.204957:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812301184 00000100:00100000:1.0:1784191794.205025:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 316 00000100:00100000:1.0:1784191794.205036:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+24:121808:x1870858812301184:12345-192.168.204.16@tcp:36:rm.0 00010000:00010000:1.0:1784191794.205098:0:161504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784191794.205132:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a088 lrc: 0/0,0 mode: --/PR res: [0x200003ab2:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3ad expref: 24 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.205169:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0x9:0x0].0x0 (ffff8af216636500) 00010000:00010000:1.0:1784191794.205187:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5600/0xfeec3c2dc5a49f69 lrc: 0/0,0 mode: --/PR res: [0x200003ab0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b344 expref: 23 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.205198:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab0:0x4:0x0].0x0 (ffff8af216687300) 00010000:00010000:1.0:1784191794.205205:0:161504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784191794.205231:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fe00/0xfeec3c2dc5a4a08f lrc: 3/0,1 mode: --/CW res: [0x200003ab0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.205263:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fe00/0xfeec3c2dc5a4a08f lrc: 3/0,1 mode: CW/CW res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.205273:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fe00/0xfeec3c2dc5a4a08f lrc: 3/0,1 mode: CW/CW res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.205287:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a096 lrc: 3/0,1 mode: --/PW res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.205294:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a096 lrc: 3/0,1 mode: PW/PW res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.205300:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a096 lrc: 3/0,1 mode: PW/PW res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.205383:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a09d lrc: 3/0,1 mode: --/EX res: [0x200003ab2:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.205401:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a09d lrc: 3/0,1 mode: EX/EX res: [0x200003ab2:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.205409:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a09d lrc: 3/0,1 mode: EX/EX res: [0x200003ab2:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784191794.205776:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x20:0x0].41, 64 off10816 00000004:00080000:1.0:1784191794.205789:0:161504:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 5414385098772ns, next at 5415385096063ns, rc = 0 00010000:00010000:1.0:1784191794.207066:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a0a4 lrc: 3/0,1 mode: --/PW res: [0x200003ab2:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207084:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a0a4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab2:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207118:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a0a4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab2:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207127:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a0a4 lrc: 4/0,1 mode: PW/PW res: [0x200003ab2:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207138:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a0a4 lrc: 4/0,1 mode: PW/PW res: [0x200003ab2:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207273:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a0a4 lrc: 3/0,0 mode: PW/PW res: [0x200003ab2:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207301:0:161504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784191794.207449:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a09d lrc: 3/0,1 mode: EX/EX res: [0x200003ab2:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207458:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a09d lrc: 2/0,0 mode: EX/EX res: [0x200003ab2:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207465:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a09d lrc: 3/0,0 mode: EX/EX res: [0x200003ab2:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207470:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191794.207474:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a09d lrc: 3/0,0 mode: EX/EX res: [0x200003ab2:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207481:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a09d lrc: 4/0,0 mode: EX/EX res: [0x200003ab2:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207492:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0x9:0x0].0x0 (ffff8af207498800) 00010000:00010000:1.0:1784191794.207495:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784191794.207504:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a09d lrc: 2/0,0 mode: --/EX res: [0x200003ab2:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207510:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a09d lrc: 0/0,0 mode: --/EX res: [0x200003ab2:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207800:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fe00/0xfeec3c2dc5a4a08f lrc: 4/0,1 mode: CW/CW res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207808:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fe00/0xfeec3c2dc5a4a08f lrc: 4/0,1 mode: CW/CW res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207814:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fe00/0xfeec3c2dc5a4a08f lrc: 3/0,0 mode: CW/CW res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207819:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fe00/0xfeec3c2dc5a4a08f lrc: 4/0,0 mode: CW/CW res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207823:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7fe00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191794.207827:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fe00/0xfeec3c2dc5a4a08f lrc: 4/0,0 mode: CW/CW res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207833:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fe00/0xfeec3c2dc5a4a08f lrc: 5/0,0 mode: CW/CW res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207842:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab0:0x4:0x0].0x0 (ffff8af207498d00) 00010000:00010000:1.0:1784191794.207844:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191794.207847:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fe00/0xfeec3c2dc5a4a08f lrc: 3/0,0 mode: --/CW res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207853:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fe00/0xfeec3c2dc5a4a08f lrc: 0/0,0 mode: --/CW res: [0x200003ab0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191794.207875:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ab7ca329 reply state 0000000032ab710e transno 34359738581 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a096 lrc: 3/0,1 mode: PW/PW res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207896:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a096 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.207903:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab0:0x4:0x0].0x1cda55a (ffff8af207498f00) 00010000:00010000:1.0:1784191794.207905:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191794.207909:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784191794.208080:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784191794.208087:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a0a4 lrc: 2/0,0 mode: PW/PW res: [0x200003ab2:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.208094:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ee00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191794.208098:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a0a4 lrc: 2/0,0 mode: PW/PW res: [0x200003ab2:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.208104:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a0a4 lrc: 3/0,0 mode: PW/PW res: [0x200003ab2:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.208115:0:158653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0x9:0x0].0x0 (ffff8af207498800) 00010000:00010000:3.0:1784191794.208117:0:158653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784191794.208120:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a0a4 lrc: 1/0,0 mode: --/PW res: [0x200003ab2:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.208125:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a0a4 lrc: 0/0,0 mode: --/PW res: [0x200003ab2:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.208152:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191794.208155:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191794.208156:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191794.208193:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+24:121808:x1870858812301184:12345-192.168.204.16@tcp:36:rm.0 Request processed in 3155us (3522us total) trans 34359738581 rc 0/0 00000100:00100000:1.0:1784191794.208203:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 316 00000100:00100000:0.0:1784191794.213457:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191794.213598:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812301440 00000100:00100000:3.0:1784191794.213626:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812301440 00000100:00100000:3.0:1784191794.213925:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 85 00000100:00100000:3.0:1784191794.213937:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+24:121808:x1870858812301440:12345-192.168.204.16@tcp:35:rm.0 00000100:00100000:3.0:1784191794.214230:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+25:121808:x1870858812301440:12345-192.168.204.16@tcp:35:rm.0 Request processed in 294us (785us total) trans 34359738582 rc 0/0 00000100:00100000:3.0:1784191794.214239:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 85 00000100:00100000:1.0:1784191794.217471:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191794.217580:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812301696 00000100:00100000:3.0:1784191794.217593:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812301696 00000100:00100000:3.0:1784191794.217678:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 317 00000100:00100000:3.0:1784191794.217847:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+25:121808:x1870858812301696:12345-192.168.204.16@tcp:36:rm.0 00010000:00010000:3.0:1784191794.217908:0:158666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1784191794.217937:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a065 lrc: 0/0,0 mode: --/CR res: [0x200003ab2:0x8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3a6 expref: 25 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.217963:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a049 lrc: 0/0,0 mode: --/PR res: [0x200003ab2:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b398 expref: 24 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.217976:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a49f5b lrc: 0/0,0 mode: --/PR res: [0x200003ab2:0x8:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b33d expref: 23 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.217987:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0x8:0x0].0x0 (ffff8af2331f1100) 00010000:00010000:3.0:1784191794.218003:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a018 lrc: 0/0,0 mode: --/PR res: [0x200003ab2:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b383 expref: 22 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218019:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0x7:0x0].0x0 (ffff8af202c46300) 00010000:00010000:3.0:1784191794.218022:0:158666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784191794.218059:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0ab lrc: 3/0,1 mode: --/CW res: [0x200003ab2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218074:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0ab lrc: 3/0,1 mode: CW/CW res: [0x200003ab2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218084:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0ab lrc: 3/0,1 mode: CW/CW res: [0x200003ab2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218230:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a0b2 lrc: 3/0,1 mode: --/PW res: [0x200003ab2:0x7:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218239:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a0b2 lrc: 3/0,1 mode: PW/PW res: [0x200003ab2:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218246:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a0b2 lrc: 3/0,1 mode: PW/PW res: [0x200003ab2:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218321:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0b9 lrc: 3/0,1 mode: --/EX res: [0x200003ab2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218330:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0b9 lrc: 3/0,1 mode: EX/EX res: [0x200003ab2:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218336:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0b9 lrc: 3/0,1 mode: EX/EX res: [0x200003ab2:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218355:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0c0 lrc: 3/0,1 mode: --/EX res: [0x200003ab0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218361:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0c0 lrc: 3/0,1 mode: EX/EX res: [0x200003ab0:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218366:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0c0 lrc: 3/0,1 mode: EX/EX res: [0x200003ab0:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191794.218871:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab2:0x8:0x0]: returning size 4096 00010000:00010000:3.0:1784191794.218889:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0c0 lrc: 3/0,1 mode: EX/EX res: [0x200003ab0:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218897:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0c0 lrc: 2/0,0 mode: EX/EX res: [0x200003ab0:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218903:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0c0 lrc: 3/0,0 mode: EX/EX res: [0x200003ab0:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218910:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7dc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191794.218915:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0c0 lrc: 3/0,0 mode: EX/EX res: [0x200003ab0:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218922:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0c0 lrc: 4/0,0 mode: EX/EX res: [0x200003ab0:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218933:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab0:0x4:0x0].0x0 (ffff8af216603d00) 00010000:00010000:3.0:1784191794.218937:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784191794.218940:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0c0 lrc: 2/0,0 mode: --/EX res: [0x200003ab0:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218947:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0c0 lrc: 0/0,0 mode: --/EX res: [0x200003ab0:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218978:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0b9 lrc: 3/0,1 mode: EX/EX res: [0x200003ab2:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.218983:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0b9 lrc: 2/0,0 mode: EX/EX res: [0x200003ab2:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.219000:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0b9 lrc: 3/0,0 mode: EX/EX res: [0x200003ab2:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.219006:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7d600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191794.219009:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0b9 lrc: 3/0,0 mode: EX/EX res: [0x200003ab2:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.219016:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0b9 lrc: 4/0,0 mode: EX/EX res: [0x200003ab2:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.219024:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0x8:0x0].0x0 (ffff8af216603700) 00010000:00010000:3.0:1784191794.219026:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784191794.219029:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0b9 lrc: 2/0,0 mode: --/EX res: [0x200003ab2:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.219034:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0b9 lrc: 0/0,0 mode: --/EX res: [0x200003ab2:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.219054:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0ab lrc: 4/0,1 mode: CW/CW res: [0x200003ab2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.219060:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0ab lrc: 4/0,1 mode: CW/CW res: [0x200003ab2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.219065:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0ab lrc: 3/0,0 mode: CW/CW res: [0x200003ab2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.219071:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0ab lrc: 4/0,0 mode: CW/CW res: [0x200003ab2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.219075:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7ce00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191794.219085:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0ab lrc: 4/0,0 mode: CW/CW res: [0x200003ab2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.219103:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0ab lrc: 5/0,0 mode: CW/CW res: [0x200003ab2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.219112:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0x7:0x0].0x0 (ffff8af202c46300) 00010000:00010000:3.0:1784191794.219115:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191794.219118:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0ab lrc: 3/0,0 mode: --/CW res: [0x200003ab2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.219125:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0ab lrc: 0/0,0 mode: --/CW res: [0x200003ab2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191794.219137:0:158666:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027e10b27 reply state 00000000a7abbf88 transno 34359738583 ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a0b2 lrc: 3/0,1 mode: PW/PW res: [0x200003ab2:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.219210:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a0b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab2:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.219221:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0x7:0x0].0xf0209d98 (ffff8af216603100) 00010000:00010000:3.0:1784191794.219224:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191794.219226:0:158666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784191794.219555:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+23:121808:x1870858812301696:12345-192.168.204.16@tcp:36:rm.0 Request processed in 1709us (2093us total) trans 34359738583 rc 0/0 00000100:00100000:2.0:1784191794.219564:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 317 00000100:00100000:1.0:1784191794.223968:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191794.224132:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812301952 00000100:00100000:2.0:1784191794.224152:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812301952 00000100:00100000:2.0:1784191794.224221:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 86 00000100:00100000:2.0:1784191794.224232:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+23:121808:x1870858812301952:12345-192.168.204.16@tcp:35:rm.0 00000100:00100000:2.0:1784191794.224560:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+24:121808:x1870858812301952:12345-192.168.204.16@tcp:35:rm.0 Request processed in 328us (602us total) trans 34359738584 rc 0/0 00000100:00100000:2.0:1784191794.224580:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 86 00000100:00100000:0.0:1784191794.228799:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191794.228891:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812302208 00000100:00100000:3.0:1784191794.228902:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812302208 00000100:00100000:3.0:1784191794.228971:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 318 00000100:00100000:3.0:1784191794.228982:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+24:121808:x1870858812302208:12345-192.168.204.16@tcp:36:rm.0 00010000:00010000:3.0:1784191794.229045:0:158665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784191794.229074:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a034 lrc: 0/0,0 mode: --/CR res: [0x200003ab2:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b391 expref: 24 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229138:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a49c98 lrc: 0/0,0 mode: --/PR res: [0x200003ab2:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b2a3 expref: 23 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229165:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0x7:0x0].0x0 (ffff8af202c46300) 00010000:00010000:3.0:1784191794.229185:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a00a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b37c expref: 22 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229194:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191794.229198:0:158665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784191794.229220:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0c7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229232:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229241:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229255:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0ce lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2730b988 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229262:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2730b988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229267:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2730b988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229348:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0d5 lrc: 3/0,1 mode: --/EX res: [0x200003ab2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229366:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0d5 lrc: 3/0,1 mode: EX/EX res: [0x200003ab2:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229373:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0d5 lrc: 3/0,1 mode: EX/EX res: [0x200003ab2:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191794.229631:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab2:0x7:0x0]: returning size 4096 00010000:00010000:3.0:1784191794.229648:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0d5 lrc: 3/0,1 mode: EX/EX res: [0x200003ab2:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229655:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0d5 lrc: 2/0,0 mode: EX/EX res: [0x200003ab2:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229662:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0d5 lrc: 3/0,0 mode: EX/EX res: [0x200003ab2:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229667:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7dc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191794.229671:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0d5 lrc: 3/0,0 mode: EX/EX res: [0x200003ab2:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229678:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0d5 lrc: 4/0,0 mode: EX/EX res: [0x200003ab2:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229745:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0x7:0x0].0x0 (ffff8af216603d00) 00010000:00010000:3.0:1784191794.229749:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784191794.229752:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0d5 lrc: 2/0,0 mode: --/EX res: [0x200003ab2:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229758:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a0d5 lrc: 0/0,0 mode: --/EX res: [0x200003ab2:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229796:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0c7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229803:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0c7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229809:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229816:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0c7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229821:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7ce00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191794.229824:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0c7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229830:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0c7 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229839:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191794.229842:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191794.229844:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0c7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229850:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a0c7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191794.229861:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000774a12ab reply state 000000009b51f49a transno 34359738585 ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2730b988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229872:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2730b988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.229884:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2730b988 (ffff8af216603700) 00010000:00010000:3.0:1784191794.229886:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191794.229889:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784191794.229977:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+23:121808:x1870858812302208:12345-192.168.204.16@tcp:36:rm.0 Request processed in 996us (1187us total) trans 34359738585 rc 0/0 00000100:00100000:3.0:1784191794.229985:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 318 00000100:00100000:1.0:1784191794.233378:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191794.233603:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812302336 00000100:00100000:2.0:1784191794.233616:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812302336 00000100:00100000:2.0:1784191794.233749:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 319 00000100:00100000:2.0:1784191794.233760:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+23:121808:x1870858812302336:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191794.233786:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191794.233811:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a0dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b3b4 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.233887:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a0e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.233904:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.233915:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191794.233965:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191794.233970:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191794.233996:0:158667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.234020:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a0dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3b4 expref: 25 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.234039:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a0e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3b4 expref: 24 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.234046:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191794.234049:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191794.234053:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4c00, rc 0) 00000100:00100000:2.0:1784191794.234129:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+24:121808:x1870858812302336:12345-192.168.204.16@tcp:101:rm.0 Request processed in 370us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191794.234154:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 319 00000100:00100000:2.0:1784191794.246508:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191794.246599:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812302464 00000100:00100000:3.0:1784191794.246610:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812302464 00000100:00100000:3.0:1784191794.246743:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 320 00000100:00100000:3.0:1784191794.246755:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+24:121808:x1870858812302464:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191794.246873:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191794.246900:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a0ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b3bb expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.246975:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a0f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.246990:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a0f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247002:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a0f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247015:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a0f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x116badb1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247021:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247026:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247106:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a0ff lrc: 3/1,0 mode: --/PR res: [0x200003ab2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247128:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a0ff lrc: 3/1,0 mode: PR/PR res: [0x200003ab2:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247135:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a0ff lrc: 3/1,0 mode: PR/PR res: [0x200003ab2:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191794.247185:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab2:0xa:0x0]: returning size 0 00000004:00200000:0.0:1784191794.247189:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784191794.247209:0:158665:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a0ff lrc: 3/1,0 mode: PR/PR res: [0x200003ab2:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247222:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a0ff lrc: 3/1,0 mode: PR/PR res: [0x200003ab2:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247232:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a0f1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247239:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a0f1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247245:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a0f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247251:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a0f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247258:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191794.247262:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a0f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247271:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a0f1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247289:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:0.0:1784191794.247292:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191794.247297:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a0f1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247304:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a0f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247330:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247337:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a0f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247343:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a0f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247347:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191794.247350:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a0f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247356:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a0f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247363:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x116badb1 (ffff8af2331f1300) 00010000:00010000:0.0:1784191794.247366:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191794.247368:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a0f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247374:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a0f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247427:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a0ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3bb expref: 26 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247442:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a0ff lrc: 3/0,0 mode: PR/PR res: [0x200003ab2:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3bb expref: 25 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.247449:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0xa:0x0].0x0 (ffff8af2331f1e00) 00010000:00010000:0.0:1784191794.247451:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191794.247453:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5a00, rc 0) 00000100:00100000:0.0:1784191794.247523:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+25:121808:x1870858812302464:12345-192.168.204.16@tcp:101:rm.0 Request processed in 770us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191794.247531:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 320 00010000:00010000:2.0:1784191794.252872:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191794.256737:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191794.256778:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812302592 00000100:00100000:3.0:1784191794.256790:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812302592 00000100:00100000:3.0:1784191794.256848:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 210 00000100:00100000:3.0:1784191794.256857:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:69108:x1870858812302592:12345-192.168.204.16@tcp:8:rm.0 00010000:00080000:3.0:1784191794.256899:0:162392:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 8c2c50be-ac0a-45d2-a88f-69ee938110a0@192.168.204.16@tcp t0 exp 0000000000000000 cur 5414 last 0 00000020:00000080:3.0:1784191794.256936:0:162392:0:(genops.c:1406:class_connect()) connect: client 8c2c50be-ac0a-45d2-a88f-69ee938110a0, cookie 0xfeec3c2dc5a4a106 00002000:00100000:3.0:1784191794.256951:0:162392:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8c2c50be-ac0a-45d2-a88f-69ee938110a0/ffff8af104b60800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 7540736 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784191794.256970:0:162392:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784191794.257055:0:162392:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784191794.257086:0:162392:0:(import.c:65:import_set_state_nolock()) ffff8af104b67000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784191794.257180:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8c2c50be-ac0a-45d2-a88f-69ee938110a0+6:69108:x1870858812302592:12345-192.168.204.16@tcp:8:rm.0 Request processed in 322us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191794.257188:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 210 00000100:00100000:1.0:1784191794.261001:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191794.261482:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812302720 00000100:00100000:2.0:1784191794.261494:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812302720 00000100:00100000:2.0:1784191794.261654:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 211 00000100:00100000:2.0:1784191794.261666:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+6:0:x1870858812302720:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191794.261717:0:160166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191794.261741:0:160166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4a10d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b3c2 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191794.261770:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191794.261793:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c2:0x0].0x0 since=5414s v=(0 0) 00010000:00010000:2.0:1784191794.261798:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191794.261811:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4a10d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3c2 expref: 7 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.261831:0:160166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4a10d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3c2 expref: 7 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.261845:0:160166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4a00, rc 0) 00000100:00100000:2.0:1784191794.261909:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:0:x1870858812302720:12345-192.168.204.16@tcp:101:rm.0 Request processed in 246us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191794.261917:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 211 00000100:00080000:0.0:1784191794.265177:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784191794.265897:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191794.265990:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812302976 00000100:00100000:2.0:1784191794.265999:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812302976 00000100:00100000:2.0:1784191794.266064:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 321 00000100:00100000:2.0:1784191794.266075:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+25:121808:x1870858812302976:12345-192.168.204.16@tcp:36:rm.0 00010000:00010000:2.0:1784191794.266155:0:158667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784191794.266185:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a0ff lrc: 0/0,0 mode: --/PR res: [0x200003ab2:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3bb expref: 25 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.266206:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0xa:0x0].0x0 (ffff8af2331f1e00) 00010000:00010000:2.0:1784191794.266223:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a0e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3b4 expref: 24 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.266232:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191794.266235:0:158667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784191794.266259:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a114 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.266272:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a114 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.266282:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a114 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.266296:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a11b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x116badb1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.266304:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a11b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.266310:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a11b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.266578:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a122 lrc: 3/0,1 mode: --/EX res: [0x200003ab2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.266587:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a122 lrc: 3/0,1 mode: EX/EX res: [0x200003ab2:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.266595:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a122 lrc: 3/0,1 mode: EX/EX res: [0x200003ab2:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784191794.266906:0:158667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].40, 64 off10752 00000004:00080000:2.0:1784191794.266917:0:158667:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 5414446226766ns, next at 5415446224621ns, rc = 0 00010000:00010000:2.0:1784191794.266970:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a129 lrc: 3/0,1 mode: --/PW res: [0x200003ab2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.266980:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a129 lrc: 3/0,1 mode: PW/PW res: [0x200003ab2:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.266988:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a129 lrc: 3/0,1 mode: PW/PW res: [0x200003ab2:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.266995:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a129 lrc: 4/0,1 mode: PW/PW res: [0x200003ab2:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.267001:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a129 lrc: 4/0,1 mode: PW/PW res: [0x200003ab2:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.267007:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a129 lrc: 3/0,0 mode: PW/PW res: [0x200003ab2:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.267030:0:158667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191794.267052:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a122 lrc: 3/0,1 mode: EX/EX res: [0x200003ab2:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.267065:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a122 lrc: 2/0,0 mode: EX/EX res: [0x200003ab2:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.267072:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a122 lrc: 3/0,0 mode: EX/EX res: [0x200003ab2:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.267078:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191794.267083:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a122 lrc: 3/0,0 mode: EX/EX res: [0x200003ab2:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.267600:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784191794.267615:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a129 lrc: 2/0,0 mode: PW/PW res: [0x200003ab2:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.267621:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4200 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191794.267625:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a129 lrc: 2/0,0 mode: PW/PW res: [0x200003ab2:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.267632:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a129 lrc: 3/0,0 mode: PW/PW res: [0x200003ab2:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.267644:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0xa:0x0].0x0 (ffff8af216636900) 00010000:00010000:3.0:1784191794.267647:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784191794.267652:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a129 lrc: 1/0,0 mode: --/PW res: [0x200003ab2:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.267659:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a129 lrc: 0/0,0 mode: --/PW res: [0x200003ab2:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.267672:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191794.267674:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191794.267676:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191794.267940:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a122 lrc: 4/0,0 mode: EX/EX res: [0x200003ab2:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.267952:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0xa:0x0].0x0 (ffff8af216636900) 00010000:00010000:2.0:1784191794.267954:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784191794.267958:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a122 lrc: 2/0,0 mode: --/EX res: [0x200003ab2:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.267965:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a122 lrc: 0/0,0 mode: --/EX res: [0x200003ab2:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.267988:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a114 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.267994:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a114 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.268001:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a114 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.268005:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191794.268015:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a114 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.268022:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a114 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.268031:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191794.268033:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191794.268036:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a114 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.268043:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a114 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191794.268051:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009dd5bd0c reply state 000000006a49b8dd transno 34359738586 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a11b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.268065:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a11b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.268072:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x116badb1 (ffff8af216636400) 00010000:00010000:2.0:1784191794.268074:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191794.268077:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784191794.268430:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+25:121808:x1870858812302976:12345-192.168.204.16@tcp:36:rm.0 Request processed in 2352us (2535us total) trans 34359738586 rc 0/0 00000100:00100000:2.0:1784191794.268439:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 321 00000100:00100000:1.0:1784191794.287646:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191794.287852:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812303104 00000100:00100000:0.0:1784191794.287862:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812303104 00000100:00100000:0.0:1784191794.287929:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 322 00000100:00100000:0.0:1784191794.287942:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+25:121811:x1870858812303104:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1784191794.287971:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191794.287993:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a130 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b3c9 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.288053:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a137 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.288065:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a137 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.288108:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a137 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191794.288163:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784191794.288167:0:161504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784191794.288542:0:161504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a137 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.288649:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a130 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3c9 expref: 27 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.288669:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a137 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3c9 expref: 26 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.288676:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:0.0:1784191794.288678:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784191794.288680:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5800, rc 0) 00000100:00100000:0.0:1784191794.288798:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+26:121811:x1870858812303104:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 858us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191794.288815:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 322 00000100:00100000:1.0:1784191794.293534:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191794.293624:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812303232 00000100:00100000:3.0:1784191794.293635:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812303232 00000100:00100000:3.0:1784191794.293719:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 323 00000100:00100000:3.0:1784191794.293730:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+26:121811:x1870858812303232:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1784191794.293756:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191794.293787:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a13e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b3d0 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.293861:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a145 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.293896:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a145 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.293910:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a145 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.293926:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a14c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.293934:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a14c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.293942:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a14c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.293992:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a145 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.294000:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a145 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.294008:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a145 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.294016:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a145 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.294022:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7dc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191794.294027:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a145 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.294035:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a145 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.294057:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191794.294060:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191794.294065:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a145 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.294072:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a145 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.294092:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a14c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.294098:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a14c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.294103:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a14c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.294108:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7c000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191794.294111:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a14c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.294117:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a14c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.294125:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfabfbe3f (ffff8af216603d00) 00010000:00010000:3.0:1784191794.294127:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191794.294130:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a14c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.294135:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a14c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.294945:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a13e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3d0 expref: 27 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.294959:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191794.294961:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191794.294965:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a13e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3d0 expref: 27 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191794.294975:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7ce00, rc 0) 00000100:00100000:3.0:1784191794.295240:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+26:121811:x1870858812303232:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1510us (1716us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191794.295249:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 323 00000100:00100000:3.0:1784191794.301057:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191794.301342:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812303488 00000100:00100000:2.0:1784191794.301353:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812303488 00000100:00100000:2.0:1784191794.301422:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 324 00000100:00100000:2.0:1784191794.301432:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+26:121811:x1870858812303488:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:2.0:1784191794.301498:0:158665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191794.301542:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a137 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3c9 expref: 26 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.301565:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191794.301583:0:158665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784191794.301655:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a153 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.301671:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a153 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.301683:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a153 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.301752:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a15a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.301759:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a15a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.301767:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a15a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:2.0:1784191794.303049:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 253 < left 278, rollback = 2 00080000:00000400:2.0:1784191794.303057:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:2.0:1784191794.303060:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191794.303062:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/1 00080000:00000400:2.0:1784191794.303065:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/2, delete: 0/0/0 00080000:00000400:2.0:1784191794.303067:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191794.303088:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 253 < left 278, rollback = 2 00080000:00000400:2.0:1784191794.303277:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:2.0:1784191794.303280:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191794.303296:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/1 00080000:00000400:2.0:1784191794.303299:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/2, delete: 0/0/0 00080000:00000400:2.0:1784191794.303301:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191794.303425:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 253 < left 278, rollback = 2 00080000:00000400:2.0:1784191794.303429:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:2.0:1784191794.303431:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191794.303433:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/1 00080000:00000400:2.0:1784191794.303435:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/2, delete: 0/0/0 00080000:00000400:2.0:1784191794.303437:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191794.303551:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a161 lrc: 3/0,1 mode: --/PW res: [0x200003ab2:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.303633:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a161 lrc: 3/0,1 mode: PW/PW res: [0x200003ab2:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.303644:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a161 lrc: 3/0,1 mode: PW/PW res: [0x200003ab2:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191794.303666:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c9e93579 reply state 0000000081d0b2da transno 34359738587 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a161 lrc: 3/0,1 mode: PW/PW res: [0x200003ab2:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.303678:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a161 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab2:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.303817:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0xb:0x0].0x0 (ffff8af216636500) 00010000:00010000:2.0:1784191794.303822:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191794.303826:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784191794.303833:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab2:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1784191794.303843:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a153 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.303851:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a153 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.303868:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a153 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.303875:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a153 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.303882:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191794.303886:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a153 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.303894:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a153 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.303906:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191794.303908:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191794.303911:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a153 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.303918:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a153 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191794.303931:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c9e93579 reply state 0000000081d0b2da transno 34359738587 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a15a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.303939:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a15a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.303945:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfabfbe3f (ffff8af216636900) 00010000:00010000:2.0:1784191794.303947:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191794.303948:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1784191794.304116:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+27:121811:x1870858812303488:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 2681us (3069us total) trans 34359738587 rc 0/0 00000100:00100000:2.0:1784191794.304125:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 324 00000100:00100000:1.0:1784191794.332910:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191794.333021:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812303616 00000100:00100000:2.0:1784191794.333032:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812303616 00000100:00100000:2.0:1784191794.333117:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 325 00000100:00100000:2.0:1784191794.333128:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+27:121656:x1870858812303616:12345-192.168.204.16@tcp:101:bash.0 00010000:00010000:2.0:1784191794.333155:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191794.333190:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a168 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b3d7 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.333275:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a16f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.333290:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a16f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.333303:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a16f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191794.333371:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191794.333375:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191794.333410:0:158667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a16f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.333439:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a168 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3d7 expref: 29 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.333462:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a16f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3d7 expref: 28 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.333502:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191794.333506:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191794.333511:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4800, rc 0) 00000100:00100000:2.0:1784191794.334137:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+28:121656:x1870858812303616:12345-192.168.204.16@tcp:101:bash.0 Request processed in 1006us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191794.334146:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 325 00000100:00100000:1.0:1784191794.343886:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191794.343973:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812303872 00000100:00100000:0.0:1784191794.343984:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812303872 00000100:00100000:0.0:1784191794.344050:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 326 00000100:00100000:0.0:1784191794.344062:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+28:121656:x1870858812303872:12345-192.168.204.16@tcp:101:bash.0 00010000:00010000:0.0:1784191794.344084:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191794.344118:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a176 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b3de expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191794.344750:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784191794.344890:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a176 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3de expref: 30 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.344910:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff8af206f3e500) 00010000:00010000:0.0:1784191794.344913:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784191794.344918:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a176 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3de expref: 30 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.344938:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4a00, rc 0) 00000100:00100000:0.0:1784191794.345015:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+29:121656:x1870858812303872:12345-192.168.204.16@tcp:101:bash.0 Request processed in 956us (1142us total) trans 34359738588 rc 301/301 00000100:00100000:0.0:1784191794.345024:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 326 00000100:00100000:0.0:1784191794.352291:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191794.352350:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191794.352549:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812304256 00000100:00100000:2.0:1784191794.352571:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812304256 00000100:00100000:2.0:1784191794.352641:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 346 00000100:00100000:2.0:1784191794.352652:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+29:69109:x1870858812304256:12345-192.168.204.16@tcp:63:ll_sa.0 00010000:00010000:2.0:1784191794.352735:0:161739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191794.352761:0:161739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a184 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b3e5 expref: -99 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.352829:0:161739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a18b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.352844:0:161739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a18b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.352857:0:161739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a18b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.352871:0:161739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a192 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x3:0x0].0x5e1d9583 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.352878:0:161739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a192 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x5e1d9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.352898:0:161739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a192 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x5e1d9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.352947:0:161739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a18b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.352955:0:161739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a18b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.352962:0:161739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a18b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.352968:0:161739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191794.352973:0:161739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a18b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.352980:0:161739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a18b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.352993:0:161739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff8af206f3e500) 00010000:00010000:2.0:1784191794.352997:0:161739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191794.353001:0:161739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a18b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.353008:0:161739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a18b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.353021:0:161739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a192 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x5e1d9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.353027:0:161739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a192 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x5e1d9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.353040:0:161739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a192 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x5e1d9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.353046:0:161739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191794.353049:0:161739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a192 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x5e1d9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.353055:0:161739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a192 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x5e1d9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.353064:0:161739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x5e1d9583 (ffff8af210e98900) 00010000:00010000:2.0:1784191794.353066:0:161739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191794.353069:0:161739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a192 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0x5e1d9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.353075:0:161739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a192 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0x5e1d9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.353105:0:161739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a184 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3e5 expref: 30 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.353115:0:161739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff8af206f3e500) 00010000:00010000:2.0:1784191794.353117:0:161739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784191794.353121:0:161739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a184 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3e5 expref: 30 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.353130:0:161739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4400, rc -2) 00000100:00100000:2.0:1784191794.353207:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+29:69109:x1870858812304256:12345-192.168.204.16@tcp:63:ll_sa.0 Request processed in 556us (929us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784191794.353224:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 346 00000100:00100000:3.0:1784191794.354557:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812304128 00000100:00100000:3.0:1784191794.354580:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812304128 00000100:00100000:3.0:1784191794.354646:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 87 00000100:00100000:3.0:1784191794.354656:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cfd0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+29:121656:x1870858812304128:12345-192.168.204.16@tcp:35:bash.0 00000100:00100000:3.0:1784191794.354964:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cfd0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+30:121656:x1870858812304128:12345-192.168.204.16@tcp:35:bash.0 Request processed in 308us (2611us total) trans 34359738589 rc 0/0 00000100:00100000:3.0:1784191794.354972:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 87 00000100:00100000:3.0:1784191794.396974:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191794.397027:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191794.397131:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812304512 00000100:00100000:0.0:1784191794.397142:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812304512 00000100:00100000:0.0:1784191794.397219:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 327 00000100:00100000:0.0:1784191794.397232:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:121656:x1870858812304512:12345-192.168.204.16@tcp:101:bash.0 00010000:00010000:0.0:1784191794.397255:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191794.397281:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a199 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b41d expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191794.397404:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000403:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784191794.397544:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a199 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b41d expref: 9 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.397584:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff8af2331f1300) 00010000:00010000:0.0:1784191794.397588:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784191794.397595:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a199 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b41d expref: 9 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.397619:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4a00, rc 0) 00000100:00100000:0.0:1784191794.397739:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+8:121656:x1870858812304512:12345-192.168.204.16@tcp:101:bash.0 Request processed in 510us (776us total) trans 21474836523 rc 301/301 00000100:00100000:0.0:1784191794.397746:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 327 00000100:00100000:2.0:1784191794.397920:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812304640 00000100:00100000:2.0:1784191794.397926:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812304640 00000100:00100000:2.0:1784191794.397976:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 347 00000100:00100000:2.0:1784191794.397983:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+30:69109:x1870858812304640:12345-192.168.204.16@tcp:63:ll_sa.0 00010000:00010000:2.0:1784191794.398027:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191794.398044:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a1a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b416 expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398091:0:158670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ae lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398105:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398118:0:158670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398132:0:158670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1b5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x3:0x0].0xd22c9583 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398139:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xd22c9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398146:0:158670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xd22c9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398191:0:158670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398209:0:158670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ae lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398215:0:158670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398221:0:158670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191794.398225:0:158670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398233:0:158670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ae lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398243:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff8af206f3e500) 00010000:00010000:2.0:1784191794.398246:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191794.398250:0:158670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398256:0:158670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398266:0:158670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xd22c9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398272:0:158670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1b5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xd22c9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398277:0:158670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xd22c9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398281:0:158670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191794.398292:0:158670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xd22c9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398297:0:158670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1b5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xd22c9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398306:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0xd22c9583 (ffff8af210e98900) 00010000:00010000:2.0:1784191794.398308:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191794.398311:0:158670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1b5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0xd22c9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398317:0:158670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1b5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0xd22c9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398342:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a1a7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b416 expref: 31 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398352:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff8af206f3e500) 00010000:00010000:2.0:1784191794.398354:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784191794.398358:0:158670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a1a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b416 expref: 31 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.398366:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4400, rc -2) 00000100:00100000:2.0:1784191794.398418:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+30:69109:x1870858812304640:12345-192.168.204.16@tcp:63:ll_sa.0 Request processed in 435us (1389us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784191794.398424:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 347 00000100:00080000:3.0:1784191794.399043:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784191794.406903:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191794.407481:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812304896 00000100:00100000:3.0:1784191794.407495:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812304896 00000100:00100000:3.0:1784191794.407573:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 88 00000100:00100000:3.0:1784191794.407599:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+8:121656:x1870858812304896:12345-192.168.204.16@tcp:35:bash.0 00000100:00100000:3.0:1784191794.408008:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+9:121656:x1870858812304896:12345-192.168.204.16@tcp:35:bash.0 Request processed in 410us (1120us total) trans 21474836524 rc 0/0 00000100:00100000:3.0:1784191794.408016:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 88 00000100:00100000:3.0:1784191794.599195:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191794.600017:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812305024 00000100:00100000:2.0:1784191794.600030:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812305024 00000100:00100000:2.0:1784191794.600102:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 89 00000100:00100000:2.0:1784191794.600119:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+30:121656:x1870858812305024:12345-192.168.204.16@tcp:37:bash.0 00000100:00100000:2.0:1784191794.614711:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+30:121656:x1870858812305024:12345-192.168.204.16@tcp:37:bash.0 Request processed in 14567us (15495us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191794.614727:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 89 00000100:00100000:3.0:1784191794.631176:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191794.631720:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812305152 00000100:00100000:2.0:1784191794.631731:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812305152 00000100:00100000:2.0:1784191794.631788:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 328 00000100:00100000:2.0:1784191794.631796:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+30:121825:x1870858812305152:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191794.631814:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191794.631831:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a1bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b45c expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.631883:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.631895:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.631904:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.631911:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.631916:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.631920:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.631964:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5400/0xfeec3c2dc5a4a1d1 lrc: 3/1,0 mode: --/PR res: [0x200003ab2:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.631981:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5400/0xfeec3c2dc5a4a1d1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab2:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.631986:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5400/0xfeec3c2dc5a4a1d1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab2:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191794.632018:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab2:0xb:0x0]: returning size 4096 00000004:00200000:2.0:1784191794.632020:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191794.632036:0:158665:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5400/0xfeec3c2dc5a4a1d1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab2:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.632045:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1c3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.632050:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1c3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.632054:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.632058:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.632062:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191794.632065:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.632162:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1c3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.632171:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191794.632179:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191794.632183:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1c3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.632188:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a1c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.632200:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.632203:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.632207:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.632210:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191794.632212:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.632215:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.632219:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfabfbe3f (ffff8af216636900) 00010000:00010000:2.0:1784191794.632220:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191794.632222:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.632225:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a1ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.632242:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a1bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b45c expref: 32 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.632257:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5400/0xfeec3c2dc5a4a1d1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab2:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b45c expref: 31 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.632262:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0xb:0x0].0x0 (ffff8af216636500) 00010000:00010000:2.0:1784191794.632264:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191794.632265:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5400, rc 0) 00000100:00100000:2.0:1784191794.632438:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+31:121825:x1870858812305152:12345-192.168.204.16@tcp:101:rm.0 Request processed in 640us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191794.632445:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 328 00000100:00100000:3.0:1784191794.637565:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191794.637973:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812305408 00000100:00100000:0.0:1784191794.637985:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812305408 00000100:00100000:0.0:1784191794.638061:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 329 00000100:00100000:0.0:1784191794.638074:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+31:121825:x1870858812305408:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191794.638097:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191794.638120:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a1d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b463 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191794.638228:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab2:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1784191794.638343:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a1d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b463 expref: 33 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.638358:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:0.0:1784191794.638361:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784191794.638366:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a1d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b463 expref: 33 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191794.638412:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4c00, rc 0) 00000100:00100000:0.0:1784191794.638546:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+32:121825:x1870858812305408:12345-192.168.204.16@tcp:101:rm.0 Request processed in 474us (995us total) trans 34359738590 rc 301/301 00000100:00100000:0.0:1784191794.638554:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 329 00000100:00100000:0.0:1784191794.643859:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191794.644016:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812305536 00000100:00100000:3.0:1784191794.644026:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812305536 00000100:00100000:3.0:1784191794.644099:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 90 00000100:00100000:3.0:1784191794.644110:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+32:121825:x1870858812305536:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:2.0:1784191794.648645:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+32:121825:x1870858812305536:12345-192.168.204.16@tcp:37:rm.0 Request processed in 4514us (4777us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191794.648660:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 90 00000100:00100000:0.0:1784191794.653661:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191794.653879:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812305792 00000100:00100000:2.0:1784191794.653892:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812305792 00000100:00100000:2.0:1784191794.654002:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 91 00000100:00100000:2.0:1784191794.654013:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+32:121825:x1870858812305792:12345-192.168.204.16@tcp:35:rm.0 00000100:00100000:2.0:1784191794.654277:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+33:121825:x1870858812305792:12345-192.168.204.16@tcp:35:rm.0 Request processed in 265us (625us total) trans 34359738591 rc 0/0 00000100:00100000:2.0:1784191794.654285:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 91 00000100:00100000:0.0:1784191794.661360:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191794.662742:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812306048 00000100:00100000:1.0:1784191794.662757:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812306048 00000100:00100000:1.0:1784191794.662847:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 330 00000100:00100000:1.0:1784191794.662859:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+33:121825:x1870858812306048:12345-192.168.204.16@tcp:36:rm.0 00010000:00010000:1.0:1784191794.662931:0:161504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784191794.662965:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5400/0xfeec3c2dc5a4a1d1 lrc: 0/0,0 mode: --/PR res: [0x200003ab2:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b45c expref: 33 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.662990:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0xb:0x0].0x0 (ffff8af216636500) 00010000:00010000:1.0:1784191794.663018:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a16f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3d7 expref: 32 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663028:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:1.0:1784191794.663031:0:161504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784191794.663055:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4a1e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663083:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4a1e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663093:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4a1e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663103:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a1ed lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663111:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a1ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663117:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a1ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663184:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a1f4 lrc: 3/0,1 mode: --/EX res: [0x200003ab2:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663192:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a1f4 lrc: 3/0,1 mode: EX/EX res: [0x200003ab2:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663199:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a1f4 lrc: 3/0,1 mode: EX/EX res: [0x200003ab2:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191794.663787:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab2:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1784191794.663874:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a1f4 lrc: 3/0,1 mode: EX/EX res: [0x200003ab2:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663883:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a1f4 lrc: 2/0,0 mode: EX/EX res: [0x200003ab2:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663890:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a1f4 lrc: 3/0,0 mode: EX/EX res: [0x200003ab2:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663896:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191794.663901:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a1f4 lrc: 3/0,0 mode: EX/EX res: [0x200003ab2:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663908:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a1f4 lrc: 4/0,0 mode: EX/EX res: [0x200003ab2:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663919:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0xb:0x0].0x0 (ffff8af216636500) 00010000:00010000:1.0:1784191794.663922:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784191794.663926:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a1f4 lrc: 2/0,0 mode: --/EX res: [0x200003ab2:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663933:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a1f4 lrc: 0/0,0 mode: --/EX res: [0x200003ab2:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663952:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4a1e6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663958:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4a1e6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663963:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4a1e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663969:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4a1e6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663981:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191794.663985:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4a1e6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.663991:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4a1e6 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.664001:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:1.0:1784191794.664003:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191794.664006:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4a1e6 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.664012:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4a1e6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191794.664023:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000043d371d0 reply state 00000000aa090c1d transno 34359738592 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a1ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.664036:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a1ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191794.664043:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfabfbe3f (ffff8af216636900) 00010000:00010000:1.0:1784191794.664046:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191794.664048:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784191794.664272:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+33:121825:x1870858812306048:12345-192.168.204.16@tcp:36:rm.0 Request processed in 1411us (2918us total) trans 34359738592 rc 0/0 00000100:00100000:1.0:1784191794.664281:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 330 00000100:00100000:0.0:1784191794.994165:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191794.994967:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812306176 00000100:00100000:2.0:1784191794.994978:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812306176 00000100:00100000:2.0:1784191794.995048:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 331 00000100:00100000:2.0:1784191794.995059:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+33:121840:x1870858812306176:12345-192.168.204.16@tcp:101:lsof.0 00010000:00010000:2.0:1784191794.995085:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191794.995121:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a1fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b46a expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.995211:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a202 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.995225:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.995240:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191794.995289:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191794.995293:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191794.995332:0:158667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.995358:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a1fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b46a expref: 35 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.995388:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a202 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b46a expref: 34 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191794.995398:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191794.995401:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191794.995404:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5600, rc 0) 00000100:00100000:2.0:1784191794.995492:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+34:121840:x1870858812306176:12345-192.168.204.16@tcp:101:lsof.0 Request processed in 434us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191794.995499:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 331 00010000:00010000:3.0:1784191795.276728:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191795.539953:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191795.539998:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191795.540033:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191795.540079:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812306304 00000100:00100000:0.0:1784191795.540091:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812306304 00000100:00100000:0.0:1784191795.540177:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 193 00000100:00100000:0.0:1784191795.540188:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf092482-e55f-41b2-a9bc-7eac002d231d+10:69112:x1870858812306304:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191795.540266:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf092482-e55f-41b2-a9bc-7eac002d231d+10:69112:x1870858812306304:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 79us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191795.540273:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 193 00000100:00100000:1.0:1784191795.540800:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812306432 00000100:00100000:1.0:1784191795.540806:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812306432 00000100:00100000:1.0:1784191795.540850:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 217 00000100:00100000:1.0:1784191795.540870:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+9:69112:x1870858812306432:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191795.540919:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+9:69112:x1870858812306432:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 49us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191795.540925:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 217 00000100:00100000:2.0:1784191795.544653:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812306560 00000100:00100000:2.0:1784191795.544754:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812306560 00000100:00100000:2.0:1784191795.544874:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 107 00000100:00100000:2.0:1784191795.544886:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:69109:x1870858812306560:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191795.544983:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:69109:x1870858812306560:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 99us (4949us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191795.544991:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 107 00000100:00100000:3.0:1784191795.727498:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827848832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784191795.727588:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191795.727965:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827848832 00000100:00100000:0.0:1784191795.727973:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827848832 00000100:00100000:0.0:1784191795.728038:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784191795.728050:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827848832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784191795.728073:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7818944 pending 0 free 71184384 avail 64016384 00000100:00100000:3.0:1784191795.731037:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827849344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191795.731124:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191795.731622:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827848960:0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.731678:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191795.731732:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827849472:0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.731756:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191795.731772:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858827849984:0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.731789:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191795.731809:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784191795.731815:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827849088:0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.731837:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191795.731851:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827849600:0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.731868:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191795.731880:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:106501:1870858827850112:0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.731897:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191795.731940:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827849088 00000100:00100000:2.0:1784191795.731948:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827849088 00000100:00100000:2.0:1784191795.731999:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827849600 00000100:00100000:2.0:1784191795.732002:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827849600 00000100:00100000:2.0:1784191795.732020:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1784191795.732029:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827849088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.732103:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827849088:12345-0@lo:400:kworker.0 Request processed in 74us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191795.732110:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1784191795.732129:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1784191795.732134:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af107906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827849600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.732162:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af107906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827849600:12345-0@lo:400:kworker.0 Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191795.732167:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1784191795.732204:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827849088:0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.732214:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827849600:0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.732244:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827849472 00000100:00100000:2.0:1784191795.732247:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827849472 00000100:00100000:2.0:1784191795.732274:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827849984 00000100:00100000:2.0:1784191795.732276:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827849984 00000100:00100000:2.0:1784191795.732307:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827850112 00000100:00100000:2.0:1784191795.732310:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827850112 00000100:00100000:2.0:1784191795.732324:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1784191795.732330:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827849472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.732385:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827849472:12345-0@lo:400:kworker.0 Request processed in 55us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191795.732393:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1784191795.732416:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827849472:0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.732436:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1784191795.732442:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858827849984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.732472:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858827849984:12345-0@lo:400:kworker.0 Request processed in 31us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191795.732484:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1784191795.732506:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858827849984:0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.732523:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1784191795.732529:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af107904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:106501:x1870858827850112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.732561:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af107904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:106501:x1870858827850112:12345-0@lo:400:kworker.0 Request processed in 33us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191795.732567:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1784191795.732584:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:106501:1870858827850112:0@lo:400:kworker.0 00000100:00080000:2.0:1784191795.732615:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784191795.732620:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784191795.732622:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784191795.732637:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827848960 00000100:00100000:2.0:1784191795.732641:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827848960 00000100:00100000:2.0:1784191795.732667:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1784191795.732673:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827848960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.732727:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827848960:12345-0@lo:400:kworker.0 Request processed in 54us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191795.732733:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1784191795.732766:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827848960:0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.732801:0:160168:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1784191795.732808:0:160168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1784191795.732826:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827849216:0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.732852:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191795.732871:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827849728:0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.732901:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191795.732914:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858827850240:0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.732931:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191795.732947:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784191795.732952:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858827849856:0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.732971:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191795.732981:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858827850368:0@lo:400:kworker.0 00000100:00100000:0.0:1784191795.735026:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827848832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6967us (7426us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191795.735043:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784191795.735080:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827849344 00000100:00100000:0.0:1784191795.735087:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827849344 00000100:00100000:3.0:1784191795.735112:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827848832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784191795.735162:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784191795.735170:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827849344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784191795.735196:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7818944 pending 0 free 71184384 avail 64016384 00000100:00100000:0.0:1784191795.735684:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827849344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 513us (4558us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191795.735711:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784191795.735731:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827850240 00000100:00100000:3.0:1784191795.735737:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827850240 00000100:00100000:0.0:1784191795.735754:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827849216 00000100:00100000:0.0:1784191795.735758:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827849216 00000100:00100000:3.0:1784191795.735765:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827849856 00000100:00100000:3.0:1784191795.735767:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827849856 00000100:00100000:3.0:1784191795.735780:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1784191795.735780:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827849728 00000100:00100000:0.0:1784191795.735783:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827849728 00000100:00100000:3.0:1784191795.735786:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af107905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858827850240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191795.735839:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af107905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858827850240:12345-0@lo:400:kworker.0 Request processed in 53us (2907us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191795.735847:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1784191795.735861:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1784191795.735867:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af107907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858827849856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191795.735895:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af107907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858827849856:12345-0@lo:400:kworker.0 Request processed in 28us (2923us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191795.735902:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:3.0:1784191795.736052:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784191795.736056:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784191795.736058:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784191795.736070:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784191795.736078:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af107904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827849216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191795.736112:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af107904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827849216:12345-0@lo:400:kworker.0 Request processed in 36us (3260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191795.736119:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784191795.736277:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784191795.736284:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af107905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827849728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191795.736318:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af107905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827849728:12345-0@lo:400:kworker.0 Request processed in 36us (3416us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191795.736325:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784191795.736492:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827849344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784191795.736900:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191795.736954:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827850368 00000100:00100000:3.0:1784191795.736959:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827850368 00000100:00100000:3.0:1784191795.737040:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1784191795.737046:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af107904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858827850368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191795.737085:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af107904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858827850368:12345-0@lo:400:kworker.0 Request processed in 39us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191795.737091:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:0.0:1784191795.737132:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784191795.737420:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858827850368:0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.737434:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827849216:0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.737445:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827849728:0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.737455:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858827850240:0@lo:400:kworker.0 00000100:00100000:2.0:1784191795.737485:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858827849856:0@lo:400:kworker.0 00000004:00080000:1.0:1784191795.739178:0:158692:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 5415918486298ns, next at 5416918483924ns, rc = 0 00010000:00010000:2.0:1784191796.299951:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191797.324513:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191798.284039:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827850496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784191798.284139:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191798.284250:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827850496 00000100:00100000:0.0:1784191798.284259:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827850496 00000100:00100000:0.0:1784191798.284351:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784191798.284361:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827850496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784191798.284393:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71049216 avail 63881216 00000100:00100000:0.0:1784191798.284450:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827850496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191798.284457:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1784191798.284536:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784191798.284635:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827850496:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784191798.348032:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191798.795914:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784191798.795941:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827850624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784191798.796043:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191798.796413:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827850752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191798.796457:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191798.804181:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827850624 00000100:00100000:1.0:1784191798.804198:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827850624 00000100:00100000:1.0:1784191798.804272:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827850752 00000100:00100000:1.0:1784191798.804276:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827850752 00000100:00100000:1.0:1784191798.804302:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1784191798.804322:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827850624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784191798.804382:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42786816 avail 36655104 00000100:00100000:1.0:1784191798.804627:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827850624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 306us (8583us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191798.804637:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1784191798.804684:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1784191798.804710:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827850752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784191798.804729:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42659840 avail 36528128 00000100:00100000:1.0:1784191798.804761:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827850752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (8303us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191798.804767:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1784191798.804843:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827850624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784191798.804861:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827850752:0@lo:41:osp-pre-0-1.0 00000004:00080000:0.0:1784191799.308375:0:158690:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 5419487682778ns, next at 5420487679917ns, rc = 0 00000100:00100000:3.0:1784191799.309747:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784191799.309780:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827850880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784191799.309863:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191799.310583:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827850880 00000100:00100000:0.0:1784191799.310592:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827850880 00000100:00100000:0.0:1784191799.310671:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784191799.310714:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827850880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784191799.310745:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71049216 avail 63881216 00000100:00080000:3.0:1784191799.310921:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191799.311065:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827850880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 374us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191799.311073:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000004:00080000:1.0:1784191799.315788:0:158645:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 23 committed 00000004:00080000:1.0:1784191799.315813:0:158645:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 23 committed 00000001:00080000:1.0:1784191799.315852:0:158645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738592 is committed 00000004:00080000:1.0:1784191799.315891:0:158645:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 22 committed 00000004:00080000:1.0:1784191799.315911:0:158645:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 22 committed 00010000:00010000:3.0:1784191799.316113:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a096 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316126:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a096 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316134:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a096 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316141:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191799.316146:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a096 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316154:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a096 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316172:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab0:0x4:0x0].0x1cda55a (ffff8af207498f00) 00010000:00010000:3.0:1784191799.316175:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191799.316180:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a096 lrc: 2/0,0 mode: --/TXN res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316186:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a096 lrc: 0/0,0 mode: --/TXN res: [0x200003ab0:0x4:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316215:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a0b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab2:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316238:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a0b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab2:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316244:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a0b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab2:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316249:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7c600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191799.316251:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a0b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab2:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316258:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a0b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab2:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316266:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0x7:0x0].0xf0209d98 (ffff8af216603100) 00010000:00010000:3.0:1784191799.316269:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191799.316272:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a0b2 lrc: 2/0,0 mode: --/TXN res: [0x200003ab2:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316278:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a0b2 lrc: 0/0,0 mode: --/TXN res: [0x200003ab2:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316312:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2730b988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316319:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2730b988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316324:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2730b988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316329:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7d600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191799.316339:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2730b988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316345:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2730b988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316354:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2730b988 (ffff8af216603700) 00010000:00010000:3.0:1784191799.316356:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191799.316359:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0ce lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2730b988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316365:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a0ce lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2730b988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316388:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a11b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316394:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a11b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316400:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a11b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316405:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191799.316408:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a11b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316414:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a11b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316422:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x116badb1 (ffff8af216636400) 00010000:00010000:3.0:1784191799.316424:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191799.316433:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a11b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316439:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a11b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x116badb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316454:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a15a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316460:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a15a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316477:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a15a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316482:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191799.316486:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a15a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316491:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a15a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316499:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfabfbe3f (ffff8af216636900) 00010000:00010000:3.0:1784191799.316501:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191799.316503:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a15a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316509:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a15a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316517:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a161 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab2:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316534:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a161 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab2:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316540:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a161 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab2:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316544:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191799.316547:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a161 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab2:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316553:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a161 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab2:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316560:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab2:0xb:0x0].0x0 (ffff8af216636500) 00010000:00010000:3.0:1784191799.316562:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191799.316565:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a161 lrc: 2/0,0 mode: --/TXN res: [0x200003ab2:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316570:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a161 lrc: 0/0,0 mode: --/TXN res: [0x200003ab2:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316582:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a1ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316588:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a1ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316593:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a1ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316597:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191799.316605:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a1ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316612:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a1ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316619:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfabfbe3f (ffff8af216636900) 00010000:00010000:3.0:1784191799.316622:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191799.316625:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a1ed lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191799.316630:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a1ed lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191799.317247:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784191799.317269:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827851136:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784191799.317359:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191799.317411:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827851136 00000100:00100000:0.0:1784191799.317418:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827851136 00000100:00100000:0.0:1784191799.317483:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1784191799.317492:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827851136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1784191799.317522:0:160165:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:130 count 1 00002000:00010000:0.0:1784191799.317561:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x82:0x0] initial LVB size: 0, mtime: 0x6a589b09, atime: 0x6a589b09, ctime: 0x6a589b09, blocks: 0x0 00010000:00010000:0.0:1784191799.317569:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4a209 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.317589:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x82:0x0].0x0 since=5419s v=(0 0) 00010000:00010000:0.0:1784191799.317594:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191799.317602:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4a209 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.317620:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4a209 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.317630:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4a209 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.317650:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4a209 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.317675:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784191799.317869:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:106502:x1870858827851136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 378us (509us total) trans 21474836530 rc 0/0 00000100:00100000:0.0:1784191799.317876:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000004:00080000:0.0:1784191799.317937:0:106502:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af227cd3100/2, rc 0, transno 21474836530 00000100:00100000:0.0:1784191799.317943:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827851136:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1784191799.317969:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191799.317975:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4a209 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.317982:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5e00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191799.317986:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4a209 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.317995:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4a209 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.318010:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4a209 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.318017:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4a209 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.318047:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191799.318048:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191799.318050:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191799.320896:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784191799.320946:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827851008:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784191799.321029:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191799.321390:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827851008 00000100:00100000:0.0:1784191799.321400:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827851008 00000100:00100000:0.0:1784191799.321478:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1784191799.321490:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827851008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784191799.321521:0:162391:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:450 count 1 00010000:00010000:0.0:1784191799.321548:0:162391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4a210 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.321570:0:162391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4a10d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3c2 expref: 6 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.321578:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c2:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1784191799.321582:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191799.321587:0:162391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4a210 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.321619:0:162391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4a10d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x50000000010020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3c2 expref: 6 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.321634:0:162391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4a10d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x70000400010020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3c2 expref: 6 pid: 160166 timeout: 5519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191799.321646:0:162391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101687100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:162391:1870858827851264:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191799.321752:0:162391:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e738000 going to sleep for 11 seconds 00000100:00080000:3.0:1784191799.322314:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784191799.322505:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827850880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784191799.329240:0:162391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101687100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:162391:1870858827851264:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191799.329281:0:162391:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4a210 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191799.336847:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191799.338123:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812306688 00000100:00100000:0.0:1784191799.338143:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812306688 00010000:00010000:0.0:1784191799.338239:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4a10d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x60000400010020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3c2 expref: 7 pid: 160166 timeout: 5519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191799.338305:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 87 00000100:00100000:0.0:1784191799.338318:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:69110:x1870858812306688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191799.338335:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191799.338342:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4a10d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x60000400010020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3c2 expref: 7 pid: 160166 timeout: 5519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.338361:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4a10d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x50000400010020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3c2 expref: 7 pid: 160166 timeout: 5519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.338392:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4a10d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->67108863) gid 0 flags: 0x44801400010020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b3c2 expref: 7 pid: 160166 timeout: 5519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.338415:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191799.338421:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191799.338428:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4a210 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.338461:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4a210 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.338506:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191799.338582:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+6:69110:x1870858812306688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 267us (1749us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191799.338591:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 87 00010000:00010000:2.0:1784191799.339537:0:162391:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4a210 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191799.339554:0:162391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4a210 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191799.339567:0:162391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4a210 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191799.339576:0:162391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4a210 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191799.339606:0:162391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784191799.339875:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:106499:x1870858827851008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18386us (18843us total) trans 17179869231 rc 0/0 00000100:00100000:2.0:1784191799.339884:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000004:00080000:2.0:1784191799.339943:0:106499:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af10ec84e00/2, rc 0, transno 17179869231 00000100:00100000:2.0:1784191799.339950:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827851008:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1784191799.340984:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784191799.341138:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191799.341151:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4a210 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.341162:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4400 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191799.341167:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4a210 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.341177:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4a210 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.341197:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4a210 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.341204:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4a210 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191799.341225:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191799.341234:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191799.341236:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784191799.343418:0:160977:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869231 is committed 00000001:00100000:1.0:1784191799.343438:0:160977:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8c2c50be-ac0a-45d2-a88f-69ee938110a0 00010000:00010000:3.0:1784191799.375474:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784191799.826104:0:159395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474836524 is committed 00010000:00010000:0.0:1784191800.395971:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191800.664062:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191800.664115:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191800.664157:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191800.664371:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812307072 00000100:00100000:3.0:1784191800.664383:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812307072 00000100:00100000:3.0:1784191800.664465:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812306944 00000100:00100000:3.0:1784191800.664469:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812306944 00000100:00080000:1.0:1784191800.664533:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784191800.664570:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 224 00000100:00100000:1.0:1784191800.664584:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:69109:x1870858812307072:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191800.664728:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:69109:x1870858812307072:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 109us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191800.664738:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 224 00000100:00100000:2.0:1784191800.665061:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812306816 00000100:00100000:2.0:1784191800.665067:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812306816 00000100:00100000:2.0:1784191800.665104:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 195 00000100:00100000:2.0:1784191800.665114:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf092482-e55f-41b2-a9bc-7eac002d231d+10:69111:x1870858812306816:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191800.665147:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191800.665156:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf092482-e55f-41b2-a9bc-7eac002d231d+10:69111:x1870858812306816:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 42us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191800.665165:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 195 00000100:00100000:0.0:1784191800.665254:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812307200 00000100:00100000:0.0:1784191800.665258:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812307200 00000100:00100000:3.0:1784191800.665268:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 225 00000100:00100000:3.0:1784191800.665289:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+10:69111:x1870858812306944:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191800.665309:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 110 00000100:00100000:0.0:1784191800.665319:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c2c50be-ac0a-45d2-a88f-69ee938110a0+5:69110:x1870858812307200:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191800.665337:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+10:69111:x1870858812306944:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 50us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191800.665345:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 225 00000100:00100000:0.0:1784191800.665360:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8c2c50be-ac0a-45d2-a88f-69ee938110a0+5:69110:x1870858812307200:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 41us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191800.665369:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 110 00000100:00080000:3.0:1784191800.665378:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784191800.844009:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858827851392:0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.844020:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827851776:0@lo:400:kworker.0 00000100:00100000:1.0:1784191800.844155:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827851520:0@lo:400:kworker.0 00000100:00100000:0.0:1784191800.845246:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827851648:0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.846616:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191800.846685:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827852288:0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.846750:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191800.846778:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191800.846876:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827851776 00000100:00100000:3.0:1784191800.846883:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827851776 00000100:00100000:2.0:1784191800.847029:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858827851904:0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.847033:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827852288 00000100:00100000:3.0:1784191800.847107:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827852288 00000100:00100000:3.0:1784191800.847146:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784191800.847155:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827851776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.847209:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827851776:12345-0@lo:400:kworker.0 Request processed in 55us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191800.847216:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784191800.847235:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784191800.847240:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827852288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.847280:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827852288:12345-0@lo:400:kworker.0 Request processed in 27us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191800.847288:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1784191800.847307:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784191800.847308:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191800.847339:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858827852416:0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.847347:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827851392 00000100:00100000:3.0:1784191800.847352:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827851392 00000100:00100000:3.0:1784191800.847380:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1784191800.847387:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858827851392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.847419:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858827851392:12345-0@lo:400:kworker.0 Request processed in 33us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191800.847425:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1784191800.847480:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827852288:0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.847488:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858827852800:0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.847527:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191800.847778:0:106501:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869231 gen 2 00000004:00080000:3.0:1784191800.847783:0:106501:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af10ec84e00, transno 17179869231 00000100:00100000:3.0:1784191800.847794:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827851776:0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.847939:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827851904 00000100:00100000:2.0:1784191800.847945:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191800.847946:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827851904 00000100:00100000:2.0:1784191800.847973:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858827852928:0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.847981:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827852800 00000100:00100000:3.0:1784191800.847986:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827852800 00000100:00100000:2.0:1784191800.848002:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191800.848013:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827852416 00000100:00100000:3.0:1784191800.848017:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827852416 00000100:00100000:2.0:1784191800.848031:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858827851392:0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.848044:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827852928 00000100:00100000:3.0:1784191800.848049:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827852928 00000100:00100000:3.0:1784191800.848072:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1784191800.848080:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858827851904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191800.848087:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1784191800.848127:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858827851904:12345-0@lo:400:kworker.0 Request processed in 48us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191800.848134:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1784191800.848147:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784191800.848152:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858827852416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.848195:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858827852416:12345-0@lo:400:kworker.0 Request processed in 26us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191800.848202:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784191800.848217:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1784191800.848223:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858827852928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.848251:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858827852928:12345-0@lo:400:kworker.0 Request processed in 28us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191800.848257:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:3.0:1784191800.848294:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784191800.848298:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784191800.848347:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858827851904:0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.848357:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858827852416:0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.848366:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858827852928:0@lo:400:kworker.0 00000100:00100000:2.0:1784191800.848707:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858827852800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191800.848760:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858827852800:12345-0@lo:400:kworker.0 Request processed in 664us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191800.848767:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1784191800.848805:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858827852800:0@lo:400:kworker.0 00000100:00100000:1.0:1784191800.853638:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191800.853713:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827852032:0@lo:400:kworker.0 00000100:00100000:1.0:1784191800.853747:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191800.853768:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858827852544:0@lo:400:kworker.0 00000100:00100000:1.0:1784191800.853799:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191800.853854:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827853056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784191800.853882:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191800.854405:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827851520 00000100:00100000:3.0:1784191800.854415:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827851520 00000100:00100000:3.0:1784191800.854482:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827852032 00000100:00100000:3.0:1784191800.854485:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827852032 00000100:00100000:3.0:1784191800.854517:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1784191800.854525:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827851520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.854594:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827851520:12345-0@lo:400:kworker.0 Request processed in 70us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191800.854602:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1784191800.854619:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1784191800.854625:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827852032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.854652:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827852032:12345-0@lo:400:kworker.0 Request processed in 27us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191800.854658:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1784191800.854967:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827852544 00000100:00100000:1.0:1784191800.854974:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827852544 00000100:00100000:1.0:1784191800.855029:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1784191800.855035:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858827852544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191800.855081:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858827852544:12345-0@lo:400:kworker.0 Request processed in 46us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191800.855088:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1784191800.855147:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827851520:0@lo:400:kworker.0 00000100:00100000:1.0:1784191800.855161:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827852032:0@lo:400:kworker.0 00000100:00100000:1.0:1784191800.855171:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858827852544:0@lo:400:kworker.0 00000100:00080000:3.0:1784191800.855927:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784191800.856052:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827853056 00000100:00100000:2.0:1784191800.856059:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827853056 00000100:00100000:2.0:1784191800.856105:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784191800.856114:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827853056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784191800.856144:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7818944 pending 0 free 71184384 avail 64016384 00000100:00100000:2.0:1784191800.856216:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827853056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191800.856224:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784191800.856387:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827853056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784191800.859409:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191800.859542:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827852160:0@lo:400:kworker.0 00000100:00100000:0.0:1784191800.859574:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191800.864245:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858827852672:0@lo:400:kworker.0 00000100:00100000:0.0:1784191800.864331:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191800.864351:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827853184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784191800.864377:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191800.864411:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827853184 00000100:00100000:0.0:1784191800.864420:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827853184 00000100:00100000:0.0:1784191800.864473:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784191800.864483:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827853184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784191800.864524:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7818944 pending 0 free 71184384 avail 64016384 00000100:00100000:0.0:1784191800.864568:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827853184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191800.864593:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784191800.864644:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827853184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191800.864992:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827852672 00000100:00100000:1.0:1784191800.864998:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827852672 00000100:00100000:1.0:1784191800.865056:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1784191800.865063:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858827852672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191800.865107:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858827852672:12345-0@lo:400:kworker.0 Request processed in 44us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191800.865114:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:0.0:1784191800.865336:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784191800.865361:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858827852672:0@lo:400:kworker.0 00000100:00100000:2.0:1784191800.865422:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827851648 00000100:00100000:2.0:1784191800.865428:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827851648 00000100:00100000:2.0:1784191800.865605:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827852160 00000100:00100000:2.0:1784191800.865617:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827852160 00000100:00080000:1.0:1784191800.865684:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784191800.865758:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784191800.865768:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:106500:x1870858827851648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.865836:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:106500:x1870858827851648:12345-0@lo:400:kworker.0 Request processed in 71us (6437us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191800.865849:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784191800.865864:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784191800.865870:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827852160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191800.865902:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827852160:12345-0@lo:400:kworker.0 Request processed in 32us (6327us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191800.865907:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784191800.865979:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827851648:0@lo:400:kworker.0 00000100:00100000:1.0:1784191800.865991:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827852160:0@lo:400:kworker.0 00010000:00010000:0.0:1784191801.421560:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191802.450299:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191803.404333:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827853312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784191803.404435:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191803.404781:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827853312 00000100:00100000:1.0:1784191803.404791:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827853312 00000100:00080000:0.0:1784191803.404923:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784191803.405048:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784191803.405074:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827853312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784191803.405109:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71049216 avail 63881216 00000100:00100000:1.0:1784191803.405174:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827853312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191803.405182:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784191803.405279:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827853312:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784191803.467876:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191803.916333:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827853440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784191803.916432:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191803.916456:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827853568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191803.916495:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827853440 00000100:00100000:0.0:1784191803.916503:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827853440 00000100:00100000:3.0:1784191803.916512:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191803.916558:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827853568 00000100:00100000:2.0:1784191803.916564:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827853568 00000100:00100000:0.0:1784191803.916564:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1784191803.916584:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827853440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784191803.916625:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42786816 avail 36655104 00000100:00100000:0.0:1784191803.916675:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827853440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191803.916789:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827853440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784191803.920792:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1784191803.920818:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101186850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827853568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784191803.920862:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42659840 avail 36528128 00000100:00100000:2.0:1784191803.920972:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101186850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827853568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 166us (4459us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191803.920980:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1784191803.923301:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827853568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191803.925607:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1784191804.432159:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827853696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784191804.432250:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191804.432309:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827853696 00000100:00100000:3.0:1784191804.432316:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827853696 00000100:00100000:3.0:1784191804.432396:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784191804.432405:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:106500:x1870858827853696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784191804.432429:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71049216 avail 63881216 00000100:00100000:3.0:1784191804.432485:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:106500:x1870858827853696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191804.432503:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1784191804.432526:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784191804.432570:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827853696:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784191804.494290:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784191804.944990:0:160160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836530 is committed 00010000:00010000:3.0:1784191805.517970:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191805.782554:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191805.782610:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191805.782642:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191805.782721:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191805.782861:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812307456 00000100:00100000:1.0:1784191805.782870:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812307456 00000100:00100000:1.0:1784191805.782936:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812307584 00000100:00100000:1.0:1784191805.782940:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812307584 00000100:00100000:1.0:1784191805.782963:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 232 00000100:00100000:1.0:1784191805.782973:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+10:69112:x1870858812307456:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191805.783057:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+10:69112:x1870858812307456:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 85us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191805.783065:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 232 00000100:00100000:1.0:1784191805.783083:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 233 00000100:00100000:1.0:1784191805.783090:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:69109:x1870858812307584:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191805.783115:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:69109:x1870858812307584:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 25us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191805.783122:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 233 00000100:00080000:3.0:1784191805.783277:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784191805.783282:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784191805.783356:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812307712 00000100:00100000:0.0:1784191805.783361:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812307712 00000100:00100000:0.0:1784191805.783411:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 115 00000100:00100000:0.0:1784191805.783421:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c2c50be-ac0a-45d2-a88f-69ee938110a0+5:69109:x1870858812307712:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191805.783474:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8c2c50be-ac0a-45d2-a88f-69ee938110a0+5:69109:x1870858812307712:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 56us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191805.783481:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 115 00000100:00080000:3.0:1784191805.783608:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784191805.784268:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812307328 00000100:00100000:2.0:1784191805.784276:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812307328 00000100:00100000:2.0:1784191805.784313:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 197 00000100:00100000:2.0:1784191805.784320:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af11066ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf092482-e55f-41b2-a9bc-7eac002d231d+10:69112:x1870858812307328:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191805.784390:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af11066ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf092482-e55f-41b2-a9bc-7eac002d231d+10:69112:x1870858812307328:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 69us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191805.784397:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 197 00000100:00100000:3.0:1784191805.964882:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827853824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191805.964962:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191805.965858:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827853824 00000100:00100000:1.0:1784191805.965868:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827853824 00000100:00100000:1.0:1784191805.965944:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784191805.965953:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827853824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784191805.965983:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7818944 pending 0 free 71184384 avail 64016384 00000100:00100000:1.0:1784191805.966061:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827853824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191805.966068:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784191805.966114:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827853952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191805.966146:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784191805.966244:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784191805.966290:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827853824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191805.966317:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827853952 00000100:00100000:3.0:1784191805.966321:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827853952 00000100:00100000:3.0:1784191805.966370:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784191805.966377:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827853952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784191805.966389:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7818944 pending 0 free 71184384 avail 64016384 00000100:00100000:3.0:1784191805.966431:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827853952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191805.966437:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1784191805.966988:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784191805.968609:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827853952:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784191805.974242:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827854080:0@lo:400:kworker.0 00000100:00100000:0.0:1784191805.974333:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191805.974394:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827854592:0@lo:400:kworker.0 00000100:00100000:0.0:1784191805.974435:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191805.974478:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858827855104:0@lo:400:kworker.0 00000100:00100000:1.0:1784191805.974479:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827854080 00000100:00100000:1.0:1784191805.974497:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827854080 00000100:00100000:0.0:1784191805.974511:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191805.974544:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784191805.974557:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827854208:0@lo:400:kworker.0 00000100:00100000:0.0:1784191805.974586:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191805.974591:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1784191805.974615:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827854720:0@lo:400:kworker.0 00000100:00100000:1.0:1784191805.974623:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858827854080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191805.974652:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191805.974679:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858827855232:0@lo:400:kworker.0 00000100:00100000:0.0:1784191805.974796:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191805.974841:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827854080:0@lo:400:kworker.0 00000100:00100000:0.0:1784191805.974886:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827854592 00000100:00100000:0.0:1784191805.974898:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827854592 00000100:00100000:3.0:1784191805.975010:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827854336:0@lo:400:kworker.0 00000100:00100000:3.0:1784191805.975044:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191805.975068:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827854848:0@lo:400:kworker.0 00000100:00100000:3.0:1784191805.975091:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191805.975108:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827855360:0@lo:400:kworker.0 00000100:00100000:3.0:1784191805.975128:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191805.975148:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784191805.975211:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827854208 00000100:00100000:0.0:1784191805.975216:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827854208 00000100:00100000:3.0:1784191805.975236:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827854464:0@lo:400:kworker.0 00000100:00100000:0.0:1784191805.975239:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1784191805.975248:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827854592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191805.975280:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191805.975295:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858827854976:0@lo:400:kworker.0 00000100:00100000:0.0:1784191805.975325:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827854592:12345-0@lo:400:kworker.0 Request processed in 76us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191805.975329:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191805.975339:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1784191805.975360:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827855104 00000100:00100000:0.0:1784191805.975365:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1784191805.975367:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827855104 00000100:00100000:0.0:1784191805.975374:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827854208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191805.975412:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827854208:12345-0@lo:400:kworker.0 Request processed in 40us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191805.975417:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1784191805.975425:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827855232 00000100:00100000:3.0:1784191805.975430:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827855232 00000100:00100000:0.0:1784191805.975444:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827854720 00000100:00100000:0.0:1784191805.975449:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827854720 00000100:00100000:3.0:1784191805.975450:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827854848 00000100:00100000:3.0:1784191805.975455:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827854848 00000100:00100000:3.0:1784191805.975470:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827855360 00000100:00100000:3.0:1784191805.975473:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827855360 00000100:00100000:3.0:1784191805.975484:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827854464 00000100:00100000:3.0:1784191805.975486:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827854464 00000100:00100000:3.0:1784191805.975509:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827854976 00000100:00100000:3.0:1784191805.975512:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827854976 00000100:00100000:3.0:1784191805.975527:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1784191805.975533:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858827855104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191805.975581:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858827855104:12345-0@lo:400:kworker.0 Request processed in 48us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191805.975604:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827854336 00000100:00100000:0.0:1784191805.975608:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827854336 00000100:00100000:0.0:1784191805.975629:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784191805.975635:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827854720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191805.975666:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827854720:12345-0@lo:400:kworker.0 Request processed in 31us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191805.975671:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784191805.975682:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1784191805.975707:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827854336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191805.976042:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1784191805.976059:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1784191805.976066:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858827855232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191805.976100:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858827855232:12345-0@lo:400:kworker.0 Request processed in 35us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191805.976105:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1784191805.976116:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1784191805.976122:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827854848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191805.976197:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858827854080:12345-0@lo:400:kworker.0 Request processed in 1576us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191805.976211:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1784191805.976257:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827854848:12345-0@lo:400:kworker.0 Request processed in 131us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191805.976275:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1784191805.976293:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1784191805.976299:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827855360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191805.976335:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827855360:12345-0@lo:400:kworker.0 Request processed in 36us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191805.976339:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1784191805.976349:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1784191805.976354:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827854464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191805.976379:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827854464:12345-0@lo:400:kworker.0 Request processed in 24us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191805.976385:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1784191805.976395:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1784191805.976400:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858827854976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191805.976875:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858827854976:12345-0@lo:400:kworker.0 Request processed in 473us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191805.976882:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:3.0:1784191805.976909:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784191805.976915:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784191805.976917:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191805.976949:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827854464:0@lo:400:kworker.0 00000100:00100000:3.0:1784191805.976960:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858827854976:0@lo:400:kworker.0 00000100:00100000:3.0:1784191805.976970:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827854848:0@lo:400:kworker.0 00000100:00100000:3.0:1784191805.976979:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827855360:0@lo:400:kworker.0 00000100:00100000:3.0:1784191805.979324:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827854208:0@lo:400:kworker.0 00000100:00100000:3.0:1784191805.979338:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827854720:0@lo:400:kworker.0 00000100:00100000:3.0:1784191805.979350:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858827855232:0@lo:400:kworker.0 00000100:00100000:3.0:1784191805.979362:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827854592:0@lo:400:kworker.0 00000100:00100000:3.0:1784191805.979374:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858827855104:0@lo:400:kworker.0 00000100:00100000:0.0:1784191805.982642:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827854336:12345-0@lo:400:kworker.0 Request processed in 6941us (7584us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191805.982658:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784191805.983624:0:106501:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836530 gen 2 00000004:00080000:3.0:1784191805.983634:0:106501:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af227cd3100, transno 21474836530 00000100:00100000:3.0:1784191805.983861:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827854336:0@lo:400:kworker.0 00010000:00010000:2.0:1784191806.539880:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191807.564042:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191808.525286:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827855488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784191808.525366:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191808.525562:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827855488 00000100:00100000:0.0:1784191808.525571:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827855488 00000100:00100000:0.0:1784191808.525647:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784191808.525657:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827855488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784191808.525737:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71049216 avail 63881216 00000100:00100000:0.0:1784191808.525800:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827855488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 145us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191808.525808:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784191808.525906:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827855488:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784191808.526005:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784191808.588119:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191809.036024:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784191809.036050:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827855616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191809.036135:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191809.036788:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827855616 00000100:00100000:1.0:1784191809.036797:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827855616 00000100:00100000:1.0:1784191809.036852:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1784191809.036861:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858827855616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784191809.036898:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42659840 avail 36528128 00000100:00100000:1.0:1784191809.036962:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858827855616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191809.036969:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1784191809.037124:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827855744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784191809.037158:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191809.037206:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827855616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191809.037342:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827855744 00000100:00100000:0.0:1784191809.037347:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827855744 00000100:00100000:0.0:1784191809.037383:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1784191809.037391:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827855744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784191809.037410:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42786816 avail 36655104 00000100:00100000:0.0:1784191809.037460:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827855744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191809.037466:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1784191809.037895:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827855744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784191809.548756:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784191809.548795:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827855872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784191809.548889:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191809.549033:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827855872 00000100:00100000:3.0:1784191809.549041:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827855872 00000100:00100000:3.0:1784191809.549121:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784191809.549132:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827855872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784191809.549155:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71049216 avail 63881216 00000100:00100000:3.0:1784191809.549220:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827855872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191809.549228:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784191809.549274:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827855872:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784191809.553270:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784191809.612509:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191810.635951:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191810.905780:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191810.905831:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191810.905900:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812307968 00000100:00100000:1.0:1784191810.905909:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812307968 00000100:00100000:1.0:1784191810.905995:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 240 00000100:00100000:1.0:1784191810.906006:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+10:69111:x1870858812307968:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191810.906090:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+10:69111:x1870858812307968:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 76us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191810.906115:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 240 00000100:00080000:2.0:1784191810.906188:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784191810.907626:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812307840 00000100:00100000:3.0:1784191810.907640:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812307840 00000100:00100000:3.0:1784191810.907751:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 199 00000100:00100000:3.0:1784191810.907761:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf092482-e55f-41b2-a9bc-7eac002d231d+10:69111:x1870858812307840:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191810.908199:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf092482-e55f-41b2-a9bc-7eac002d231d+10:69111:x1870858812307840:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 438us (2428us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191810.908207:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 199 00000100:00100000:0.0:1784191810.913488:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191810.913650:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191810.913778:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812308096 00000100:00100000:3.0:1784191810.913786:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812308096 00000100:00100000:3.0:1784191810.913870:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 241 00000100:00100000:3.0:1784191810.913881:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:69109:x1870858812308096:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191810.913965:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:69109:x1870858812308096:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 86us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191810.913973:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 241 00000100:00080000:0.0:1784191810.914065:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784191810.914380:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812308224 00000100:00100000:1.0:1784191810.914386:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812308224 00000100:00100000:1.0:1784191810.914441:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 118 00000100:00100000:1.0:1784191810.914450:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:8c2c50be-ac0a-45d2-a88f-69ee938110a0+5:69109:x1870858812308224:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191810.914484:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:8c2c50be-ac0a-45d2-a88f-69ee938110a0+5:69109:x1870858812308224:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 37us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191810.914491:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 118 00000100:00080000:0.0:1784191810.914549:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784191811.084115:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784191811.084141:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827856000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191811.084217:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191811.085494:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827856000 00000100:00100000:2.0:1784191811.085507:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827856000 00000100:00100000:2.0:1784191811.085569:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1784191811.085580:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827856000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784191811.085633:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7818944 pending 0 free 71184384 avail 64016384 00000100:00080000:0.0:1784191811.085774:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784191811.085899:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827856128:0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.085943:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191811.085971:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858827856640:0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.085995:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191811.086019:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858827857152:0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.086042:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191811.086062:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784191811.086067:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827856256:0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.086098:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191811.086110:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827856768:0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.086127:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191811.086139:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858827857280:0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.086154:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191811.086176:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827856256 00000100:00100000:0.0:1784191811.086180:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827856256 00000100:00100000:0.0:1784191811.086206:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827856768 00000100:00100000:0.0:1784191811.086209:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827856768 00000100:00100000:0.0:1784191811.086230:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1784191811.086237:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827856256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.086277:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827856256:12345-0@lo:400:kworker.0 Request processed in 41us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191811.086284:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1784191811.086298:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1784191811.086303:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827856768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.086324:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827856768:12345-0@lo:400:kworker.0 Request processed in 22us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191811.086329:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1784191811.086359:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827856640 00000100:00100000:0.0:1784191811.086363:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827856640 00000100:00100000:0.0:1784191811.086390:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827857152 00000100:00100000:0.0:1784191811.086394:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827857152 00000100:00100000:0.0:1784191811.086424:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827857280 00000100:00100000:0.0:1784191811.086427:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827857280 00000100:00100000:0.0:1784191811.086445:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1784191811.086451:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858827856640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.086484:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858827856640:12345-0@lo:400:kworker.0 Request processed in 34us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191811.086490:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1784191811.086501:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1784191811.086506:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858827857152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.086534:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858827857152:12345-0@lo:400:kworker.0 Request processed in 28us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191811.086540:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1784191811.086555:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1784191811.086561:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858827857280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.086589:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858827857280:12345-0@lo:400:kworker.0 Request processed in 29us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191811.086595:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1784191811.086612:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784191811.086616:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784191811.086645:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827856256:0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.086656:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827856768:0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.086664:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858827857280:0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.086672:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858827856640:0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.086680:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858827857152:0@lo:400:kworker.0 00000100:00100000:3.0:1784191811.086986:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827856128 00000100:00100000:3.0:1784191811.086992:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827856128 00000100:00100000:3.0:1784191811.087024:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1784191811.087032:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858827856128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191811.087072:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858827856128:12345-0@lo:400:kworker.0 Request processed in 43us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191811.087091:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1784191811.087177:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827856512:0@lo:400:kworker.0 00000100:00100000:3.0:1784191811.087207:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191811.087231:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858827857024:0@lo:400:kworker.0 00000100:00100000:3.0:1784191811.087254:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191811.087272:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858827857536:0@lo:400:kworker.0 00000100:00100000:3.0:1784191811.087294:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191811.087314:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1784191811.087319:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827856384:0@lo:400:kworker.0 00000100:00100000:2.0:1784191811.087444:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827856000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1866us (3226us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191811.087453:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1784191811.087506:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827856512 00000100:00100000:2.0:1784191811.087510:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827856512 00000100:00100000:2.0:1784191811.087543:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1784191811.087935:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827857024 00000100:00100000:1.0:1784191811.087941:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827857024 00000100:00100000:1.0:1784191811.087969:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827857536 00000100:00100000:1.0:1784191811.087972:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827857536 00000100:00100000:1.0:1784191811.087988:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1784191811.087993:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858827857024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191811.088040:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858827857024:12345-0@lo:400:kworker.0 Request processed in 46us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191811.088047:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1784191811.088060:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1784191811.088067:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858827857536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191811.088108:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858827857536:12345-0@lo:400:kworker.0 Request processed in 42us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191811.088113:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1784191811.088183:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827856000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784191811.089127:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827856512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191811.089187:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827856512:12345-0@lo:400:kworker.0 Request processed in 1637us (1979us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191811.089197:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1784191811.089228:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784191811.089234:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784191811.089242:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784191811.089268:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827857664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784191811.089312:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191811.089499:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191811.089509:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827856128:0@lo:400:kworker.0 00000100:00100000:3.0:1784191811.089524:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827856896:0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.089541:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827856384 00000100:00100000:0.0:1784191811.089546:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827856384 00000100:00100000:3.0:1784191811.089548:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191811.089564:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858827857408:0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.089580:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827856896 00000100:00100000:0.0:1784191811.089583:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827856896 00000100:00100000:3.0:1784191811.089586:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191811.089602:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1784191811.089608:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827856384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191811.089611:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827856512:0@lo:400:kworker.0 00000100:00100000:3.0:1784191811.089621:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858827857024:0@lo:400:kworker.0 00000100:00100000:3.0:1784191811.089631:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858827857536:0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.089639:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827856384:12345-0@lo:400:kworker.0 Request processed in 32us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191811.089645:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1784191811.089651:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827856384:0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.089656:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784191811.089661:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827856896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191811.089670:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827857408 00000100:00100000:3.0:1784191811.089673:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827857408 00000100:00100000:3.0:1784191811.089712:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1784191811.089719:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858827857408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191811.089863:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827857664 00000100:00100000:1.0:1784191811.089868:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827857664 00000100:00080000:2.0:1784191811.090086:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784191811.090090:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784191811.090122:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827856896:0@lo:400:kworker.0 00000100:00100000:2.0:1784191811.090131:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858827857408:0@lo:400:kworker.0 00000100:00100000:0.0:1784191811.090273:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827856896:12345-0@lo:400:kworker.0 Request processed in 611us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191811.090280:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784191811.090333:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858827857408:12345-0@lo:400:kworker.0 Request processed in 613us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191811.090357:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1784191811.090452:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1784191811.090460:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827857664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784191811.090479:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7818944 pending 0 free 71184384 avail 64016384 00000100:00100000:1.0:1784191811.090530:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827857664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191811.090535:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1784191811.090621:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827857664:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784191811.660278:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191812.683996:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191813.644052:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827857792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784191813.644131:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191813.644164:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827857792 00000100:00100000:1.0:1784191813.644174:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827857792 00000100:00080000:3.0:1784191813.644252:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784191813.644609:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784191813.644623:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827857792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784191813.644660:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71049216 avail 63881216 00000100:00100000:1.0:1784191813.644769:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827857792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191813.644778:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784191813.644815:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827857792:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784191813.708190:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191814.156382:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784191814.156409:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827857920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191814.156503:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191814.156879:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827857920 00000100:00100000:0.0:1784191814.156887:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827857920 00000100:00100000:0.0:1784191814.156947:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1784191814.156957:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858827857920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784191814.156993:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42659840 avail 36528128 00000100:00100000:0.0:1784191814.157052:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858827857920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191814.157059:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1784191814.157197:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784191814.157208:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827858048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784191814.157241:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191814.157321:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827858048 00000100:00100000:1.0:1784191814.157326:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827858048 00000100:00100000:1.0:1784191814.157361:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1784191814.157369:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827858048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784191814.157388:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42786816 avail 36655104 00000100:00100000:1.0:1784191814.157425:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827858048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191814.157432:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1784191814.157561:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827858048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784191814.160987:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827857920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191814.668198:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784191814.668223:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827858176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784191814.668296:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191814.668980:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827858176 00000100:00100000:3.0:1784191814.668989:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827858176 00000100:00100000:3.0:1784191814.669072:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784191814.669082:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827858176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784191814.669106:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71049216 avail 63881216 00000100:00100000:3.0:1784191814.669163:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827858176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191814.669170:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784191814.669217:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827858176:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784191814.669289:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784191814.733725:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191815.756035:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191816.025492:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191816.025793:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812308480 00000100:00100000:1.0:1784191816.025804:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812308480 00000100:00100000:1.0:1784191816.026325:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 248 00000100:00100000:1.0:1784191816.026336:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+10:69112:x1870858812308480:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191816.026436:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+10:69112:x1870858812308480:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 102us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191816.026445:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 248 00000100:00080000:2.0:1784191816.026638:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784191816.031187:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191816.031312:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812308352 00000100:00100000:3.0:1784191816.031322:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812308352 00000100:00100000:3.0:1784191816.031381:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 201 00000100:00100000:3.0:1784191816.031391:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af11066b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf092482-e55f-41b2-a9bc-7eac002d231d+10:69112:x1870858812308352:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191816.031486:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af11066b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf092482-e55f-41b2-a9bc-7eac002d231d+10:69112:x1870858812308352:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 96us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191816.031494:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 201 00000100:00100000:3.0:1784191816.036133:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191816.036181:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191816.036273:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812308608 00000100:00100000:2.0:1784191816.036283:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812308608 00000100:00100000:2.0:1784191816.036353:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 249 00000100:00100000:2.0:1784191816.036363:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:69110:x1870858812308608:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191816.036431:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:69110:x1870858812308608:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 69us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191816.036438:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 249 00000100:00080000:3.0:1784191816.037480:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784191816.038593:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812308736 00000100:00100000:0.0:1784191816.038607:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812308736 00000100:00100000:0.0:1784191816.039167:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 122 00000100:00080000:3.0:1784191816.039513:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784191816.040166:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:8c2c50be-ac0a-45d2-a88f-69ee938110a0+5:69110:x1870858812308736:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191816.040258:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:8c2c50be-ac0a-45d2-a88f-69ee938110a0+5:69110:x1870858812308736:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 118us (4075us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191816.041291:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 122 00000100:00100000:2.0:1784191816.206238:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827858304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784191816.206319:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191816.206375:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858827858560:0@lo:400:kworker.0 00000100:00100000:2.0:1784191816.206398:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827858816:0@lo:400:kworker.0 00000100:00100000:0.0:1784191816.206434:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191816.206450:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827858688:0@lo:400:kworker.0 00000100:00100000:3.0:1784191816.206478:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827858304 00000100:00100000:3.0:1784191816.206501:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827858304 00000100:00100000:3.0:1784191816.206569:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784191816.206580:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827858304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784191816.206613:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7818944 pending 0 free 71184384 avail 64016384 00000100:00100000:2.0:1784191816.206679:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191816.206724:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827859328:0@lo:400:kworker.0 00000100:00100000:2.0:1784191816.206763:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191816.206783:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858827859840:0@lo:400:kworker.0 00000100:00100000:2.0:1784191816.206811:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191816.206846:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827858816 00000100:00100000:2.0:1784191816.206866:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827858816 00000100:00100000:2.0:1784191816.206910:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827859328 00000100:00100000:2.0:1784191816.206914:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827859328 00000100:00100000:2.0:1784191816.206939:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784191816.206946:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827858816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191816.206998:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827858816:12345-0@lo:400:kworker.0 Request processed in 52us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191816.207006:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784191816.207024:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1784191816.207031:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827859328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191816.207058:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827859328:12345-0@lo:400:kworker.0 Request processed in 28us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191816.207064:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1784191816.207087:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827859840 00000100:00100000:2.0:1784191816.207091:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827859840 00000100:00100000:2.0:1784191816.207118:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1784191816.207123:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858827859840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191816.207149:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858827859840:12345-0@lo:400:kworker.0 Request processed in 26us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191816.207155:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1784191816.207192:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827859328:0@lo:400:kworker.0 00000100:00100000:2.0:1784191816.207202:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858827859840:0@lo:400:kworker.0 00000100:00100000:2.0:1784191816.207210:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827858816:0@lo:400:kworker.0 00000100:00100000:2.0:1784191816.207251:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827858560 00000100:00100000:2.0:1784191816.207254:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827858560 00000100:00100000:2.0:1784191816.207281:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1784191816.207295:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858827858560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191816.207328:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858827858560:12345-0@lo:400:kworker.0 Request processed in 33us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191816.207333:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1784191816.207361:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827858432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784191816.207386:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191816.207403:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827858944:0@lo:400:kworker.0 00000100:00100000:2.0:1784191816.207424:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191816.207442:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827859456:0@lo:400:kworker.0 00000100:00100000:2.0:1784191816.207464:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191816.207512:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858827858560:0@lo:400:kworker.0 00000100:00100000:0.0:1784191816.207531:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827859072:0@lo:400:kworker.0 00000100:00100000:1.0:1784191816.207554:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191816.207576:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827859200:0@lo:400:kworker.0 00000100:00100000:1.0:1784191816.207597:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191816.207615:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858827859712:0@lo:400:kworker.0 00000100:00100000:1.0:1784191816.207634:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191816.207663:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827858432 00000100:00100000:1.0:1784191816.207666:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827858432 00000100:00100000:1.0:1784191816.207700:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1784191816.207708:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827858432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784191816.207721:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7818944 pending 0 free 71184384 avail 64016384 00000100:00100000:1.0:1784191816.207750:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827858432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191816.207757:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1784191816.207771:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191816.207777:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827858944 00000100:00100000:1.0:1784191816.207782:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827858944 00000100:00100000:0.0:1784191816.207799:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858827859584:0@lo:400:kworker.0 00000100:00100000:1.0:1784191816.207804:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827859456 00000100:00100000:1.0:1784191816.207808:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827859456 00000100:00100000:1.0:1784191816.207820:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827859712 00000100:00100000:1.0:1784191816.207822:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827859712 00000100:00100000:1.0:1784191816.207835:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1784191816.207840:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827858944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191816.207878:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827858944:12345-0@lo:400:kworker.0 Request processed in 38us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191816.207885:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1784191816.207898:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1784191816.207906:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827859456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191816.207908:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191816.207943:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827859456:12345-0@lo:400:kworker.0 Request processed in 39us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191816.207945:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827859200 00000100:00100000:0.0:1784191816.207951:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827859200 00000100:00100000:1.0:1784191816.207953:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1784191816.207967:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827859584 00000100:00100000:1.0:1784191816.207971:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827859584 00000100:00100000:0.0:1784191816.208003:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1784191816.208008:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1784191816.208015:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827859200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191816.208020:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858827859712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191816.208167:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827859456:0@lo:400:kworker.0 00000100:00100000:2.0:1784191816.208174:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827859968:0@lo:400:kworker.0 00000100:00100000:1.0:1784191816.209039:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858827859712:12345-0@lo:400:kworker.0 Request processed in 1016us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191816.209039:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827859200:12345-0@lo:400:kworker.0 Request processed in 1020us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191816.209052:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1784191816.209077:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1784191816.209085:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858827859584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191816.209133:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1784191816.209138:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858827859584:12345-0@lo:400:kworker.0 Request processed in 53us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191816.209145:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1784191816.209167:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827858688 00000100:00100000:0.0:1784191816.209174:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827858688 00000100:00100000:0.0:1784191816.209205:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827859072 00000100:00100000:0.0:1784191816.209209:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827859072 00000100:00100000:0.0:1784191816.209226:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1784191816.209233:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827858688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191816.209271:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827858688:12345-0@lo:400:kworker.0 Request processed in 39us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191816.210057:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1784191816.210067:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858827859072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191816.210120:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858827859072:12345-0@lo:400:kworker.0 Request processed in 55us (2350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191816.210127:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1784191816.210272:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827858688:0@lo:400:kworker.0 00000100:00100000:1.0:1784191816.210286:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827859200:0@lo:400:kworker.0 00000100:00100000:1.0:1784191816.210296:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858827859712:0@lo:400:kworker.0 00000100:00100000:1.0:1784191816.210364:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827859072:0@lo:400:kworker.0 00000100:00100000:1.0:1784191816.210376:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858827859584:0@lo:400:kworker.0 00000100:00080000:1.0:1784191816.210449:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784191816.210456:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784191816.210460:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784191816.210463:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784191816.210486:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1784191816.213621:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827858304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7033us (7292us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191816.213637:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784191816.215233:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191816.215342:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827858432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784191816.215357:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827858944:0@lo:400:kworker.0 00000100:00100000:0.0:1784191816.215864:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827858304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784191816.216263:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827859968 00000100:00100000:1.0:1784191816.216270:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827859968 00000100:00100000:1.0:1784191816.216357:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1784191816.216368:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827859968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191816.216457:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827859968:12345-0@lo:400:kworker.0 Request processed in 92us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191816.216465:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1784191816.216762:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827859968:0@lo:400:kworker.0 00000100:00080000:3.0:1784191816.216830:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1784191816.780086:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191817.804142:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191818.765009:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784191818.765037:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827860096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784191818.765125:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191818.765245:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827860096 00000100:00100000:3.0:1784191818.765255:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827860096 00000100:00100000:3.0:1784191818.765333:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784191818.765345:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827860096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784191818.765377:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71049216 avail 63881216 00000100:00100000:3.0:1784191818.765433:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827860096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191818.765440:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784191818.765503:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827860096:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784191818.766581:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784191818.827898:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191819.277634:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827860224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784191819.277767:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191819.277824:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784191819.277832:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827860352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784191819.277854:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191819.277970:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827860224 00000100:00100000:3.0:1784191819.277980:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827860224 00000100:00100000:3.0:1784191819.278042:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827860352 00000100:00100000:3.0:1784191819.278045:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827860352 00000100:00100000:3.0:1784191819.278066:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1784191819.278075:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827860224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784191819.278121:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42659840 avail 36528128 00000100:00100000:2.0:1784191819.278132:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1784191819.278152:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827860352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784191819.278176:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42786816 avail 36655104 00000100:00100000:3.0:1784191819.278203:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827860224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191819.278212:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1784191819.278220:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827860352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191819.278240:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1784191819.278265:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827860352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784191819.278282:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827860224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191819.788661:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827860480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784191819.788775:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191819.788959:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827860480 00000100:00100000:0.0:1784191819.788968:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827860480 00000100:00100000:0.0:1784191819.789046:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1784191819.789059:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827860480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784191819.789099:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71049216 avail 63881216 00000100:00080000:3.0:1784191819.789188:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191819.793274:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827860480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4203us (4484us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191819.793294:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1784191819.796591:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827860480:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784191819.852004:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191820.876166:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191821.143333:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191821.143423:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812308864 00000100:00100000:0.0:1784191821.143436:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812308864 00000100:00100000:0.0:1784191821.143534:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 203 00000100:00100000:0.0:1784191821.143548:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af11066b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf092482-e55f-41b2-a9bc-7eac002d231d+10:69112:x1870858812308864:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191821.143657:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af11066b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf092482-e55f-41b2-a9bc-7eac002d231d+10:69112:x1870858812308864:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 111us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191821.143667:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 203 00000100:00100000:1.0:1784191821.145479:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191821.145789:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812309120 00000100:00100000:2.0:1784191821.145797:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812309120 00000100:00100000:2.0:1784191821.145864:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 256 00000100:00100000:2.0:1784191821.145875:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:69109:x1870858812309120:12345-192.168.204.16@tcp:400:kworker.0 00000100:00080000:3.0:1784191821.145900:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784191821.145976:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:69109:x1870858812309120:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 104us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191821.145985:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 256 00000100:00100000:3.0:1784191821.161602:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191821.161730:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812308992 00000100:00100000:1.0:1784191821.161740:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812308992 00000100:00100000:1.0:1784191821.161835:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 257 00000100:00100000:1.0:1784191821.161847:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+10:69111:x1870858812308992:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191821.161969:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+10:69111:x1870858812308992:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 124us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191821.161977:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 257 00000100:00080000:3.0:1784191821.162362:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784191821.166774:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191821.166977:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812309248 00000100:00100000:1.0:1784191821.166989:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812309248 00000100:00100000:1.0:1784191821.167126:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 214 00000100:00100000:1.0:1784191821.167138:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:8c2c50be-ac0a-45d2-a88f-69ee938110a0+5:69108:x1870858812309248:12345-192.168.204.16@tcp:9:kworker.0 00000020:00000080:1.0:1784191821.167174:0:162394:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4a106 00000100:00080000:1.0:1784191821.167184:0:162394:0:(import.c:65:import_set_state_nolock()) ffff8af104b67000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784191821.167245:0:162394:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869231 00000100:00100000:1.0:1784191821.167418:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:8c2c50be-ac0a-45d2-a88f-69ee938110a0+2:69108:x1870858812309248:12345-192.168.204.16@tcp:9:kworker.0 Request processed in 280us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191821.167426:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 214 00000100:00080000:3.0:1784191821.167580:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784191821.168715:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191821.324005:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784191821.324046:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827860608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784191821.324155:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191821.324358:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827860608 00000100:00100000:0.0:1784191821.324367:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827860608 00000100:00100000:0.0:1784191821.324443:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784191821.324456:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827860608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784191821.324489:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71184384 avail 64016384 00000100:00100000:0.0:1784191821.324541:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827860608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191821.324563:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1784191821.324633:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784191821.324673:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827860608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784191821.324983:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827860992:0@lo:400:kworker.0 00000100:00100000:2.0:1784191821.325019:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191821.325048:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827861504:0@lo:400:kworker.0 00000100:00100000:2.0:1784191821.325089:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191821.325105:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858827862016:0@lo:400:kworker.0 00000100:00100000:2.0:1784191821.325132:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191821.325162:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784191821.325179:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827861120:0@lo:400:kworker.0 00000100:00100000:2.0:1784191821.325204:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191821.325222:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827861632:0@lo:400:kworker.0 00000100:00100000:2.0:1784191821.325248:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191821.325264:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827862144:0@lo:400:kworker.0 00000100:00100000:2.0:1784191821.325283:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191821.325311:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827860992 00000100:00100000:2.0:1784191821.325315:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827860992 00000100:00100000:2.0:1784191821.325346:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827861504 00000100:00100000:2.0:1784191821.325349:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827861504 00000100:00100000:2.0:1784191821.325363:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827861120 00000100:00100000:2.0:1784191821.325365:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827861120 00000100:00100000:2.0:1784191821.325380:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1784191821.325386:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827860992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191821.325426:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827860992:12345-0@lo:400:kworker.0 Request processed in 39us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191821.325433:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1784191821.325446:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1784191821.325452:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827861504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191821.325481:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827861504:12345-0@lo:400:kworker.0 Request processed in 29us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191821.325487:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1784191821.325500:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1784191821.325506:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827861120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191821.325533:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827861120:12345-0@lo:400:kworker.0 Request processed in 28us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191821.325549:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1784191821.325565:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784191821.325569:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784191821.325578:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827862016 00000100:00100000:2.0:1784191821.325581:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827862016 00000100:00100000:2.0:1784191821.325608:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827861632 00000100:00100000:2.0:1784191821.325611:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827861632 00000100:00100000:2.0:1784191821.325621:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827862144 00000100:00100000:2.0:1784191821.325623:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827862144 00000100:00100000:2.0:1784191821.325636:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1784191821.325641:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858827862016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191821.325671:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858827862016:12345-0@lo:400:kworker.0 Request processed in 30us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191821.325677:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1784191821.325712:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1784191821.325718:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827861632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191821.325745:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827861632:12345-0@lo:400:kworker.0 Request processed in 28us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191821.325751:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1784191821.325764:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1784191821.325770:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827862144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191821.325797:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827862144:12345-0@lo:400:kworker.0 Request processed in 27us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191821.325803:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00080000:2.0:1784191821.325817:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784191821.325821:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784191821.325845:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827861120:0@lo:400:kworker.0 00000100:00100000:2.0:1784191821.325865:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827861632:0@lo:400:kworker.0 00000100:00100000:2.0:1784191821.325875:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827862144:0@lo:400:kworker.0 00000100:00100000:2.0:1784191821.325894:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827860992:0@lo:400:kworker.0 00000100:00100000:2.0:1784191821.325906:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827861504:0@lo:400:kworker.0 00000100:00100000:2.0:1784191821.325915:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858827862016:0@lo:400:kworker.0 00000100:00100000:0.0:1784191821.326470:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827860736:0@lo:400:kworker.0 00000100:00100000:0.0:1784191821.326514:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191821.326551:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858827861248:0@lo:400:kworker.0 00000100:00100000:0.0:1784191821.326576:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191821.326600:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858827861760:0@lo:400:kworker.0 00000100:00100000:0.0:1784191821.326621:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191821.326647:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827862272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784191821.326671:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191821.326712:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784191821.326718:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827860864:0@lo:400:kworker.0 00000100:00100000:0.0:1784191821.326743:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191821.326759:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827861376:0@lo:400:kworker.0 00000100:00100000:0.0:1784191821.326778:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191821.326794:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858827861888:0@lo:400:kworker.0 00000100:00100000:0.0:1784191821.326813:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191821.326846:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827860864 00000100:00100000:0.0:1784191821.326851:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827860864 00000100:00100000:0.0:1784191821.326894:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827861376 00000100:00100000:0.0:1784191821.326897:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827861376 00000100:00100000:0.0:1784191821.326917:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1784191821.326924:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827860864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191821.326971:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827860864:12345-0@lo:400:kworker.0 Request processed in 46us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191821.326978:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1784191821.327006:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1784191821.327013:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827861376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191821.327157:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827860736 00000100:00100000:1.0:1784191821.327162:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827860736 00000100:00100000:1.0:1784191821.327194:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1784191821.327201:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858827860736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191821.327332:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827861248 00000100:00100000:2.0:1784191821.327337:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827861248 00000100:00100000:2.0:1784191821.327363:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827861760 00000100:00100000:2.0:1784191821.327365:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827861760 00000100:00100000:2.0:1784191821.327384:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827861888 00000100:00100000:2.0:1784191821.327386:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827861888 00000100:00100000:2.0:1784191821.327400:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1784191821.327406:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858827861248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191821.327473:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1784191821.327484:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858827861760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191821.330456:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858827860736:12345-0@lo:400:kworker.0 Request processed in 3243us (3929us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191821.330472:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1784191821.330670:0:161504:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1784191821.330679:0:161504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1784191821.330877:0:158666:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1784191821.330902:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1784191821.330916:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858827861888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191821.330986:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858827861888:12345-0@lo:400:kworker.0 Request processed in 75us (4172us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191821.331009:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1784191821.331104:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827861376:12345-0@lo:400:kworker.0 Request processed in 4088us (4321us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191821.331115:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1784191821.331200:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827860864:0@lo:400:kworker.0 00000100:00100000:1.0:1784191821.331209:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827862272 00000100:00100000:0.0:1784191821.331214:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827861376:0@lo:400:kworker.0 00000100:00100000:1.0:1784191821.331215:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827862272 00000100:00100000:0.0:1784191821.331224:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858827861888:0@lo:400:kworker.0 00000100:00100000:0.0:1784191821.331233:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827860736:0@lo:400:kworker.0 00000100:00100000:1.0:1784191821.331249:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1784191821.331255:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827862272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784191821.331272:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71184384 avail 64016384 00000100:00080000:0.0:1784191821.331278:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784191821.331285:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784191821.331311:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827862272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (4639us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191821.331317:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1784191821.331340:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827862272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191821.331679:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858827861760:12345-0@lo:400:kworker.0 Request processed in 4196us (5054us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191821.331706:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1784191821.331718:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858827861248:0@lo:400:kworker.0 00000100:00100000:0.0:1784191821.331729:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858827861760:0@lo:400:kworker.0 00000100:00100000:2.0:1784191821.331832:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858827861248:12345-0@lo:400:kworker.0 Request processed in 4424us (5254us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191821.331841:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00010000:00010000:3.0:1784191821.902508:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191822.925102:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191823.884014:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784191823.884207:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827862400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784191823.884286:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191823.884405:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827862400 00000100:00100000:0.0:1784191823.884415:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827862400 00000100:00100000:0.0:1784191823.884522:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1784191823.884535:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827862400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784191823.884568:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71049216 avail 63881216 00000100:00100000:3.0:1784191823.884741:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827862400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784191823.884852:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827862400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191823.884862:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1784191823.884923:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784191823.949602:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191824.396153:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784191824.396181:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827862528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784191824.396263:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191824.396890:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827862528 00000100:00100000:3.0:1784191824.396899:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827862528 00000100:00100000:3.0:1784191824.396968:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1784191824.396979:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827862528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784191824.397030:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42786816 avail 36655104 00000100:00100000:3.0:1784191824.397089:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827862528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191824.397096:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1784191824.397434:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827862656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784191824.397469:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191824.397529:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827862528:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784191824.397661:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827862656 00000100:00100000:2.0:1784191824.397666:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827862656 00000100:00100000:2.0:1784191824.397737:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1784191824.397745:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858827862656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784191824.397778:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42659840 avail 36528128 00000100:00100000:2.0:1784191824.397992:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858827862656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 247us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191824.398025:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1784191824.398293:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827862656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191824.723835:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191824.724012:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812309376 00000100:00100000:3.0:1784191824.724021:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812309376 00000100:00100000:3.0:1784191824.724111:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 372 00000100:00100000:3.0:1784191824.724123:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+10:69109:x1870858812309376:12345-192.168.204.16@tcp:63:ll_sa.0 00010000:00010000:3.0:1784191824.724167:0:159636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191824.724189:0:159636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a217 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b471 expref: -99 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724247:0:159636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a21e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724262:0:159636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a21e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724274:0:159636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a21e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724288:0:159636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a225 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x3:0x0].0xc0cd4e83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724303:0:159636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a225 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xc0cd4e83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724311:0:159636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a225 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xc0cd4e83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724357:0:159636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a21e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724365:0:159636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a21e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724372:0:159636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a21e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724378:0:159636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7d600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191824.724382:0:159636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a21e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724390:0:159636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a21e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724401:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff8af206f3e500) 00010000:00010000:3.0:1784191824.724404:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191824.724409:0:159636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a21e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724415:0:159636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a21e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724432:0:159636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a225 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xc0cd4e83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724444:0:159636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a225 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xc0cd4e83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724451:0:159636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a225 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xc0cd4e83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724456:0:159636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7ce00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191824.724459:0:159636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a225 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xc0cd4e83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724466:0:159636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a225 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xc0cd4e83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724474:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0xc0cd4e83 (ffff8af215ff6d00) 00010000:00010000:3.0:1784191824.724477:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191824.724480:0:159636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a225 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0xc0cd4e83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724486:0:159636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a225 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0xc0cd4e83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724519:0:159636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a217 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b471 expref: 11 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724530:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff8af206f3e500) 00010000:00010000:3.0:1784191824.724533:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784191824.724536:0:159636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a217 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b471 expref: 11 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.724555:0:159636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7c600, rc -2) 00000100:00100000:3.0:1784191824.724625:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:8c2c50be-ac0a-45d2-a88f-69ee938110a0+10:69109:x1870858812309376:12345-192.168.204.16@tcp:63:ll_sa.0 Request processed in 504us (816us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784191824.724634:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 372 00000100:00080000:2.0:1784191824.724725:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784191824.881169:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191824.881870:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812309760 00000100:00100000:2.0:1784191824.881882:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812309760 00000100:00100000:2.0:1784191824.881948:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 23 00000100:00100000:2.0:1784191824.881959:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23f632050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf092482-e55f-41b2-a9bc-7eac002d231d+10:69109:x1870858812309760:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191824.881985:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191824.882006:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af10d532600/0xfeec3c2dc5a47b7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ab8e expref: 10 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191824.882026:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191824.882093:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23f632050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf092482-e55f-41b2-a9bc-7eac002d231d+9:69109:x1870858812309760:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 135us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191824.882100:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 23 00000100:00100000:1.0:1784191824.882901:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191824.882935:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191824.883035:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812309632 00000100:00100000:2.0:1784191824.883042:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812309632 00000100:00100000:2.0:1784191824.883078:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812309504 00000100:00100000:2.0:1784191824.883082:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812309504 00000100:00100000:2.0:1784191824.883102:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 24 00000100:00100000:2.0:1784191824.883186:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf092482-e55f-41b2-a9bc-7eac002d231d+10:69112:x1870858812309632:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191824.883199:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191824.883214:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af233127400/0xfeec3c2dc5a47b04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ab4f expref: 10 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191824.883230:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191824.883269:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf092482-e55f-41b2-a9bc-7eac002d231d+9:69112:x1870858812309632:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 159us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191824.884677:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 25 00000100:00100000:3.0:1784191824.884708:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cf092482-e55f-41b2-a9bc-7eac002d231d+9:69112:x1870858812309504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191824.884724:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191824.885103:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af233126800/0xfeec3c2dc5a47afd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ab1e expref: 9 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.885121:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191824.885176:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cf092482-e55f-41b2-a9bc-7eac002d231d+8:69112:x1870858812309504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 488us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191824.885186:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 25 00000100:00100000:2.0:1784191824.895869:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 24 00000100:00100000:0.0:1784191824.898002:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191824.898122:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812310528 00000100:00100000:1.0:1784191824.898135:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812310528 00000100:00100000:1.0:1784191824.898211:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 332 00000100:00100000:1.0:1784191824.898242:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+10:69108:x1870858812310528:12345-192.168.204.16@tcp:39:umount.0 00000020:00000080:1.0:1784191824.898303:0:158666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a47b12 00000020:00010000:1.0:1784191824.898317:0:158666:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8af10c36c000: total 0 00000100:00080000:1.0:1784191824.898322:0:158666:0:(import.c:65:import_set_state_nolock()) ffff8af10c36b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784191824.898461:0:158666:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 8, last_transno is 34359738592 00000100:00100000:1.0:1784191824.898632:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c2c50be-ac0a-45d2-a88f-69ee938110a0+9:69108:x1870858812310528:12345-192.168.204.16@tcp:39:umount.0 Request processed in 395us (641us total) trans 34359738593 rc 0/0 00000100:00100000:1.0:1784191824.898640:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 332 00000020:00010000:3.0:1784191824.898776:0:158654:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8af10c36c000: total 0 00010000:00010000:3.0:1784191824.898781:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191824.898854:0:158654:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8af10c36c000, canceled 0 locks, left on hash table 5. 00010000:00010000:3.0:1784191824.898894:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8af206f3ea00) 00010000:00010000:3.0:1784191824.898898:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784191824.898906:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20d790400/0xfeec3c2dc5a490a5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8afd9 expref: 8 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.898928:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8af2331f1600) 00010000:00010000:3.0:1784191824.898930:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784191824.898934:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ee00/0xfeec3c2dc5a4905f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8afc4 expref: 7 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.898960:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191824.898962:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784191824.898966:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a202 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b46a expref: 6 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.898977:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0x0 (ffff8af206f3e400) 00010000:00010000:3.0:1784191824.898979:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784191824.898982:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20d791a00/0xfeec3c2dc5a490f2 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8afee expref: 5 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.898997:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff8af206f3e500) 00010000:00010000:3.0:1784191824.898999:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784191824.899003:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20d791200/0xfeec3c2dc5a4907b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8afcb expref: 4 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191824.899022:0:158654:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8af10c36c000, canceled 5 locks, left on hash table 0. 00010000:00010000:3.0:1784191824.899035:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191824.899037:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191824.899039:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191824.910365:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784191824.910392:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827862784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784191824.910466:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191824.910653:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827862784 00000100:00100000:1.0:1784191824.910663:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827862784 00000100:00100000:1.0:1784191824.910769:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1784191824.910780:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827862784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784191824.910805:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 71049216 avail 63881216 00000100:00100000:1.0:1784191824.910875:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827862784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191824.910882:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1784191824.911055:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784191824.911271:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827862784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784191824.911380:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191824.911446:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812310912 00000100:00100000:1.0:1784191824.911451:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812310912 00000100:00100000:1.0:1784191824.911489:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 333 00000100:00100000:1.0:1784191824.911497:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c2c50be-ac0a-45d2-a88f-69ee938110a0+7:69108:x1870858812310912:12345-192.168.204.16@tcp:39:umount.0 00000020:00000080:1.0:1784191824.911525:0:164531:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a47b19 00000020:00010000:1.0:1784191824.911532:0:164531:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8af10c36b800: total 0 00000100:00080000:1.0:1784191824.911536:0:164531:0:(import.c:65:import_set_state_nolock()) ffff8af10c369800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784191824.911563:0:164531:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 5, last_transno is 21474836524 00000100:00100000:1.0:1784191824.911758:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c2c50be-ac0a-45d2-a88f-69ee938110a0+6:69108:x1870858812310912:12345-192.168.204.16@tcp:39:umount.0 Request processed in 261us (380us total) trans 21474836525 rc 0/0 00000100:00100000:1.0:1784191824.911765:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 333 00000020:00010000:1.0:1784191824.911863:0:158653:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8af10c36b800: total 0 00010000:00010000:1.0:1784191824.911920:0:158653:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8af10c36b800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1784191824.911959:0:158653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002342:0x3:0x0].0x0 (ffff8af203904a00) 00010000:00010000:1.0:1784191824.911964:0:158653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784191824.911975:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a49da9 lrc: 0/0,0 mode: --/CR res: [0x240002342:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b2f0 expref: 5 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191824.913738:0:158653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0x0 (ffff8af2331f1400) 00010000:00010000:0.0:1784191824.913748:0:158653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784191824.913757:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4910e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8affc expref: 4 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784191824.913772:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784191824.913792:0:158653:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8af10c36b800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1784191824.913837:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191824.913840:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191824.913842:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191824.940197:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191824.940372:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812311168 00000100:00100000:2.0:1784191824.940385:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812311168 00000100:00100000:2.0:1784191824.940449:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 205 00000100:00100000:2.0:1784191824.940460:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf092482-e55f-41b2-a9bc-7eac002d231d+7:69108:x1870858812311168:12345-192.168.204.16@tcp:251:umount.0 00000020:00000080:2.0:1784191824.940522:0:158658:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a47aef 00000020:00010000:2.0:1784191824.940532:0:158658:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8af23f2df000: total 0 00000100:00080000:2.0:1784191824.940536:0:158658:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1784191824.940947:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf092482-e55f-41b2-a9bc-7eac002d231d+3:69108:x1870858812311168:12345-192.168.204.16@tcp:251:umount.0 Request processed in 487us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191824.940957:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 205 00000020:00010000:3.0:1784191824.941821:0:160901:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8af23f2df000: total 0 00010000:00010000:2.0:1784191824.942622:0:160901:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8af23f2df000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784191824.942665:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af242073c00/0xfeec3c2dc5a47af6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ab17 expref: 2 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191824.942684:0:160901:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8af23f2df000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1784191824.942717:0:160901:0:(genops.c:906:class_export_put()) final put ffff8af23f2df000/cf092482-e55f-41b2-a9bc-7eac002d231d 00010000:00010000:2.0:1784191824.942960:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191824.942963:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191824.942965:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784191824.943079:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23f2df000/cf092482-e55f-41b2-a9bc-7eac002d231d for MGS 00000020:00000080:1.0:1784191824.943196:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af23f2d8000 for MGS 00010000:00010000:3.0:1784191824.972131:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191825.141923:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191825.143474:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812311296 00000100:00100000:1.0:1784191825.143488:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812311296 00000100:00100000:1.0:1784191825.143552:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 206 00000100:00100000:1.0:1784191825.143562:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af11066bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:69108:x1870858812311296:12345-192.168.204.16@tcp:250:mount.lustre.0 00010000:00080000:1.0:1784191825.143597:0:158660:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from f9e3b1f6-8cce-446b-b02a-9948a606da8b@192.168.204.16@tcp t0 exp 0000000000000000 cur 5445 last 0 00000020:00000080:1.0:1784191825.143686:0:158660:0:(genops.c:1406:class_connect()) connect: client f9e3b1f6-8cce-446b-b02a-9948a606da8b, cookie 0xfeec3c2dc5a4a22c 00000100:00080000:1.0:1784191825.143804:0:158660:0:(import.c:65:import_set_state_nolock()) ffff8af234708000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784191825.143906:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af11066bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9e3b1f6-8cce-446b-b02a-9948a606da8b+5:69108:x1870858812311296:12345-192.168.204.16@tcp:250:mount.lustre.0 Request processed in 343us (1992us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191825.143914:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 206 00000100:00100000:0.0:1784191825.149490:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.149730:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812311424 00000100:00100000:2.0:1784191825.149754:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812311424 00000100:00100000:2.0:1784191825.149875:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 207 00000100:00100000:2.0:1784191825.149887:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af11066a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9e3b1f6-8cce-446b-b02a-9948a606da8b+5:121866:x1870858812311424:12345-192.168.204.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784191825.149910:0:158658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191825.149938:0:158658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af1019d5600/0xfeec3c2dc5a4a233 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b486 expref: -99 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.149972:0:158658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af1019d5600/0xfeec3c2dc5a4a233 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b486 expref: 6 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.149985:0:158658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af1019d5600/0xfeec3c2dc5a4a233 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b486 expref: 6 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.149996:0:158658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5600, rc 0) 00000100:00100000:2.0:1784191825.150078:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af11066a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9e3b1f6-8cce-446b-b02a-9948a606da8b+6:121866:x1870858812311424:12345-192.168.204.16@tcp:101:mount.lustre.0 Request processed in 193us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191825.150087:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 207 00000100:00100000:3.0:1784191825.152249:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191825.164115:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812311552 00000100:00100000:0.0:1784191825.164133:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812311552 00000100:00100000:2.0:1784191825.164630:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 208 00000100:00100000:2.0:1784191825.164644:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9e3b1f6-8cce-446b-b02a-9948a606da8b+6:121866:x1870858812311552:12345-192.168.204.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784191825.164801:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9e3b1f6-8cce-446b-b02a-9948a606da8b+6:121866:x1870858812311552:12345-192.168.204.16@tcp:501:mount.lustre.0 Request processed in 160us (12565us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784191825.164827:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 208 00000100:00100000:3.0:1784191825.171919:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191825.172479:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812311680 00000100:00100000:0.0:1784191825.172492:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812311680 00000100:00100000:0.0:1784191825.172565:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 209 00000100:00100000:0.0:1784191825.172577:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af11066a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9e3b1f6-8cce-446b-b02a-9948a606da8b+6:121866:x1870858812311680:12345-192.168.204.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784191825.172595:0:158659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191825.172618:0:158659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af10b5e5800/0xfeec3c2dc5a4a23a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b48d expref: -99 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191825.172650:0:158659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af10b5e5800/0xfeec3c2dc5a4a23a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b48d expref: 7 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191825.172661:0:158659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af10b5e5800/0xfeec3c2dc5a4a23a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b48d expref: 7 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191825.172749:0:158659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5800, rc 0) 00000100:00100000:0.0:1784191825.172828:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af11066a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9e3b1f6-8cce-446b-b02a-9948a606da8b+7:121866:x1870858812311680:12345-192.168.204.16@tcp:101:mount.lustre.0 Request processed in 252us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191825.172835:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 209 00000100:00100000:3.0:1784191825.178384:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191825.178494:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812311808 00000100:00100000:1.0:1784191825.178504:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812311808 00000100:00100000:1.0:1784191825.178566:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 210 00000100:00100000:1.0:1784191825.178577:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9e3b1f6-8cce-446b-b02a-9948a606da8b+7:121866:x1870858812311808:12345-192.168.204.16@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784191825.178827:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9e3b1f6-8cce-446b-b02a-9948a606da8b+8:121866:x1870858812311808:12345-192.168.204.16@tcp:501:mount.lustre.0 Request processed in 251us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191825.178838:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 210 00000100:00100000:3.0:1784191825.188546:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.188669:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812311936 00000100:00100000:2.0:1784191825.188679:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812311936 00000100:00100000:2.0:1784191825.188774:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 211 00000100:00100000:2.0:1784191825.188786:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9e3b1f6-8cce-446b-b02a-9948a606da8b+8:121866:x1870858812311936:12345-192.168.204.16@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784191825.188974:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9e3b1f6-8cce-446b-b02a-9948a606da8b+8:121866:x1870858812311936:12345-192.168.204.16@tcp:503:mount.lustre.0 Request processed in 190us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191825.188983:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 211 00000100:00100000:3.0:1784191825.195147:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191825.195355:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812312064 00000100:00100000:0.0:1784191825.195366:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812312064 00000100:00100000:0.0:1784191825.195431:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 212 00000100:00100000:0.0:1784191825.195442:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9e3b1f6-8cce-446b-b02a-9948a606da8b+8:121879:x1870858812312064:12345-192.168.204.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784191825.195609:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9e3b1f6-8cce-446b-b02a-9948a606da8b+8:121879:x1870858812312064:12345-192.168.204.16@tcp:502:llog_process_th.0 Request processed in 168us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191825.195618:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 212 00000100:00100000:2.0:1784191825.226953:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191825.227138:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812312192 00000100:00100000:1.0:1784191825.227148:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812312192 00000100:00100000:1.0:1784191825.227358:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 213 00000100:00100000:1.0:1784191825.227370:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9e3b1f6-8cce-446b-b02a-9948a606da8b+8:121879:x1870858812312192:12345-192.168.204.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784191825.227556:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9e3b1f6-8cce-446b-b02a-9948a606da8b+8:121879:x1870858812312192:12345-192.168.204.16@tcp:502:llog_process_th.0 Request processed in 187us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191825.227564:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 213 00000100:00100000:3.0:1784191825.230144:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191825.233222:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812312320 00000100:00100000:0.0:1784191825.233243:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812312320 00000100:00100000:0.0:1784191825.233310:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 214 00000100:00100000:0.0:1784191825.233321:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9e3b1f6-8cce-446b-b02a-9948a606da8b+8:121879:x1870858812312320:12345-192.168.204.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784191825.233512:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9e3b1f6-8cce-446b-b02a-9948a606da8b+8:121879:x1870858812312320:12345-192.168.204.16@tcp:502:llog_process_th.0 Request processed in 192us (3377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191825.233521:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 214 00000100:00100000:3.0:1784191825.243151:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191825.244442:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812312448 00000100:00100000:0.0:1784191825.244458:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812312448 00000100:00100000:0.0:1784191825.244540:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 215 00000100:00100000:0.0:1784191825.244551:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9e3b1f6-8cce-446b-b02a-9948a606da8b+8:121866:x1870858812312448:12345-192.168.204.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784191825.244569:0:158659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191825.244589:0:158659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a241 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b4be expref: -99 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191825.244638:0:158659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b4be expref: 9 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191825.244650:0:158659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b4be expref: 9 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191825.244659:0:158659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5a00, rc 0) 00000100:00100000:0.0:1784191825.244765:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9e3b1f6-8cce-446b-b02a-9948a606da8b+9:121866:x1870858812312448:12345-192.168.204.16@tcp:101:mount.lustre.0 Request processed in 214us (1624us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191825.244772:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 215 00000100:00100000:0.0:1784191825.253235:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.254845:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812312576 00000100:00100000:2.0:1784191825.254860:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812312576 00000100:00100000:2.0:1784191825.254924:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 216 00000100:00100000:2.0:1784191825.254932:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9e3b1f6-8cce-446b-b02a-9948a606da8b+9:121866:x1870858812312576:12345-192.168.204.16@tcp:256:mount.lustre.0 20000000:01000000:2.0:1784191825.254957:0:158658:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784191825.254986:0:158658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784191825.254989:0:158658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784191825.254991:0:158658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784191825.254993:0:158658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1784191825.254995:0:158658:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 36 00000100:00100000:2.0:1784191825.261427:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9e3b1f6-8cce-446b-b02a-9948a606da8b+9:121866:x1870858812312576:12345-192.168.204.16@tcp:256:mount.lustre.0 Request processed in 6483us (8328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191825.261442:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 216 00000100:00100000:3.0:1784191825.267105:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191825.267334:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812312704 00000100:00100000:0.0:1784191825.267344:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812312704 00000100:00100000:0.0:1784191825.267419:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 217 00000100:00100000:0.0:1784191825.267430:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9e3b1f6-8cce-446b-b02a-9948a606da8b+9:121866:x1870858812312704:12345-192.168.204.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784191825.267448:0:158659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191825.267468:0:158659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af10b5e5600/0xfeec3c2dc5a4a248 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b4c5 expref: -99 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191825.267498:0:158659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af10b5e5600/0xfeec3c2dc5a4a248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b4c5 expref: 10 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191825.267508:0:158659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af10b5e5600/0xfeec3c2dc5a4a248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b4c5 expref: 10 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191825.267516:0:158659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5600, rc 0) 00000100:00100000:0.0:1784191825.267612:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9e3b1f6-8cce-446b-b02a-9948a606da8b+10:121866:x1870858812312704:12345-192.168.204.16@tcp:101:mount.lustre.0 Request processed in 182us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191825.267633:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 217 00000100:00100000:0.0:1784191825.270465:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.270818:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812312832 00000100:00100000:2.0:1784191825.270829:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812312832 00000100:00100000:2.0:1784191825.270949:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 218 00000100:00100000:2.0:1784191825.270961:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9e3b1f6-8cce-446b-b02a-9948a606da8b+10:121866:x1870858812312832:12345-192.168.204.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784191825.271141:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9e3b1f6-8cce-446b-b02a-9948a606da8b+10:121866:x1870858812312832:12345-192.168.204.16@tcp:501:mount.lustre.0 Request processed in 180us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191825.271150:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 218 00000100:00100000:2.0:1784191825.274071:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191825.274940:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812312960 00000100:00100000:0.0:1784191825.274953:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812312960 00000100:00100000:0.0:1784191825.275126:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 219 00000100:00100000:0.0:1784191825.275139:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9e3b1f6-8cce-446b-b02a-9948a606da8b+10:121866:x1870858812312960:12345-192.168.204.16@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784191825.275377:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9e3b1f6-8cce-446b-b02a-9948a606da8b+10:121866:x1870858812312960:12345-192.168.204.16@tcp:503:mount.lustre.0 Request processed in 241us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191825.275386:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 219 00000100:00100000:3.0:1784191825.281614:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.281917:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812313088 00000100:00100000:2.0:1784191825.281942:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812313088 00000100:00100000:2.0:1784191825.282065:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 220 00000100:00100000:2.0:1784191825.282076:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9e3b1f6-8cce-446b-b02a-9948a606da8b+10:121885:x1870858812313088:12345-192.168.204.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784191825.282516:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9e3b1f6-8cce-446b-b02a-9948a606da8b+10:121885:x1870858812313088:12345-192.168.204.16@tcp:502:llog_process_th.0 Request processed in 440us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191825.282525:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 220 00000100:00100000:2.0:1784191825.289043:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191825.289208:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812313216 00000100:00100000:0.0:1784191825.289218:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812313216 00000100:00100000:0.0:1784191825.289290:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 221 00000100:00100000:0.0:1784191825.289302:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9e3b1f6-8cce-446b-b02a-9948a606da8b+10:121885:x1870858812313216:12345-192.168.204.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784191825.289475:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9e3b1f6-8cce-446b-b02a-9948a606da8b+10:121885:x1870858812313216:12345-192.168.204.16@tcp:502:llog_process_th.0 Request processed in 174us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191825.289484:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 221 00000100:00100000:3.0:1784191825.295182:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.295630:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812313344 00000100:00100000:2.0:1784191825.295641:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812313344 00000100:00100000:2.0:1784191825.295726:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 334 00000100:00100000:2.0:1784191825.295734:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:69108:x1870858812313344:12345-192.168.204.16@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784191825.295769:0:158667:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 8673fc11-fb8a-4aba-9612-ff2cd2a411bc@192.168.204.16@tcp t0 exp 0000000000000000 cur 5445 last 0 00000020:00000080:2.0:1784191825.295822:0:158667:0:(genops.c:1406:class_connect()) connect: client 8673fc11-fb8a-4aba-9612-ff2cd2a411bc, cookie 0xfeec3c2dc5a4a24f 00000004:00100000:2.0:1784191825.295848:0:158667:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784191825.295950:0:158667:0:(import.c:65:import_set_state_nolock()) ffff8af110dfe000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784191825.296036:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:69108:x1870858812313344:12345-192.168.204.16@tcp:38:mount.lustre.0 Request processed in 300us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191825.296045:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 334 00000100:00100000:3.0:1784191825.297021:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191825.298167:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812313600 00000100:00100000:1.0:1784191825.298179:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812313600 00000100:00100000:1.0:1784191825.298306:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 335 00000100:00100000:1.0:1784191825.298315:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:69108:x1870858812313600:12345-192.168.204.16@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784191825.298349:0:158666:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 8673fc11-fb8a-4aba-9612-ff2cd2a411bc@192.168.204.16@tcp t0 exp 0000000000000000 cur 5445 last 0 00000020:00000080:1.0:1784191825.299188:0:158666:0:(genops.c:1406:class_connect()) connect: client 8673fc11-fb8a-4aba-9612-ff2cd2a411bc, cookie 0xfeec3c2dc5a4a256 00000004:00100000:1.0:1784191825.299220:0:158666:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784191825.299322:0:158666:0:(import.c:65:import_set_state_nolock()) ffff8af23d858000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784191825.299409:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:69108:x1870858812313600:12345-192.168.204.16@tcp:38:mount.lustre.0 Request processed in 1092us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191825.299429:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 335 00000100:00100000:0.0:1784191825.301059:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191825.307718:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.307833:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812313472 00000100:00100000:2.0:1784191825.307843:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812313472 00000100:00100000:1.0:1784191825.319721:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812313856 00000100:00100000:1.0:1784191825.319737:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812313856 00000100:00100000:1.0:1784191825.319825:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 336 00000100:00100000:1.0:1784191825.319837:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af107906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+7:0:x1870858812313472:12345-192.168.204.16@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784191825.319888:0:158666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42659840 avail 36528128 00000100:00100000:3.0:1784191825.320053:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 337 00000100:00100000:3.0:1784191825.320065:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af107906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+7:121866:x1870858812313856:12345-192.168.204.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1784191825.320080:0:158665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42659840 avail 36528128 00000100:00100000:3.0:1784191825.320240:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af107906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+7:121866:x1870858812313856:12345-192.168.204.16@tcp:41:mount.lustre.0 Request processed in 177us (12530us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191825.320248:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 337 00000100:00100000:3.0:1784191825.320548:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191825.322661:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812313728 00000100:00100000:3.0:1784191825.322679:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812313728 00000100:00100000:3.0:1784191825.322831:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 338 00000100:00100000:3.0:1784191825.322842:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:0:x1870858812313728:12345-192.168.204.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1784191825.322960:0:158665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42786816 avail 36655104 00000100:00100000:3.0:1784191825.323155:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:0:x1870858812313728:12345-192.168.204.16@tcp:41:mount.lustre.0 Request processed in 314us (2607us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191825.323164:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 338 00000100:00100000:3.0:1784191825.323238:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191825.324048:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af107906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:0:x1870858812313472:12345-192.168.204.16@tcp:41:mount.lustre.0 Request processed in 4210us (22991us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191825.324075:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 336 00000100:00100000:1.0:1784191825.324097:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812313984 00000100:00100000:1.0:1784191825.324102:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812313984 00000100:00100000:1.0:1784191825.324127:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 339 00000100:00100000:1.0:1784191825.324134:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:121866:x1870858812313984:12345-192.168.204.16@tcp:40:mount.lustre.0 00000100:00100000:1.0:1784191825.324177:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:121866:x1870858812313984:12345-192.168.204.16@tcp:40:mount.lustre.0 Request processed in 43us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191825.324185:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 339 00000100:00080000:1.0:1784191825.324282:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784191825.324288:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784191825.330071:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191825.330123:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.330189:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812314112 00000100:00100000:2.0:1784191825.330199:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812314112 00000100:00100000:2.0:1784191825.330243:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812314240 00000100:00100000:2.0:1784191825.330246:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812314240 00000100:00100000:1.0:1784191825.330263:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 215 00000100:00100000:2.0:1784191825.330271:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 216 00000100:00100000:1.0:1784191825.330273:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:69108:x1870858812314112:12345-192.168.204.16@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784191825.330311:0:162395:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 8673fc11-fb8a-4aba-9612-ff2cd2a411bc@192.168.204.16@tcp t0 exp 0000000000000000 cur 5445 last 0 00000100:00100000:2.0:1784191825.330347:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:69108:x1870858812314240:12345-192.168.204.16@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784191825.330366:0:161232:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 8673fc11-fb8a-4aba-9612-ff2cd2a411bc@192.168.204.16@tcp t0 exp 0000000000000000 cur 5445 last 0 00000020:00000080:1.0:1784191825.330397:0:162395:0:(genops.c:1406:class_connect()) connect: client 8673fc11-fb8a-4aba-9612-ff2cd2a411bc, cookie 0xfeec3c2dc5a4a25d 00002000:00100000:1.0:1784191825.330414:0:162395:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8673fc11-fb8a-4aba-9612-ff2cd2a411bc/ffff8af107877000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784191825.330435:0:162395:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784191825.330517:0:162395:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000020:00000080:2.0:1784191825.330524:0:161232:0:(genops.c:1406:class_connect()) connect: client 8673fc11-fb8a-4aba-9612-ff2cd2a411bc, cookie 0xfeec3c2dc5a4a264 00002000:00100000:2.0:1784191825.330530:0:161232:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8673fc11-fb8a-4aba-9612-ff2cd2a411bc/ffff8af110dfc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784191825.330541:0:161232:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784191825.330544:0:162395:0:(import.c:65:import_set_state_nolock()) ffff8af107874800 : changing import state from RECOVER to FULL 00002000:00080000:2.0:1784191825.330570:0:161232:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1784191825.330648:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:69108:x1870858812314112:12345-192.168.204.16@tcp:8:mount.lustre.0 Request processed in 375us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191825.330656:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 215 00000100:00080000:2.0:1784191825.332299:0:161232:0:(import.c:65:import_set_state_nolock()) ffff8af110dfc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784191825.332436:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:69108:x1870858812314240:12345-192.168.204.16@tcp:8:mount.lustre.0 Request processed in 2153us (2307us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191825.332447:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 216 00000100:00100000:1.0:1784191825.344108:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.346190:0:158676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812314368 00000100:00100000:2.0:1784191825.346204:0:158676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812314368 00000100:00100000:2.0:1784191825.346510:0:158676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9 00000100:00100000:2.0:1784191825.346522:0:158676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:121866:x1870858812314368:12345-192.168.204.16@tcp:900:mount.lustre.0 00000100:00100000:2.0:1784191825.346628:0:158676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:121866:x1870858812314368:12345-192.168.204.16@tcp:900:mount.lustre.0 Request processed in 102us (2525us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191825.346636:0:158676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9 00000100:00100000:3.0:1784191825.352134:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.352775:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812314496 00000100:00100000:2.0:1784191825.352788:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812314496 00000100:00100000:2.0:1784191825.352863:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 92 00000100:00100000:2.0:1784191825.353186:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1099f4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:121866:x1870858812314496:12345-192.168.204.16@tcp:33:mount.lustre.0 00000004:00200000:2.0:1784191825.353679:0:158668:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1784191825.354064:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1099f4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:121866:x1870858812314496:12345-192.168.204.16@tcp:33:mount.lustre.0 Request processed in 1186us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191825.354075:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 92 00000100:00100000:1.0:1784191825.491850:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.492130:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812314624 00000100:00100000:2.0:1784191825.492141:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812314624 00000100:00100000:2.0:1784191825.492212:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 340 00000100:00100000:2.0:1784191825.492235:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:121902:x1870858812314624:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1784191825.492257:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191825.492294:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a26b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b4f6 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.492364:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a272 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.492631:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a272 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.492650:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a272 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191825.492734:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191825.492738:0:158666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191825.492759:0:158666:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a272 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.492784:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a26b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b4f6 expref: 8 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.492814:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a272 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b4f6 expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.492824:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191825.492827:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191825.492830:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4a00, rc 0) 00000100:00100000:2.0:1784191825.492901:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+7:121902:x1870858812314624:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 679us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191825.492908:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 340 00000100:00100000:1.0:1784191825.504596:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191825.512999:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812314752 00000100:00100000:3.0:1784191825.513016:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812314752 00000100:00100000:3.0:1784191825.513176:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 341 00000100:00100000:3.0:1784191825.513188:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+7:121902:x1870858812314752:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1784191825.513213:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191825.513237:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a279 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b4fd expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513303:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a280 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513317:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a280 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513327:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a280 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513341:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a287 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513347:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a287 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513352:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a287 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513394:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a280 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513402:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a280 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513408:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a280 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513425:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a280 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513431:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7ce00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191825.513435:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a280 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513442:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a280 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513456:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191825.513458:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191825.513462:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a280 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513469:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a280 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513488:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a287 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513494:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a287 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513500:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a287 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513505:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7d600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191825.513508:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a287 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513525:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a287 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513534:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfabfbe3f (ffff8af215ff6d00) 00010000:00010000:3.0:1784191825.513536:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191825.513539:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a287 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513545:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a287 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513750:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a279 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b4fd expref: 8 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513764:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191825.513766:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191825.513770:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a279 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b4fd expref: 8 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.513781:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7c600, rc 0) 00000100:00100000:3.0:1784191825.513944:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+7:121902:x1870858812314752:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 756us (9356us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191825.513951:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 341 00000100:00100000:3.0:1784191825.645929:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191825.646200:0:158674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812314880 00000100:00100000:0.0:1784191825.646212:0:158674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812314880 00000100:00100000:0.0:1784191825.646596:0:158674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4 00000100:00100000:0.0:1784191825.646609:0:158674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+7:121902:x1870858812314880:12345-192.168.204.16@tcp:700:lfs.0 00000100:00100000:0.0:1784191825.646759:0:158674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+7:121902:x1870858812314880:12345-192.168.204.16@tcp:700:lfs.0 Request processed in 153us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191825.646767:0:158674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4 00000100:00100000:0.0:1784191825.651611:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191825.652180:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812315136 00000100:00100000:1.0:1784191825.652192:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812315136 00000100:00100000:1.0:1784191825.652309:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 342 00000100:00100000:1.0:1784191825.652321:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+7:121902:x1870858812315136:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:1.0:1784191825.652393:0:161504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191825.652433:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a272 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b4f6 expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.652453:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:1.0:1784191825.652459:0:161504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784191825.652524:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f000/0xfeec3c2dc5a4a28e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.652538:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f000/0xfeec3c2dc5a4a28e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.652548:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f000/0xfeec3c2dc5a4a28e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.652563:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a295 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.652571:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a295 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.652577:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a295 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:1.0:1784191825.653737:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 251 < left 306, rollback = 2 00080000:00000400:1.0:1784191825.653754:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:1.0:1784191825.653756:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:1.0:1784191825.653758:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/2 00080000:00000400:1.0:1784191825.653760:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/3, delete: 0/0/0 00080000:00000400:1.0:1784191825.653763:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191825.653788:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 251 < left 306, rollback = 2 00080000:00000400:1.0:1784191825.653791:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:1.0:1784191825.653793:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:1.0:1784191825.653795:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/2 00080000:00000400:1.0:1784191825.653798:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/3, delete: 0/0/0 00080000:00000400:1.0:1784191825.653814:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191825.653829:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 251 < left 306, rollback = 2 00080000:00000400:1.0:1784191825.653831:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:1.0:1784191825.653833:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:1.0:1784191825.653834:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/2 00080000:00000400:1.0:1784191825.653836:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/3, delete: 0/0/0 00080000:00000400:1.0:1784191825.653839:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191825.653845:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 251 < left 306, rollback = 2 00080000:00000400:1.0:1784191825.653848:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:1.0:1784191825.653849:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:1.0:1784191825.653851:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/2 00080000:00000400:1.0:1784191825.653853:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/3, delete: 0/0/0 00080000:00000400:1.0:1784191825.653855:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191825.653883:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 249 < left 306, rollback = 2 00080000:00000400:1.0:1784191825.653886:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:1.0:1784191825.653887:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:1.0:1784191825.653889:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/2 00080000:00000400:1.0:1784191825.653891:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/5, delete: 0/0/0 00080000:00000400:1.0:1784191825.653893:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191825.653996:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a29c lrc: 3/0,1 mode: --/PW res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.654011:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a29c lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.654027:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a29c lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191825.654039:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b6475788 reply state 0000000027b9704a transno 34359738594 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a29c lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.654050:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a29c lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.654056:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af20db3d200) 00010000:00010000:1.0:1784191825.654058:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191825.654061:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784191825.654067:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab3:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1784191825.654075:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f000/0xfeec3c2dc5a4a28e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.654081:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f000/0xfeec3c2dc5a4a28e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.654086:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f000/0xfeec3c2dc5a4a28e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.654091:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f000/0xfeec3c2dc5a4a28e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.654096:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191825.654100:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f000/0xfeec3c2dc5a4a28e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.654107:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f000/0xfeec3c2dc5a4a28e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.654125:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:1.0:1784191825.654127:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191825.654131:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f000/0xfeec3c2dc5a4a28e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.654137:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f000/0xfeec3c2dc5a4a28e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191825.654152:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b6475788 reply state 0000000027b9704a transno 34359738594 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a295 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.654160:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a295 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.654165:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfabfbe3f (ffff8af20db3d600) 00010000:00010000:1.0:1784191825.654167:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191825.654169:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1784191825.654266:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+8:121902:x1870858812315136:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 1943us (2662us total) trans 34359738594 rc 0/0 00000100:00100000:1.0:1784191825.654275:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 342 00000100:00100000:1.0:1784191825.683959:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.684122:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812315264 00000100:00100000:2.0:1784191825.684148:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812315264 00000100:00100000:2.0:1784191825.684210:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 343 00000100:00100000:2.0:1784191825.684221:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+8:121912:x1870858812315264:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1784191825.684244:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191825.684491:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a2a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b504 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.684564:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a2aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.684580:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a2aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.684594:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a2aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191825.684730:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191825.684735:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191825.684761:0:158667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a2aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.684787:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a2a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b504 expref: 10 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.684816:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a2aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b504 expref: 9 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.684826:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191825.684829:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191825.684832:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4c00, rc 0) 00000100:00100000:2.0:1784191825.684964:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+9:121912:x1870858812315264:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 744us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191825.684981:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 343 00000100:00100000:0.0:1784191825.696463:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191825.696863:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812315520 00000100:00100000:3.0:1784191825.696875:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812315520 00000100:00100000:3.0:1784191825.696943:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 344 00000100:00100000:3.0:1784191825.696955:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+9:121912:x1870858812315520:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1784191825.696996:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191825.697000:0:158665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784191825.697028:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a2aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b504 expref: 9 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697049:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191825.697054:0:158665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784191825.697069:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a2b1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b50b expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697180:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a2b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697194:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a2b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697203:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a2b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697214:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a2bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697221:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a2bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697227:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a2bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697289:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a2c6 lrc: 3/1,0 mode: --/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697306:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a2c6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697314:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a2c6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191825.697324:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab3:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784191825.697340:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a2c6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697347:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a2c6 lrc: 2/0,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697354:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a2c6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697360:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7c000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191825.697364:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a2c6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697372:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a2c6 lrc: 4/0,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697380:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af20db3d200) 00010000:00010000:3.0:1784191825.697383:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191825.697387:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a2c6 lrc: 2/0,0 mode: --/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697393:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a2c6 lrc: 0/0,0 mode: --/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697425:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a2b8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697431:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a2b8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697437:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a2b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697442:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a2b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697447:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7d600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191825.697451:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a2b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697457:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a2b8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697466:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191825.697468:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191825.697471:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a2b8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697477:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a2b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697492:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a2bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697498:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a2bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697511:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a2bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.697517:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7ce00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191825.699299:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a2bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.699319:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a2bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.699337:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfabfbe3f (ffff8af20db3d600) 00010000:00010000:3.0:1784191825.699340:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191825.699344:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a2bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.699351:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a2bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.699407:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a2b1 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b50b expref: 9 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.699417:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191825.699421:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191825.699423:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a2b1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b50b expref: 9 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.699433:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7c600, rc 0) 00000100:00100000:3.0:1784191825.704186:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+8:121912:x1870858812315520:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 7216us (7716us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191825.704227:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 344 00000100:00100000:0.0:1784191825.708222:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191825.708559:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812315648 00000100:00100000:1.0:1784191825.708573:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812315648 00000100:00100000:1.0:1784191825.709107:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 345 00000100:00100000:1.0:1784191825.709120:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+8:121912:x1870858812315648:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1784191825.709143:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191825.709166:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f000/0xfeec3c2dc5a4a2cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b512 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.709450:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a2d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.709468:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.709480:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191825.709526:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784191825.709531:0:161504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784191825.709551:0:161504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.709575:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f000/0xfeec3c2dc5a4a2cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b512 expref: 10 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.709595:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a2d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b512 expref: 9 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.709885:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:1.0:1784191825.709888:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784191825.709892:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e200, rc 0) 00000100:00100000:1.0:1784191825.710112:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+9:121912:x1870858812315648:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 993us (1901us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191825.710120:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 345 00000100:00100000:2.0:1784191825.716178:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191825.716282:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812315904 00000100:00100000:1.0:1784191825.716292:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812315904 00000100:00100000:1.0:1784191825.716377:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 346 00000100:00100000:1.0:1784191825.716388:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+9:121912:x1870858812315904:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1784191825.716410:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191825.716429:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f000/0xfeec3c2dc5a4a2db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b519 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.716497:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a2e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.716511:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.716522:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.716531:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4a2e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.716537:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4a2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.716543:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4a2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191825.716619:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab3:0x1:0x0]: returning size 4096 00000001:00080000:3.0:1784191825.718275:0:158645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738595 is committed 00000001:00100000:3.0:1784191825.718291:0:158645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8673fc11-fb8a-4aba-9612-ff2cd2a411bc 00000001:00100000:3.0:1784191825.718296:0:158645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8c2c50be-ac0a-45d2-a88f-69ee938110a0 00000001:00080000:3.0:1784191825.718304:0:158645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738593 is committed 00000020:00000080:3.0:1784191825.718307:0:158645:0:(genops.c:906:class_export_put()) final put ffff8af10c36c000/8c2c50be-ac0a-45d2-a88f-69ee938110a0 00010000:00010000:1.0:1784191825.718391:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a295 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.718402:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a295 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.718409:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a295 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.718423:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ec00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191825.718428:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a295 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.718435:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a295 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.718450:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfabfbe3f (ffff8af20db3d600) 00010000:00010000:1.0:1784191825.718454:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191825.718459:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a295 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.718466:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a295 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.718485:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a29c lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.718491:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a29c lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.718497:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a29c lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.718502:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191825.718504:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a29c lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.718510:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a29c lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.718529:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af20db3d200) 00010000:00010000:1.0:1784191825.718531:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191825.718534:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a29c lrc: 2/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.718539:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a29c lrc: 0/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.718546:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.718555:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a2e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.718560:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a2e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.718566:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191825.718569:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a2e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.718576:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a2e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.718584:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191825.718587:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191825.718605:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a2e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.718610:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a2e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.718620:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4a2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.718626:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4a2e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.718823:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4a2e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.718828:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7fc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191825.718831:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4a2e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.719099:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4a2e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.719109:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfabfbe3f (ffff8af20db3d600) 00010000:00010000:2.0:1784191825.719112:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191825.719115:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4a2e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.719120:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4a2e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.719177:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f000/0xfeec3c2dc5a4a2db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b519 expref: 7 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784191825.719177:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10c36c000/8c2c50be-ac0a-45d2-a88f-69ee938110a0 for lustre-MDT0000 00010000:00010000:2.0:1784191825.719188:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191825.719191:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191825.719194:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f000/0xfeec3c2dc5a4a2db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b519 expref: 7 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.719203:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f000, rc 0) 00000020:00000080:0.0:1784191825.719235:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af10c36b000 for lustre-MDT0000 00000100:00100000:2.0:1784191825.719401:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:121912:x1870858812315904:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3014us (3232us total) trans 34359738595 rc 301/301 00000100:00100000:2.0:1784191825.719419:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 346 00000100:00100000:0.0:1784191825.722067:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191825.722455:0:158677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812316032 00000100:00100000:3.0:1784191825.722466:0:158677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812316032 00000100:00100000:3.0:1784191825.722566:0:158677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10 00000100:00100000:3.0:1784191825.722578:0:158677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:121912:x1870858812316032:12345-192.168.204.16@tcp:900:lfs.0 00000100:00100000:3.0:1784191825.722673:0:158677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:121912:x1870858812316032:12345-192.168.204.16@tcp:900:lfs.0 Request processed in 97us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191825.722681:0:158677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10 00000100:00100000:0.0:1784191825.727137:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191825.727959:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812316288 00000100:00100000:3.0:1784191825.727971:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812316288 00000100:00100000:2.0:1784191825.728176:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 347 00000100:00100000:2.0:1784191825.728187:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:121912:x1870858812316288:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:2.0:1784191825.728282:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a2f7 lrc: 3/0,1 mode: --/PW res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.728299:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a2f7 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.728311:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a2f7 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191825.728474:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004961d939 reply state 00000000fdc2ceb6 transno 34359738596 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a2f7 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.728488:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a2f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.728495:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:2.0:1784191825.728498:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1784191825.728501:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784191825.728510:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab3:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1784191825.728670:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+8:121912:x1870858812316288:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 483us (1542us total) trans 34359738596 rc 0/0 00000100:00100000:2.0:1784191825.728678:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 347 00000100:00100000:3.0:1784191825.730890:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191825.731058:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812316544 00000100:00100000:0.0:1784191825.731069:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812316544 00000100:00100000:0.0:1784191825.731126:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 93 00000100:00100000:0.0:1784191825.731137:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+8:121912:x1870858812316544:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:0.0:1784191825.731383:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+9:121912:x1870858812316544:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 247us (500us total) trans 34359738597 rc 0/0 00000100:00100000:0.0:1784191825.731392:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 93 00000100:00100000:0.0:1784191825.753007:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191825.753155:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812316800 00000100:00100000:1.0:1784191825.753165:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812316800 00000100:00100000:1.0:1784191825.753237:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 348 00000100:00100000:1.0:1784191825.753248:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+9:121913:x1870858812316800:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1784191825.753276:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191825.753279:0:161504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784191825.753307:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a2d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b512 expref: 9 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.753327:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:1.0:1784191825.753333:0:161504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784191825.753346:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a2fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b520 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.753461:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a305 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.753475:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a305 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.753485:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a305 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.753518:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a30c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.753525:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a30c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.753533:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a30c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.753597:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a313 lrc: 3/1,0 mode: --/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.753606:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a313 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.753613:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a313 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191825.753622:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab3:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1784191825.753637:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a313 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.753643:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a313 lrc: 2/0,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.753650:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a313 lrc: 3/0,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.753655:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191825.753660:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a313 lrc: 3/0,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.753677:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a313 lrc: 4/0,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754117:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:1.0:1784191825.754124:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191825.754130:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a313 lrc: 2/0,0 mode: --/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754137:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a313 lrc: 0/0,0 mode: --/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754156:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a305 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754162:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a305 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754168:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a305 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754174:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a305 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754180:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ec00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191825.754183:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a305 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754190:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a305 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754199:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:1.0:1784191825.754208:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191825.754212:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a305 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754218:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a305 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754228:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a30c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754233:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a30c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754239:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a30c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754244:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191825.754247:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a30c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754252:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a30c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754260:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfabfbe3f (ffff8af20db3d200) 00010000:00010000:1.0:1784191825.754262:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191825.754265:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a30c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754270:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a30c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754306:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a2fe lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b520 expref: 9 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754324:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:1.0:1784191825.754326:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191825.754330:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a2fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b520 expref: 9 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.754340:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e400, rc 0) 00000100:00100000:1.0:1784191825.754412:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+8:121913:x1870858812316800:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1165us (1415us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191825.754420:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 348 00000100:00100000:1.0:1784191825.756484:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.756569:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812316928 00000100:00100000:2.0:1784191825.756578:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812316928 00000100:00100000:2.0:1784191825.756675:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 349 00000100:00100000:2.0:1784191825.756685:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+8:121913:x1870858812316928:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1784191825.756755:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191825.756774:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a31a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b527 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.756846:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5400/0xfeec3c2dc5a4a321 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.756866:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5400/0xfeec3c2dc5a4a321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.756877:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5400/0xfeec3c2dc5a4a321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191825.756927:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191825.756931:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191825.756952:0:158667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5400/0xfeec3c2dc5a4a321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.756991:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a31a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b527 expref: 10 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.757007:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5400/0xfeec3c2dc5a4a321 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b527 expref: 9 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.757015:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191825.757018:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191825.757021:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5400, rc 0) 00000100:00100000:2.0:1784191825.757074:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+9:121913:x1870858812316928:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 390us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191825.757081:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 349 00000100:00100000:0.0:1784191825.760416:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.760522:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812317184 00000100:00100000:2.0:1784191825.760533:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812317184 00000100:00100000:2.0:1784191825.760732:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 350 00000100:00100000:2.0:1784191825.760744:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+9:121913:x1870858812317184:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1784191825.760768:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191825.760790:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a328 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b52e expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.760879:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a32f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.760894:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a32f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.760906:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a32f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.760921:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a336 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.760928:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a336 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.760936:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a336 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191825.761233:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab3:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784191825.761331:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a32f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.761338:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a32f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.761361:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a32f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.761367:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a32f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.761372:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191825.761377:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a32f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.761384:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a32f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.761398:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191825.761401:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191825.761405:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a32f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.761411:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a32f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.761425:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a336 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.761431:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a336 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.761436:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a336 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.761440:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191825.761447:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a336 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.761453:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a336 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.761460:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfabfbe3f (ffff8af210e98300) 00010000:00010000:2.0:1784191825.761463:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191825.761465:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a336 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.761471:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a336 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.761515:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a328 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b52e expref: 11 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.761526:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191825.761528:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191825.761531:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a328 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b52e expref: 11 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.761540:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4200, rc 0) 00000100:00100000:2.0:1784191825.761898:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+10:121913:x1870858812317184:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1154us (1489us total) trans 34359738598 rc 301/301 00000100:00100000:2.0:1784191825.761910:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 350 00000100:00100000:0.0:1784191825.765375:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191825.765465:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812317440 00000100:00100000:1.0:1784191825.765479:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812317440 00000100:00100000:1.0:1784191825.765574:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 351 00000100:00100000:1.0:1784191825.765586:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+10:121913:x1870858812317440:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:1.0:1784191825.765682:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a344 lrc: 3/0,1 mode: --/PW res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.765758:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a344 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.765770:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a344 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191825.765952:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f1b98e25 reply state 00000000bb0ab0d9 transno 34359738599 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a344 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.765967:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a344 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.766001:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:1.0:1784191825.766004:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1784191825.766008:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784191825.766016:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab3:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1784191825.766084:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+12:121913:x1870858812317440:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 500us (719us total) trans 34359738599 rc 0/0 00000100:00100000:1.0:1784191825.766103:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 351 00000100:00100000:0.0:1784191825.768276:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191825.768354:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812317696 00000100:00100000:3.0:1784191825.768363:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812317696 00000100:00100000:3.0:1784191825.768419:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 94 00000100:00100000:3.0:1784191825.768429:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+12:121913:x1870858812317696:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:3.0:1784191825.768748:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+13:121913:x1870858812317696:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 319us (478us total) trans 34359738600 rc 0/0 00000100:00100000:3.0:1784191825.768756:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 94 00000100:00100000:0.0:1784191825.776555:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.776637:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812317824 00000100:00100000:2.0:1784191825.776648:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812317824 00000100:00100000:2.0:1784191825.776755:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 352 00000100:00100000:2.0:1784191825.776767:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+13:121914:x1870858812317824:12345-192.168.204.16@tcp:101:touch.0 00010000:00010000:2.0:1784191825.776827:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191825.776852:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a34b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b535 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.776921:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a352 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.776936:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a352 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.776947:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a352 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.776962:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a359 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777143:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a359 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777152:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a359 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777213:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a360 lrc: 3/1,0 mode: --/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777221:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a360 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777227:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a360 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191825.777262:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab3:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191825.777273:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191825.777300:0:158667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a360 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777312:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a352 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777319:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a352 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777326:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a352 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777332:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191825.777336:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a352 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777344:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a352 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777357:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191825.777359:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191825.777364:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a352 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777370:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a352 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777382:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a359 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777388:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a359 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777404:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a359 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777410:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191825.777413:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a359 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777419:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a359 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777426:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfabfbe3f (ffff8af210e98200) 00010000:00010000:2.0:1784191825.777429:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191825.777431:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a359 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777437:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a359 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777471:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a34b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b535 expref: 15 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777485:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a360 lrc: 3/0,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b535 expref: 14 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.777492:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:2.0:1784191825.777494:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784191825.777497:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5000, rc 0) 00000100:00100000:2.0:1784191825.777608:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+14:121914:x1870858812317824:12345-192.168.204.16@tcp:101:touch.0 Request processed in 843us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191825.777625:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 352 00000100:00100000:0.0:1784191825.808847:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.809000:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812318080 00000100:00100000:2.0:1784191825.809012:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812318080 00000100:00100000:2.0:1784191825.809081:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 353 00000100:00100000:2.0:1784191825.809194:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+14:121914:x1870858812318080:12345-192.168.204.16@tcp:101:touch.0 00010000:00010000:2.0:1784191825.809223:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191825.809246:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a367 lrc: 2/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b53c expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.809378:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a36e lrc: 3/0,1 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.809399:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a36e lrc: 3/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.809412:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a36e lrc: 3/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.809426:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a375 lrc: 3/0,1 mode: --/PW res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.809433:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a375 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.809439:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a375 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191825.810328:0:158665:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x21c:0x0], count =38 00000004:00080000:2.0:1784191825.810337:0:158665:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x21c:0x0]+38 in llog 00000004:00080000:2.0:1784191825.810350:0:158665:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x242:0x0], index 0: 0 00080000:00000400:2.0:1784191825.810377:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 252 < left 306, rollback = 2 00080000:00000400:2.0:1784191825.810380:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:2.0:1784191825.810382:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191825.810384:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 1/3/2 00080000:00000400:2.0:1784191825.810386:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/1, delete: 0/0/0 00080000:00000400:2.0:1784191825.810388:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191825.810411:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 252 < left 306, rollback = 2 00080000:00000400:2.0:1784191825.810414:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:2.0:1784191825.810415:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191825.810417:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 1/3/2 00080000:00000400:2.0:1784191825.810419:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/1, delete: 0/0/0 00080000:00000400:2.0:1784191825.810421:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191825.810429:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 252 < left 306, rollback = 2 00080000:00000400:2.0:1784191825.810431:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:2.0:1784191825.810433:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191825.810435:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 1/3/2 00080000:00000400:2.0:1784191825.810437:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/1, delete: 0/0/0 00080000:00000400:2.0:1784191825.810439:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191825.810448:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 252 < left 306, rollback = 2 00080000:00000400:2.0:1784191825.810451:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:2.0:1784191825.810452:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191825.810454:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 1/3/2 00080000:00000400:2.0:1784191825.810456:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/1, delete: 0/0/0 00080000:00000400:2.0:1784191825.810457:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191825.810491:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 251 < left 306, rollback = 2 00080000:00000400:2.0:1784191825.810493:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:2.0:1784191825.810495:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191825.810496:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 1/3/2 00080000:00000400:2.0:1784191825.810498:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/2, delete: 0/0/0 00080000:00000400:2.0:1784191825.810500:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191825.810612:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a37c lrc: 3/1,0 mode: --/PR res: [0x200003ab3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.810636:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a37c lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.810647:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a37c lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.810712:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a36e lrc: 4/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.810795:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a36e lrc: 4/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.810813:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a36e lrc: 3/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.810819:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a36e lrc: 4/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.810825:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191825.810829:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a36e lrc: 4/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.810838:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a36e lrc: 5/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.810852:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:2.0:1784191825.810854:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191825.810859:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a36e lrc: 3/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.810866:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a36e lrc: 0/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191825.810888:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fbb484b8 reply state 00000000555f0a3c transno 34359738601 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a375 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.810901:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a375 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.810908:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x138b1e0d (ffff8af210e98200) 00010000:00010000:2.0:1784191825.810910:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191825.810914:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191825.810950:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a367 lrc: 0/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b53c expref: 17 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.810966:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a37c lrc: 3/0,0 mode: PR/PR res: [0x200003ab3:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b53c expref: 16 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.811041:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x4:0x0].0x0 (ffff8af210e98300) 00010000:00010000:2.0:1784191825.811043:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191825.811046:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4200, rc 0) 00000100:00100000:2.0:1784191825.811350:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+17:121914:x1870858812318080:12345-192.168.204.16@tcp:101:touch.0 Request processed in 2256us (2511us total) trans 34359738601 rc 0/0 00000100:00100000:2.0:1784191825.811359:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 353 00000100:00100000:0.0:1784191825.820513:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191825.822462:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812318336 00000100:00100000:1.0:1784191825.822477:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812318336 00000100:00100000:1.0:1784191825.822566:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 354 00000100:00100000:1.0:1784191825.822577:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+17:121914:x1870858812318336:12345-192.168.204.16@tcp:36:touch.0 00010000:00010000:1.0:1784191825.822646:0:161504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191825.822676:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a37c lrc: 0/0,0 mode: --/PR res: [0x200003ab3:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b53c expref: 17 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.822737:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x4:0x0].0x0 (ffff8af210e98300) 00010000:00010000:1.0:1784191825.822748:0:161504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784191825.822821:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a38a lrc: 3/0,1 mode: --/PW res: [0x200003ab3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.822833:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a38a lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.822842:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a38a lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191825.822954:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d451508 reply state 0000000092483946 transno 34359738602 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a38a lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.822985:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a38a lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.822991:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x4:0x0].0x0 (ffff8af20db3d200) 00010000:00010000:1.0:1784191825.822994:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191825.822997:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784191825.823100:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+18:121914:x1870858812318336:12345-192.168.204.16@tcp:36:touch.0 Request processed in 524us (2598us total) trans 34359738602 rc 0/0 00000100:00100000:1.0:1784191825.823108:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 354 00000100:00100000:0.0:1784191825.829121:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.829288:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812318464 00000100:00100000:2.0:1784191825.829300:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812318464 00000100:00100000:2.0:1784191825.829385:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 355 00000100:00100000:2.0:1784191825.829398:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+18:121914:x1870858812318464:12345-192.168.204.16@tcp:101:touch.0 00010000:00010000:2.0:1784191825.829433:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191825.829457:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a391 lrc: 2/0,0 mode: --/CR res: [0x200003ab3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b543 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.829542:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a391 lrc: 3/0,0 mode: CR/CR res: [0x200003ab3:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b543 expref: 19 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.829559:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a391 lrc: 3/0,0 mode: CR/CR res: [0x200003ab3:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b543 expref: 19 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.829578:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x4:0x0].0x0 (ffff8af20db3d200) 00010000:00010000:2.0:1784191825.829580:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784191825.829584:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4800, rc 0) 00000100:00100000:2.0:1784191825.829648:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+19:121914:x1870858812318464:12345-192.168.204.16@tcp:101:touch.0 Request processed in 253us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191825.829656:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 355 00000100:00100000:0.0:1784191825.833576:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.833869:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812318592 00000100:00100000:2.0:1784191825.833881:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812318592 00000100:00100000:2.0:1784191825.833958:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 217 00000100:00100000:2.0:1784191825.833979:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:69112:x1870858812318592:12345-192.168.204.16@tcp:2:touch.0 00080000:00000400:2.0:1784191825.834089:0:162385:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:2.0:1784191825.834147:0:162385:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191825.834151:0:162385:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:2.0:1784191825.834153:0:162385:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/9/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191825.834156:0:162385:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191825.834158:0:162385:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191825.834191:0:162385:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:2.0:1784191825.834194:0:162385:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191825.834195:0:162385:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:2.0:1784191825.834197:0:162385:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/9/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191825.834199:0:162385:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191825.834208:0:162385:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191825.834330:0:162385:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:2.0:1784191825.834334:0:162385:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191825.834336:0:162385:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:2.0:1784191825.834338:0:162385:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/9/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191825.834340:0:162385:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191825.834342:0:162385:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00080000:1.0:1784191825.836652:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1784191825.844897:0:160160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836531 is committed 00000001:00100000:0.0:1784191825.844913:0:160160:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8673fc11-fb8a-4aba-9612-ff2cd2a411bc 00000100:00100000:2.0:1784191825.854790:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69112:x1870858812318592:12345-192.168.204.16@tcp:2:touch.0 Request processed in 20811us (21212us total) trans 21474836531 rc 0/0 00000100:00100000:2.0:1784191825.854818:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 217 00000100:00100000:0.0:1784191825.862480:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191825.862567:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812318848 00000100:00100000:3.0:1784191825.862575:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812318848 00000100:00100000:3.0:1784191825.862634:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 95 00000100:00100000:3.0:1784191825.862661:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+19:121914:x1870858812318848:12345-192.168.204.16@tcp:35:touch.0 00000100:00100000:3.0:1784191825.863103:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+20:121914:x1870858812318848:12345-192.168.204.16@tcp:35:touch.0 Request processed in 442us (632us total) trans 34359738603 rc 0/0 00000100:00100000:3.0:1784191825.863112:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 95 00000100:00100000:0.0:1784191825.885203:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.886941:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812319104 00000100:00100000:2.0:1784191825.886955:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812319104 00000100:00100000:2.0:1784191825.887035:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 356 00000100:00100000:2.0:1784191825.887046:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+20:121918:x1870858812319104:12345-192.168.204.16@tcp:101:dd.0 00010000:00010000:2.0:1784191825.887073:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191825.887095:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a398 lrc: 2/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b54a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.887204:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a39f lrc: 3/0,1 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.887218:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a39f lrc: 3/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.887230:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a39f lrc: 3/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.887278:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a3a6 lrc: 3/0,1 mode: --/PW res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.887286:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a3a6 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.887307:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a3a6 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191825.888142:0:158665:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x243:0x0], index 0: 0 00080000:00000400:2.0:1784191825.888157:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 306, rollback = 2 00080000:00000400:2.0:1784191825.888161:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191825.888163:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191825.888166:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191825.888168:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191825.888170:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191825.888191:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 306, rollback = 2 00080000:00000400:2.0:1784191825.888193:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191825.888195:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191825.888197:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191825.888199:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191825.888201:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191825.888209:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 306, rollback = 2 00080000:00000400:2.0:1784191825.888211:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191825.888213:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191825.888214:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191825.888217:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191825.888218:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191825.888227:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 306, rollback = 2 00080000:00000400:2.0:1784191825.888230:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191825.888231:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191825.888233:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191825.888235:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191825.888237:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191825.888263:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 306, rollback = 2 00080000:00000400:2.0:1784191825.888266:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191825.888275:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191825.888277:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191825.888279:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191825.888281:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191825.890891:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a3ad lrc: 3/1,0 mode: --/PR res: [0x200003ab3:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.890917:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a3ad lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.890930:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a3ad lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.890973:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a39f lrc: 4/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.890981:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a39f lrc: 4/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.890988:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a39f lrc: 3/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.890995:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a39f lrc: 4/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.891001:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191825.891005:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a39f lrc: 4/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.891013:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a39f lrc: 5/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.891025:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:2.0:1784191825.891038:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191825.891044:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a39f lrc: 3/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.891052:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a39f lrc: 0/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191825.891067:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cad3dd90 reply state 00000000de9e150b transno 34359738604 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a3a6 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.891080:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a3a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.891086:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0xcfba293b (ffff8af210e98600) 00010000:00010000:2.0:1784191825.891089:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191825.891092:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191825.892297:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a398 lrc: 0/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b54a expref: 23 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.892322:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a3ad lrc: 3/0,0 mode: PR/PR res: [0x200003ab3:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b54a expref: 22 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.892332:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x5:0x0].0x0 (ffff8af210e98e00) 00010000:00010000:2.0:1784191825.892334:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191825.892338:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4200, rc 0) 00000100:00100000:2.0:1784191825.892419:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+23:121918:x1870858812319104:12345-192.168.204.16@tcp:101:dd.0 Request processed in 5375us (7226us total) trans 34359738604 rc 0/0 00000100:00100000:2.0:1784191825.892428:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 356 00000100:00100000:1.0:1784191825.908589:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.911766:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812319232 00000100:00100000:2.0:1784191825.911781:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812319232 00000100:00100000:2.0:1784191825.911890:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 357 00000100:00100000:2.0:1784191825.911902:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+23:121918:x1870858812319232:12345-192.168.204.16@tcp:101:dd.0 00010000:00010000:2.0:1784191825.911927:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191825.911949:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a3bb lrc: 2/0,0 mode: --/PR res: [0x200003ab3:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b551 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.911984:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a3c2 lrc: 3/1,0 mode: --/PR res: [0x200003ab3:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.911997:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a3c2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.912009:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a3c2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.912254:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a3bb lrc: 0/0,0 mode: --/PR res: [0x200003ab3:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b551 expref: 25 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.912274:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a3c2 lrc: 3/0,0 mode: PR/PR res: [0x200003ab3:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b551 expref: 24 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191825.912283:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x5:0x0].0x0 (ffff8af210e98e00) 00010000:00010000:2.0:1784191825.912286:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784191825.912290:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5a00, rc 0) 00000100:00100000:2.0:1784191825.912370:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+24:121918:x1870858812319232:12345-192.168.204.16@tcp:101:dd.0 Request processed in 470us (3792us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191825.912376:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 357 00000100:00100000:0.0:1784191825.921484:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191825.922241:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812319360 00000100:00100000:1.0:1784191825.922254:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812319360 00000100:00100000:1.0:1784191825.922317:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 218 00000100:00100000:1.0:1784191825.922327:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:121918:x1870858812319360:12345-192.168.204.16@tcp:101:dd.0 00010000:00010000:1.0:1784191825.922345:0:162391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191825.922367:0:162391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000439dbac2/0xfeec3c2dc5a4a3c9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b558 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784191825.922393:0:162391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x243:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191825.922414:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x243:0x0].0x0 since=5446s v=(0 0) 00010000:00010000:1.0:1784191825.922419:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x243:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191825.922428:0:162391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000439dbac2/0xfeec3c2dc5a4a3c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b558 expref: 6 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.922447:0:162391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000439dbac2/0xfeec3c2dc5a4a3c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b558 expref: 6 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191825.922488:0:162391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ec00, rc 0) 00000100:00100000:1.0:1784191825.922860:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:121918:x1870858812319360:12345-192.168.204.16@tcp:101:dd.0 Request processed in 532us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191825.922868:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 218 00000100:00100000:0.0:1784191825.929943:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191825.930074:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812319488 00000100:00100000:1.0:1784191825.930086:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812319488 00002000:00100000:1.0:1784191825.930133:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x243:0x0] (0->4095) req@ffff8af23310b480 x1870858812319488/t0(0) o4->8673fc11-fb8a-4aba-9612-ff2cd2a411bc@192.168.204.16@tcp:751/0 lens 4584/0 e 0 to 0 dl 1784191836 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191825.930144:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af23310b480 with x1870858812319488 ext(0->4095) 00002000:00010000:1.0:1784191825.930150:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af23310b480 00000100:00100000:1.0:1784191825.930191:0:160169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 0 00000100:00100000:1.0:1784191825.930202:0:160169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:69110:x1870858812319488:12345-192.168.204.16@tcp:4:dd.0 00080000:00000400:1.0:1784191825.930427:0:160169:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:1.0:1784191825.930432:0:160169:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:1.0:1784191825.930434:0:160169:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:1.0:1784191825.930436:0:160169:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:1.0:1784191825.930439:0:160169:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:1.0:1784191825.930441:0:160169:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191825.930460:0:160169:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:1.0:1784191825.930462:0:160169:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:1.0:1784191825.930464:0:160169:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:1.0:1784191825.930466:0:160169:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:1.0:1784191825.930468:0:160169:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:1.0:1784191825.930469:0:160169:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191825.930486:0:160169:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:1.0:1784191825.930488:0:160169:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:1.0:1784191825.930497:0:160169:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:1.0:1784191825.930499:0:160169:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:1.0:1784191825.930501:0:160169:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:1.0:1784191825.930503:0:160169:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:1.0:1784191825.933073:0:160169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+8:69110:x1870858812319488:12345-192.168.204.16@tcp:4:dd.0 Request processed in 2862us (3130us total) trans 21474836532 rc 0/0 00000100:00100000:1.0:1784191825.933089:0:160169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 0 00002000:00100000:1.0:1784191825.933104:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x243:0x0] (0->4095) req@ffff8af23310b480 x1870858812319488/t21474836532(0) o4->8673fc11-fb8a-4aba-9612-ff2cd2a411bc@192.168.204.16@tcp:751/0 lens 4584/448 e 0 to 0 dl 1784191836 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191825.933114:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af23310b480 with x1870858812319488 ext(0->4095) 00002000:00010000:1.0:1784191825.933121:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af23310b480 00000100:00100000:0.0:1784191825.938427:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191825.938815:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812319616 00000100:00100000:2.0:1784191825.938827:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812319616 00000100:00100000:2.0:1784191825.938919:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 358 00000100:00100000:2.0:1784191825.938930:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+24:121918:x1870858812319616:12345-192.168.204.16@tcp:44:dd.0 00000001:00080000:1.0:1784191825.940898:0:158645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738604 is committed 00000100:00100000:2.0:1784191825.941137:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+15:121918:x1870858812319616:12345-192.168.204.16@tcp:44:dd.0 Request processed in 2203us (2712us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191825.941149:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 358 00010000:00010000:3.0:1784191825.942459:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a2f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.942476:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a2f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.942484:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a2f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.942491:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191825.942496:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a2f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.942504:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a2f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.942523:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:3.0:1784191825.942525:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784191825.942531:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a2f7 lrc: 2/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.942536:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a2f7 lrc: 0/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.942558:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a344 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.942586:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a344 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.942591:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a344 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.942596:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191825.942599:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a344 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.942605:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a344 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.942614:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:3.0:1784191825.942617:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784191825.942619:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a344 lrc: 2/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.942625:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a344 lrc: 0/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.942637:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a375 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.942643:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a375 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.942650:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a375 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.942654:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191825.942665:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a375 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.942671:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a375 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.942679:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x138b1e0d (ffff8af210e98200) 00010000:00010000:3.0:1784191825.942681:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191825.942684:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a375 lrc: 2/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.943321:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a375 lrc: 0/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.943345:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a38a lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.943351:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a38a lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.943358:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a38a lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.943363:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191825.943366:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a38a lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.943372:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a38a lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.943381:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x4:0x0].0x0 (ffff8af20db3d200) 00010000:00010000:3.0:1784191825.943385:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191825.943396:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a38a lrc: 2/0,0 mode: --/TXN res: [0x200003ab3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.943403:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4a38a lrc: 0/0,0 mode: --/TXN res: [0x200003ab3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.943417:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a3a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.943423:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a3a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.943429:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a3a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.943434:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191825.943437:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a3a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.943443:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a3a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.943452:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0xcfba293b (ffff8af210e98600) 00010000:00010000:3.0:1784191825.943454:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191825.943457:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a3a6 lrc: 2/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191825.943462:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a3a6 lrc: 0/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191825.947360:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191825.947819:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812319744 00000100:00100000:1.0:1784191825.947830:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812319744 00000100:00100000:1.0:1784191825.947893:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 219 00000100:00100000:1.0:1784191825.947904:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+8:69109:x1870858812319744:12345-192.168.204.16@tcp:16:dd.0 00000001:00080000:2.0:1784191825.949365:0:160160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836532 is committed 00000100:00100000:1.0:1784191825.949820:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:69109:x1870858812319744:12345-192.168.204.16@tcp:16:dd.0 Request processed in 1913us (2465us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191825.949832:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 219 00000100:00100000:0.0:1784191825.952155:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191825.952271:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812320000 00000100:00100000:3.0:1784191825.952280:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812320000 00000100:00100000:3.0:1784191825.952339:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 96 00000100:00100000:3.0:1784191825.952367:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+10:121918:x1870858812320000:12345-192.168.204.16@tcp:35:dd.0 00000100:00100000:2.0:1784191825.953417:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+11:121918:x1870858812320000:12345-192.168.204.16@tcp:35:dd.0 Request processed in 1045us (1264us total) trans 34359738605 rc 0/0 00000100:00100000:2.0:1784191825.953428:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 96 00010000:00010000:0.0:1784191825.995881:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191826.444239:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827863040:0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.444316:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191826.444362:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827863552:0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.444389:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191826.444404:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827864064:0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.444423:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191826.444450:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827864576:0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.444474:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191826.444503:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784191826.444509:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827863168:0@lo:400:kworker.0 00000100:00100000:3.0:1784191826.444528:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827862912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784191826.444540:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191826.444562:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827863680:0@lo:400:kworker.0 00000100:00100000:3.0:1784191826.444571:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191826.444671:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827863168 00000100:00100000:2.0:1784191826.444680:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827863168 00000100:00100000:2.0:1784191826.444743:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1784191826.444753:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827863168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191826.444849:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827863296:0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.451404:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191826.451481:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858827864192:0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.451541:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191826.451578:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784191826.451595:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827864704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784191826.451753:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191826.451811:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827863552 00000100:00100000:0.0:1784191826.451820:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827863552 00000100:00100000:0.0:1784191826.451873:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827864064 00000100:00100000:0.0:1784191826.451877:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827864064 00000100:00100000:0.0:1784191826.451890:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827864576 00000100:00100000:0.0:1784191826.451892:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827864576 00000100:00100000:0.0:1784191826.451929:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827864192 00000100:00100000:0.0:1784191826.451932:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827864192 00000100:00100000:0.0:1784191826.451948:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1784191826.451956:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827863552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.452025:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827863552:12345-0@lo:400:kworker.0 Request processed in 68us (7634us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191826.452033:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1784191826.452078:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827863552:0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.452100:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1784191826.452106:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827864064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.452140:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827864064:12345-0@lo:400:kworker.0 Request processed in 34us (7716us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191826.452147:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1784191826.452170:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827864064:0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.452205:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1784191826.452212:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827864576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.452248:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827864576:12345-0@lo:400:kworker.0 Request processed in 37us (7774us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191826.452264:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1784191826.452291:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827864576:0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.452309:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1784191826.452316:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858827864192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.452348:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858827864192:12345-0@lo:400:kworker.0 Request processed in 34us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191826.452353:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1784191826.452371:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858827864192:0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.452426:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827862912 00000100:00100000:0.0:1784191826.452430:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827862912 00000100:00100000:0.0:1784191826.452454:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827864704 00000100:00100000:0.0:1784191826.452456:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827864704 00000100:00100000:0.0:1784191826.452468:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784191826.452473:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827862912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784191826.452488:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8249024 pending 0 free 71184384 avail 64016384 00000100:00100000:0.0:1784191826.452521:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827862912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (7951us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191826.452527:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784191826.452537:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1784191826.452543:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827864704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784191826.452551:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8249024 pending 0 free 71184384 avail 64016384 00000100:00100000:0.0:1784191826.452577:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827864704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191826.452583:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1784191826.452624:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827864704:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784191826.452664:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784191826.452668:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784191826.452671:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784191826.453085:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827863040 00000100:00100000:0.0:1784191826.453091:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827863040 00000100:00100000:0.0:1784191826.453121:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1784191826.453127:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827863040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.453169:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827863040:12345-0@lo:400:kworker.0 Request processed in 42us (8853us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191826.453175:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1784191826.453200:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827863040:0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.453249:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827863680 00000100:00100000:0.0:1784191826.453253:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827863680 00000100:00100000:0.0:1784191826.453277:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1784191826.453283:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827863680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.453321:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827863680:12345-0@lo:400:kworker.0 Request processed in 38us (1927us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191826.453326:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1784191826.453356:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827863680:0@lo:400:kworker.0 00000100:00100000:3.0:1784191826.455720:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827862912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784191826.455740:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827863424:0@lo:400:kworker.0 00000100:00100000:3.0:1784191826.455819:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191826.455939:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827863936:0@lo:400:kworker.0 00000100:00100000:2.0:1784191826.456103:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827863168:12345-0@lo:400:kworker.0 Request processed in 11347us (11558us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191826.456116:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1784191826.456264:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191826.456283:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827863168:0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.456822:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827863424 00000100:00100000:0.0:1784191826.456832:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827863424 00000100:00100000:1.0:1784191826.456846:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827863808:0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.456880:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827863296 00000100:00100000:1.0:1784191826.456881:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191826.456885:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827863296 00000100:00100000:1.0:1784191826.456909:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858827864320:0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.456916:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827863808 00000100:00100000:0.0:1784191826.456920:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827863808 00000100:00100000:0.0:1784191826.456938:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784191826.457009:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191826.457521:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827863424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191826.457528:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1784191826.457546:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827863296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.457590:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827863424:12345-0@lo:400:kworker.0 Request processed in 74us (1771us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191826.457599:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784191826.457605:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827863296:12345-0@lo:400:kworker.0 Request processed in 61us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191826.457615:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784191826.457622:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784191826.457632:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827863808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.457661:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827863808:12345-0@lo:400:kworker.0 Request processed in 32us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191826.457667:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1784191826.457712:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784191826.457761:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827864320 00000100:00100000:1.0:1784191826.457767:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827864320 00000100:00100000:0.0:1784191826.457768:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827863296:0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.457796:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827863808:0@lo:400:kworker.0 00000100:00080000:1.0:1784191826.457800:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784191826.457840:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1784191826.457848:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858827864320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191826.457890:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858827864320:12345-0@lo:400:kworker.0 Request processed in 44us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191826.457897:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1784191826.457933:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858827864320:0@lo:400:kworker.0 00000100:00100000:3.0:1784191826.458019:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191826.458049:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858827864448:0@lo:400:kworker.0 00000100:00100000:3.0:1784191826.458092:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191826.458142:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827863424:0@lo:400:kworker.0 00000100:00100000:3.0:1784191826.458166:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827863936 00000100:00100000:3.0:1784191826.458169:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827863936 00000100:00100000:0.0:1784191826.458378:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827864448 00000100:00100000:0.0:1784191826.458382:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827864448 00000100:00100000:0.0:1784191826.458425:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1784191826.458431:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858827864448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191826.459441:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784191826.459453:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827863936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191826.459526:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827863936:12345-0@lo:400:kworker.0 Request processed in 76us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191826.459532:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784191826.460054:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827863936:0@lo:400:kworker.0 00000100:00080000:1.0:1784191826.460185:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784191826.461756:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858827864448:0@lo:400:kworker.0 00000100:00100000:0.0:1784191826.461829:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858827864448:12345-0@lo:400:kworker.0 Request processed in 3108us (3446us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191826.461842:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000001:00100000:3.0:1784191826.962574:0:160977:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8673fc11-fb8a-4aba-9612-ff2cd2a411bc 00000001:00100000:3.0:1784191826.962587:0:160977:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8c2c50be-ac0a-45d2-a88f-69ee938110a0 00000020:00000080:3.0:1784191826.962590:0:160977:0:(genops.c:906:class_export_put()) final put ffff8af104b60800/8c2c50be-ac0a-45d2-a88f-69ee938110a0 00000020:00000080:0.0:1784191826.962670:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8af104b60800/8c2c50be-ac0a-45d2-a88f-69ee938110a0 for lustre-OST0001 00000020:00000080:0.0:1784191826.962805:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af104b67000 for lustre-OST0001 00010000:00010000:1.0:1784191827.024003:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191827.856652:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191827.857057:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812320256 00000100:00100000:2.0:1784191827.857070:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812320256 00000100:00100000:2.0:1784191827.857201:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 359 00000100:00100000:2.0:1784191827.857212:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+11:122028:x1870858812320256:12345-192.168.204.16@tcp:101:touch.0 00010000:00010000:2.0:1784191827.857238:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191827.857259:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a3d0 lrc: 2/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b55f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.857379:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a3d7 lrc: 3/0,1 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.857407:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a3d7 lrc: 3/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.857422:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a3d7 lrc: 3/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.857439:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a3de lrc: 3/0,1 mode: --/PW res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.857446:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a3de lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.857453:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a3de lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191827.857852:0:158665:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x244:0x0], index 0: 0 00080000:00000400:2.0:1784191827.857866:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 253 < left 306, rollback = 2 00080000:00000400:2.0:1784191827.857870:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:2.0:1784191827.857872:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191827.857874:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 1/3/1 00080000:00000400:2.0:1784191827.857877:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/1, delete: 0/0/0 00080000:00000400:2.0:1784191827.857879:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191827.857902:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 253 < left 306, rollback = 2 00080000:00000400:2.0:1784191827.857905:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:2.0:1784191827.857907:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191827.857909:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 1/3/1 00080000:00000400:2.0:1784191827.857911:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/1, delete: 0/0/0 00080000:00000400:2.0:1784191827.857913:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191827.857923:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 253 < left 306, rollback = 2 00080000:00000400:2.0:1784191827.857925:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:2.0:1784191827.857927:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191827.857935:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 1/3/1 00080000:00000400:2.0:1784191827.857937:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/1, delete: 0/0/0 00080000:00000400:2.0:1784191827.857939:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191827.857953:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 253 < left 306, rollback = 2 00080000:00000400:2.0:1784191827.857956:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:2.0:1784191827.857957:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191827.857959:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 1/3/1 00080000:00000400:2.0:1784191827.857962:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/1, delete: 0/0/0 00080000:00000400:2.0:1784191827.857964:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191827.858218:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 251 < left 306, rollback = 2 00080000:00000400:2.0:1784191827.858222:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:2.0:1784191827.858224:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191827.858225:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 1/3/1 00080000:00000400:2.0:1784191827.858227:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/3, delete: 0/0/0 00080000:00000400:2.0:1784191827.858229:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191827.858333:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a3e5 lrc: 3/1,0 mode: --/PR res: [0x200003ab3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.858344:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a3e5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.858352:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a3e5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.858389:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a3d7 lrc: 4/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.858397:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a3d7 lrc: 4/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.858403:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a3d7 lrc: 3/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.858410:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a3d7 lrc: 4/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.858424:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191827.858429:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a3d7 lrc: 4/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.858451:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a3d7 lrc: 5/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.858465:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:2.0:1784191827.858467:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191827.858472:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a3d7 lrc: 3/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.858479:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a3d7 lrc: 0/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191827.858494:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000047c800e1 reply state 00000000f1eaf22e transno 34359738606 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a3de lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.858506:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a3de lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.858512:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0xc262d182 (ffff8af210e98800) 00010000:00010000:2.0:1784191827.858514:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191827.858517:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191827.862105:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a3d0 lrc: 0/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b55f expref: 14 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.862134:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a3e5 lrc: 3/0,0 mode: PR/PR res: [0x200003ab3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b55f expref: 13 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.862158:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x6:0x0].0x0 (ffff8af210e98000) 00010000:00010000:2.0:1784191827.862162:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191827.862165:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4a00, rc 0) 00000100:00100000:2.0:1784191827.862236:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+14:122028:x1870858812320256:12345-192.168.204.16@tcp:101:touch.0 Request processed in 5025us (5594us total) trans 34359738606 rc 0/0 00000100:00100000:2.0:1784191827.862244:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 359 00000100:00080000:0.0:1784191827.866683:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784191827.869681:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191827.869862:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812320512 00000100:00100000:1.0:1784191827.869873:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812320512 00000100:00100000:1.0:1784191827.869939:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 360 00000100:00100000:1.0:1784191827.869963:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+14:122028:x1870858812320512:12345-192.168.204.16@tcp:36:touch.0 00010000:00010000:1.0:1784191827.870028:0:158666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191827.870070:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a3e5 lrc: 0/0,0 mode: --/PR res: [0x200003ab3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b55f expref: 14 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191827.873732:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x6:0x0].0x0 (ffff8af210e98000) 00010000:00010000:1.0:1784191827.873767:0:158666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784191827.873840:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a3f3 lrc: 3/0,1 mode: --/PW res: [0x200003ab3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191827.873856:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a3f3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191827.873883:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a3f3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191827.874168:0:158666:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001556c41f reply state 00000000995de7d8 transno 34359738607 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a3f3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191827.874183:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a3f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191827.874189:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x6:0x0].0x0 (ffff8af20db3d500) 00010000:00010000:1.0:1784191827.874191:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191827.874194:0:158666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784191827.874359:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+15:122028:x1870858812320512:12345-192.168.204.16@tcp:36:touch.0 Request processed in 4405us (4682us total) trans 34359738607 rc 0/0 00000100:00100000:1.0:1784191827.874368:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 360 00000100:00100000:3.0:1784191827.878395:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191827.878528:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812320640 00000100:00100000:1.0:1784191827.878538:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812320640 00000100:00100000:1.0:1784191827.878604:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 361 00000100:00100000:1.0:1784191827.878615:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+15:122028:x1870858812320640:12345-192.168.204.16@tcp:101:touch.0 00010000:00010000:1.0:1784191827.878643:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191827.878712:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a3fa lrc: 2/0,0 mode: --/CR res: [0x200003ab3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b566 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191827.880556:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a3fa lrc: 3/0,0 mode: CR/CR res: [0x200003ab3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b566 expref: 16 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191827.880584:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a3fa lrc: 3/0,0 mode: CR/CR res: [0x200003ab3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b566 expref: 16 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191827.880626:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x6:0x0].0x0 (ffff8af20db3d500) 00010000:00010000:1.0:1784191827.880629:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784191827.880633:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e200, rc 0) 00000100:00100000:1.0:1784191827.880735:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+16:122028:x1870858812320640:12345-192.168.204.16@tcp:101:touch.0 Request processed in 2121us (2351us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191827.880744:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 361 00000100:00100000:1.0:1784191827.884214:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191827.886442:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812320768 00000100:00100000:2.0:1784191827.886458:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812320768 00000100:00100000:2.0:1784191827.886590:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 220 00000100:00080000:1.0:1784191827.886594:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784191827.886603:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:69112:x1870858812320768:12345-192.168.204.16@tcp:2:touch.0 00080000:02000000:2.0:1784191827.886780:0:162395:0:(osd_handler.c:3510:osd_attr_set()) *** cfs_fail_loc=1632, val=0*** 00080000:00000400:3.0:1784191827.892179:0:162395:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:3.0:1784191827.892187:0:162395:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:3.0:1784191827.892190:0:162395:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:3.0:1784191827.892193:0:162395:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/9/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191827.892195:0:162395:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:3.0:1784191827.892197:0:162395:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191827.892228:0:162395:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:3.0:1784191827.892230:0:162395:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:3.0:1784191827.892232:0:162395:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:3.0:1784191827.892234:0:162395:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/9/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191827.892237:0:162395:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:3.0:1784191827.892239:0:162395:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:3.0:1784191827.892391:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+7:69112:x1870858812320768:12345-192.168.204.16@tcp:2:touch.0 Request processed in 5785us (8181us total) trans 21474836533 rc 0/0 00000100:00100000:3.0:1784191827.892405:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 220 00000100:00100000:3.0:1784191827.904239:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191827.904316:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812321024 00000100:00100000:0.0:1784191827.904326:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812321024 00000100:00100000:0.0:1784191827.904387:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 97 00000100:00100000:0.0:1784191827.904398:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+16:122028:x1870858812321024:12345-192.168.204.16@tcp:35:touch.0 00000100:00100000:0.0:1784191827.904800:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+17:122028:x1870858812321024:12345-192.168.204.16@tcp:35:touch.0 Request processed in 402us (581us total) trans 34359738608 rc 0/0 00000100:00100000:0.0:1784191827.904810:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 97 00000100:00100000:0.0:1784191827.936020:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191827.936086:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812321280 00000100:00100000:2.0:1784191827.936097:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812321280 00000100:00100000:2.0:1784191827.936164:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 362 00000100:00100000:2.0:1784191827.936175:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+17:122029:x1870858812321280:12345-192.168.204.16@tcp:101:dd.0 00010000:00010000:2.0:1784191827.936203:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191827.936226:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a401 lrc: 2/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b56d expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.936524:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a408 lrc: 3/0,1 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.936542:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a408 lrc: 3/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.936555:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a408 lrc: 3/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.936582:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a40f lrc: 3/0,1 mode: --/PW res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.936590:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a40f lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.936598:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a40f lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191827.936969:0:158665:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x245:0x0], index 0: 0 00080000:00000400:2.0:1784191827.936986:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 306, rollback = 2 00080000:00000400:2.0:1784191827.936990:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191827.936993:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191827.936995:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191827.936996:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191827.936998:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191827.937020:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 306, rollback = 2 00080000:00000400:2.0:1784191827.937023:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191827.937025:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191827.937027:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191827.937029:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191827.937031:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191827.937040:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 306, rollback = 2 00080000:00000400:2.0:1784191827.937043:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191827.937044:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191827.937046:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191827.937049:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191827.937050:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191827.937060:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 306, rollback = 2 00080000:00000400:2.0:1784191827.937062:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191827.937071:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191827.937073:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191827.937075:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191827.937076:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191827.937119:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 306, rollback = 2 00080000:00000400:2.0:1784191827.937122:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191827.937124:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:2.0:1784191827.937126:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191827.937129:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191827.937131:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191827.938325:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4e00/0xfeec3c2dc5a4a416 lrc: 3/1,0 mode: --/PR res: [0x200003ab3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.938346:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4e00/0xfeec3c2dc5a4a416 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.938357:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4e00/0xfeec3c2dc5a4a416 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.938574:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a408 lrc: 4/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.938583:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a408 lrc: 4/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.938589:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a408 lrc: 3/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.938595:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a408 lrc: 4/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.938601:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191827.938605:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a408 lrc: 4/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.938619:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a408 lrc: 5/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.938632:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:2.0:1784191827.938634:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191827.938638:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a408 lrc: 3/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.938644:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a408 lrc: 0/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191827.938656:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000206d402e reply state 00000000106259ad transno 34359738609 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a40f lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.938889:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a40f lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.938896:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x617c8261 (ffff8af210e98b00) 00010000:00010000:2.0:1784191827.938900:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191827.938904:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191827.938952:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a401 lrc: 0/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b56d expref: 20 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.938968:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4e00/0xfeec3c2dc5a4a416 lrc: 3/0,0 mode: PR/PR res: [0x200003ab3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b56d expref: 19 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.938976:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x7:0x0].0x0 (ffff8af210e98700) 00010000:00010000:2.0:1784191827.938978:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191827.938980:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4e00, rc 0) 00000100:00100000:2.0:1784191827.939143:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+20:122029:x1870858812321280:12345-192.168.204.16@tcp:101:dd.0 Request processed in 2967us (3132us total) trans 34359738609 rc 0/0 00000100:00100000:2.0:1784191827.939151:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 362 00000100:00100000:3.0:1784191827.948545:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191827.948769:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812321408 00000100:00100000:1.0:1784191827.948780:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812321408 00000100:00100000:1.0:1784191827.948841:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 363 00000100:00100000:1.0:1784191827.948853:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+20:122029:x1870858812321408:12345-192.168.204.16@tcp:101:dd.0 00010000:00010000:1.0:1784191827.948882:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191827.948904:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4a424 lrc: 2/0,0 mode: --/PR res: [0x200003ab3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b574 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191827.948942:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4a42b lrc: 3/1,0 mode: --/PR res: [0x200003ab3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191827.948959:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4a42b lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191827.948974:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4a42b lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191827.949094:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4a424 lrc: 0/0,0 mode: --/PR res: [0x200003ab3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b574 expref: 22 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191827.949130:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4a42b lrc: 3/0,0 mode: PR/PR res: [0x200003ab3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b574 expref: 21 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191827.949138:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x7:0x0].0x0 (ffff8af210e98700) 00010000:00010000:1.0:1784191827.949142:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784191827.949144:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f600, rc 0) 00000100:00100000:1.0:1784191827.949211:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+21:122029:x1870858812321408:12345-192.168.204.16@tcp:101:dd.0 Request processed in 360us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191827.949219:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 363 00000100:00100000:0.0:1784191827.962071:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191827.962135:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812321536 00000100:00100000:2.0:1784191827.962149:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812321536 00000100:00100000:2.0:1784191827.962291:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 221 00000100:00100000:2.0:1784191827.962307:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+7:122029:x1870858812321536:12345-192.168.204.16@tcp:101:dd.0 00010000:00010000:2.0:1784191827.962326:0:160165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191827.962348:0:160165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4a432 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b57b expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191827.962474:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x245:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191827.962497:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x245:0x0].0x0 since=5448s v=(0 0) 00010000:00010000:2.0:1784191827.962502:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x245:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191827.962512:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4a432 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b57b expref: 8 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.962530:0:160165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4a432 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b57b expref: 8 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191827.962542:0:160165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5800, rc 0) 00000100:00100000:2.0:1784191827.962603:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+8:122029:x1870858812321536:12345-192.168.204.16@tcp:101:dd.0 Request processed in 299us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191827.962610:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 221 00000100:00100000:1.0:1784191827.989219:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191827.989314:0:160171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812321664 00000100:00100000:0.0:1784191827.989324:0:160171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812321664 00002000:00100000:0.0:1784191827.989379:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x245:0x0] (0->4095) req@ffff8af10f4eca80 x1870858812321664/t0(0) o4->8673fc11-fb8a-4aba-9612-ff2cd2a411bc@192.168.204.16@tcp:753/0 lens 4584/0 e 0 to 0 dl 1784191838 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191827.989391:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10f4eca80 with x1870858812321664 ext(0->4095) 00002000:00010000:0.0:1784191827.989397:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10f4eca80 00000100:00100000:0.0:1784191827.989435:0:160171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1 00000100:00100000:0.0:1784191827.989446:0:160171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+8:69112:x1870858812321664:12345-192.168.204.16@tcp:4:dd.0 00080000:00000400:0.0:1784191827.989671:0:160171:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191827.989675:0:160171:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191827.989678:0:160171:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191827.989681:0:160171:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191827.989683:0:160171:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191827.989685:0:160171:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191827.993316:0:160171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+10:69112:x1870858812321664:12345-192.168.204.16@tcp:4:dd.0 Request processed in 3857us (4093us total) trans 21474836534 rc 0/0 00000100:00100000:2.0:1784191827.993347:0:160171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1 00002000:00100000:2.0:1784191827.993361:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x245:0x0] (0->4095) req@ffff8af10f4eca80 x1870858812321664/t21474836534(0) o4->8673fc11-fb8a-4aba-9612-ff2cd2a411bc@192.168.204.16@tcp:753/0 lens 4584/448 e 0 to 0 dl 1784191838 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191827.993371:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10f4eca80 with x1870858812321664 ext(0->4095) 00002000:00010000:2.0:1784191827.993378:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10f4eca80 00000100:00100000:0.0:1784191828.009725:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191828.009780:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812321792 00000100:00100000:0.0:1784191828.009790:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812321792 00000100:00100000:0.0:1784191828.009848:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 364 00000100:00100000:0.0:1784191828.009866:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+21:122029:x1870858812321792:12345-192.168.204.16@tcp:44:dd.0 00000001:00080000:0.0:1784191828.011726:0:158645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738609 is committed 00000100:00100000:0.0:1784191828.012108:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+16:122029:x1870858812321792:12345-192.168.204.16@tcp:44:dd.0 Request processed in 2236us (2383us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191828.012119:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 364 00010000:00010000:1.0:1784191828.015189:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a3de lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015210:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a3de lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015218:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a3de lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015224:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191828.015230:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a3de lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015237:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a3de lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015256:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0xc262d182 (ffff8af210e98800) 00010000:00010000:1.0:1784191828.015259:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191828.015271:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a3de lrc: 2/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015278:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a3de lrc: 0/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015311:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a3f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015317:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a3f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015323:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a3f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015328:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191828.015331:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a3f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015338:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a3f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015347:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x6:0x0].0x0 (ffff8af20db3d500) 00010000:00010000:1.0:1784191828.015350:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191828.015354:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a3f3 lrc: 2/0,0 mode: --/TXN res: [0x200003ab3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015360:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a3f3 lrc: 0/0,0 mode: --/TXN res: [0x200003ab3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015374:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a40f lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015390:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a40f lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015397:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a40f lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015402:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191828.015404:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a40f lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015411:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a40f lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015421:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x617c8261 (ffff8af210e98b00) 00010000:00010000:1.0:1784191828.015424:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191828.015427:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a40f lrc: 2/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191828.015434:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a40f lrc: 0/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191828.016044:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191828.016306:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812321920 00000100:00100000:1.0:1784191828.016316:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812321920 00000100:00100000:1.0:1784191828.016376:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 222 00000100:00100000:1.0:1784191828.016388:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+10:69110:x1870858812321920:12345-192.168.204.16@tcp:16:dd.0 00000001:00080000:0.0:1784191828.021684:0:160160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836534 is committed 00000100:00100000:1.0:1784191828.022227:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+7:69110:x1870858812321920:12345-192.168.204.16@tcp:16:dd.0 Request processed in 5833us (6181us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191828.022240:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 222 00000100:00100000:1.0:1784191828.028618:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191828.028732:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812322176 00000100:00100000:3.0:1784191828.028743:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812322176 00000100:00100000:3.0:1784191828.028806:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 98 00000100:00100000:3.0:1784191828.028819:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1099f7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+13:122029:x1870858812322176:12345-192.168.204.16@tcp:35:dd.0 00000100:00100000:3.0:1784191828.029170:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1099f7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+14:122029:x1870858812322176:12345-192.168.204.16@tcp:35:dd.0 Request processed in 352us (561us total) trans 34359738610 rc 0/0 00000100:00100000:3.0:1784191828.029179:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 98 00010000:00010000:1.0:1784191828.044099:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191829.003909:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784191829.003934:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827864832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784191829.004349:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191829.004436:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827864832 00000100:00100000:3.0:1784191829.004444:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827864832 00000100:00100000:3.0:1784191829.004506:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1784191829.004516:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827864832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784191829.004566:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 21221056 pending 0 free 71045120 avail 63848448 00000100:00100000:3.0:1784191829.004615:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827864832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191829.004623:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1784191829.004900:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191829.005022:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827864832:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784191829.078369:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191829.518454:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784191829.518478:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827864960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784191829.518557:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191829.518600:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827864960 00000100:00100000:0.0:1784191829.518606:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827864960 00000100:00100000:0.0:1784191829.518652:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1784191829.518661:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827864960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784191829.518717:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42786816 avail 36655104 00000100:00100000:0.0:1784191829.518773:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827864960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191829.518780:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1784191829.518832:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827864960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784191829.518885:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191829.518908:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812322304 00000100:00100000:0.0:1784191829.518920:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812322304 00000100:00100000:0.0:1784191829.518970:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 26 00000100:00100000:0.0:1784191829.518977:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+7:121873:x1870858812322304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191829.518988:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:0.0:1784191829.519009:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x243:0x0] updating lvb size from disk: 0 -> 1 00002000:00010000:0.0:1784191829.519012:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x243:0x0] updating lvb mtime from disk: 0 -> 1784191825 00002000:00010000:0.0:1784191829.519015:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x243:0x0] updating lvb ctime from disk: 0 -> 1784191825 00002000:00010000:0.0:1784191829.519017:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x243:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784191829.519045:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000439dbac2/0xfeec3c2dc5a4a3c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b558 expref: 7 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191829.519078:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x245:0x0] updating lvb size from disk: 0 -> 1 00002000:00010000:0.0:1784191829.519080:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x245:0x0] updating lvb mtime from disk: 0 -> 1784191827 00002000:00010000:0.0:1784191829.519082:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x245:0x0] updating lvb ctime from disk: 0 -> 1784191827 00002000:00010000:0.0:1784191829.519084:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x245:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784191829.519091:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4a432 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b57b expref: 6 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191829.519104:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191829.519141:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:121873:x1870858812322304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 166us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191829.519149:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 26 00000100:00080000:0.0:1784191829.519167:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784191829.520840:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784191829.520858:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827865088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784191829.521070:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191829.521141:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827865088 00000100:00100000:0.0:1784191829.521148:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827865088 00000100:00100000:0.0:1784191829.521240:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1784191829.521249:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858827865088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784191829.521301:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42655744 avail 36524032 00000100:00100000:0.0:1784191829.521356:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858827865088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191829.521364:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1784191829.521590:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827865088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784191830.035130:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827865216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784191830.035209:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191830.035291:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827865216 00000100:00100000:0.0:1784191830.035300:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827865216 00000100:00100000:0.0:1784191830.035374:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784191830.035384:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827865216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784191830.035419:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 21221056 pending 0 free 71041024 avail 63873024 00000100:00100000:0.0:1784191830.035776:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827865216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 393us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191830.035784:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1784191830.035792:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827865216:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784191830.035810:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784191830.093195:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191830.356953:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191830.356991:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191830.357015:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191830.357047:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191830.357073:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191830.357107:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812322816 00000100:00100000:3.0:1784191830.357119:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812322816 00000100:00100000:3.0:1784191830.357174:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812322944 00000100:00100000:3.0:1784191830.357177:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812322944 00000100:00100000:3.0:1784191830.357216:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 133 00000100:00100000:3.0:1784191830.357227:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69109:x1870858812322816:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191830.357320:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69109:x1870858812322816:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 94us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191830.357329:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 133 00000100:00100000:3.0:1784191830.357346:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 134 00000100:00100000:3.0:1784191830.357352:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69109:x1870858812322944:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191830.357378:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69109:x1870858812322944:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 25us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191830.357400:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 134 00000100:00080000:3.0:1784191830.357420:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784191830.357685:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812322688 00000100:00100000:1.0:1784191830.357722:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812322688 00000100:00100000:1.0:1784191830.357765:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812322560 00000100:00100000:1.0:1784191830.357769:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812322560 00000100:00100000:1.0:1784191830.357794:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 270 00000100:00100000:1.0:1784191830.357802:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:69112:x1870858812322688:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191830.357842:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+6:69112:x1870858812322688:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 40us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191830.357848:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 270 00000100:00100000:1.0:1784191830.357865:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 271 00000100:00100000:1.0:1784191830.357872:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+14:69112:x1870858812322560:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191830.357904:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+14:69112:x1870858812322560:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 31us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191830.357909:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 271 00000100:00100000:1.0:1784191830.357929:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812322432 00000100:00100000:1.0:1784191830.357932:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812322432 00000100:00100000:1.0:1784191830.357955:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 223 00000100:00100000:1.0:1784191830.357960:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9e3b1f6-8cce-446b-b02a-9948a606da8b+10:69109:x1870858812322432:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191830.357983:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9e3b1f6-8cce-446b-b02a-9948a606da8b+10:69109:x1870858812322432:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 23us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191830.357996:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 223 00000100:00080000:3.0:1784191830.358226:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784191830.358230:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:0.0:1784191830.561145:0:159395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8673fc11-fb8a-4aba-9612-ff2cd2a411bc 00000001:00100000:0.0:1784191830.561160:0:159395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8c2c50be-ac0a-45d2-a88f-69ee938110a0 00000001:00080000:0.0:1784191830.561169:0:159395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474836525 is committed 00000020:00000080:0.0:1784191830.561175:0:159395:0:(genops.c:906:class_export_put()) final put ffff8af10c36b800/8c2c50be-ac0a-45d2-a88f-69ee938110a0 00000020:00000080:0.0:1784191830.561202:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10c36b800/8c2c50be-ac0a-45d2-a88f-69ee938110a0 for lustre-MDT0001 00000020:00000080:0.0:1784191830.561278:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af10c369800 for lustre-MDT0001 00000020:00000080:3.0:1784191830.624384:0:164678:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866e6 len=0 uarg=00007ffcff5c3d30 00000004:00000080:3.0:1784191830.624411:0:164678:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=c00866e6 len=608 karg=ffff8af10f5a6000 uarg=0000000000000000 00000004:00000080:3.0:1784191830.624825:0:164678:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb46d0fa3bd70 00100000:10000000:3.0:1784191830.624834:0:164678:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00100000:10000000:3.0:1784191830.625441:0:164678:0:(lfsck_layout.c:5404:lfsck_layout_reset()) lustre-MDT0000-osd: layout LFSCK reset: rc = 0 00100000:10000000:2.0:1784191830.630186:0:164680:0:(scrub.c:294:scrub_thread_prep()) lustre-MDT0000: OI scrub prep, flags = 0x46 00100000:10000000:2.0:1784191830.630195:0:164680:0:(scrub.c:116:scrub_file_reset()) lustre-MDT0000: reset OI scrub file, old flags = 0x0, add flags = 0x0 00100000:10000000:2.0:1784191830.630255:0:164680:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1784191830.630375:0:164679:0:(lfsck_lib.c:2526:lfsck_start_assistant()) lustre-MDT0000-osd: start lfsck_layout assistant thread 00100000:10000000:1.0:1784191830.631252:0:164679:0:(lfsck_layout.c:5635:lfsck_layout_master_prep()) lustre-MDT0000-osd: layout LFSCK master prep done, start pos [1] 00100000:10000000:2.0:1784191830.631487:0:164680:0:(osd_scrub.c:1263:osd_scrub_main()) lustre-MDT0000: OI scrub start, flags = 0x46, pos = 12 00100000:10000000:1.0:1784191830.632106:0:164679:0:(lfsck_layout.c:5454:lfsck_layout_master_checkpoint()) lustre-MDT0000-osd: layout LFSCK master checkpoint at the pos [13], status = 1: rc = 0 00100000:10000000:1.0:1784191830.632112:0:164679:0:(lfsck_engine.c:1034:lfsck_master_engine()) lustre-MDT0000-osd entry: oit_flags = 0x60000, dir_flags = 0x8006, oit_cookie = 13, dir_cookie = 0x0, parent = [0x0:0x0:0x0], pid = 164679 00100000:10000000:3.0:1784191830.638965:0:164681:0:(lfsck_engine.c:1551:lfsck_assistant_engine()) lustre-MDT0000-osd: lfsck_layout LFSCK assistant thread start 00000100:00100000:3.0:1784191830.639028:0:164681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc65880 pname:cluuid:pid:xid:nid:opc:job lfsck_layout:lustre-MDT0000-mdtlov_UUID:164681:1870858827865344:0@lo:1101:lfsck_layout.0 00000100:00100000:3.0:1784191830.639112:0:164681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191830.639166:0:164681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc66d80 pname:cluuid:pid:xid:nid:opc:job lfsck_layout:lustre-MDT0000-mdtlov_UUID:164681:1870858827865472:0@lo:1101:lfsck_layout.0 00000100:00100000:3.0:1784191830.639190:0:164681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191830.639226:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827865344 00000100:00100000:3.0:1784191830.639234:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827865344 00000100:00100000:3.0:1784191830.639288:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827865472 00000100:00100000:3.0:1784191830.639292:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827865472 00000100:00100000:3.0:1784191830.639324:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1784191830.639333:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1051f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:164681:x1870858827865344:12345-0@lo:1101:lfsck_layout.0 00100000:10000000:3.0:1784191830.639357:0:160166:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00100000:10000000:3.0:1784191830.639450:0:160166:0:(lfsck_layout.c:5404:lfsck_layout_reset()) lustre-OST0000-osd: layout LFSCK reset: rc = 0 00000100:00100000:3.0:1784191830.639523:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1784191830.639531:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:164681:x1870858827865472:12345-0@lo:1101:lfsck_layout.0 00100000:10000000:3.0:1784191830.639544:0:160163:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00100000:10000000:3.0:1784191830.639584:0:160163:0:(lfsck_layout.c:5404:lfsck_layout_reset()) lustre-OST0001-osd: layout LFSCK reset: rc = 0 00000100:00080000:3.0:1784191830.639621:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784191830.639776:0:164681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf07180 going to sleep for 11 seconds 00000100:00100000:1.0:1784191830.644986:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827865728:0@lo:1000:lfsck.0 00100000:10000000:2.0:1784191830.645037:0:164680:0:(scrub.c:368:scrub_thread_post()) lustre-MDT0000: OI scrub post with result = 1 00100000:10000000:2.0:1784191830.645078:0:164680:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1784191830.645081:0:164680:0:(osd_scrub.c:1303:osd_scrub_main()) lustre-MDT0000: OI scrub: stop, pos = 40001: rc = 1 00000100:00100000:1.0:1784191830.645402:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191830.645491:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784191830.645499:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827865600:0@lo:1000:lfsck.0 00000100:00100000:1.0:1784191830.645601:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191830.645721:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827865728 00000100:00100000:1.0:1784191830.645729:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827865728 00000100:00100000:1.0:1784191830.645773:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827865600 00000100:00100000:1.0:1784191830.645777:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827865600 00000100:00100000:1.0:1784191830.645798:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1784191830.645808:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:106500:x1870858827865728:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1784191830.645832:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1784191830.645840:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:106500:x1870858827865600:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1784191830.645901:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:106500:x1870858827865728:12345-0@lo:1000:lfsck.0 Request processed in 94us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191830.645908:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00100000:10000000:3.0:1784191830.646125:0:164679:0:(lfsck_engine.c:1053:lfsck_master_engine()) lustre-MDT0000-osd ffff8af10d4d27c0 exit: oit_flags = 0x60000, dir_flags = 0x8006, oit_cookie = 20075, dir_cookie = 0x0, parent = [0x0:0x0:0x0], pid = 164679: rc = 1 00100000:10000000:3.0:1784191830.646134:0:164679:0:(lfsck_lib.c:2594:lfsck_post_generic()) lustre-MDT0000-osd: waiting for assistant to do lfsck_layout post, rc = 1 00000100:00100000:0.0:1784191830.647871:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827865856:0@lo:1000:lfsck.0 00000100:00100000:0.0:1784191830.647948:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191830.647998:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784191830.648004:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827865984:0@lo:1000:lfsck.0 00000100:00100000:0.0:1784191830.648028:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:3.0:1784191830.648503:0:164684:0:(scrub.c:294:scrub_thread_prep()) lustre-OST0000: OI scrub prep, flags = 0x46 00100000:10000000:3.0:1784191830.648509:0:164684:0:(scrub.c:116:scrub_file_reset()) lustre-OST0000: reset OI scrub file, old flags = 0x0, add flags = 0x0 00100000:10000000:3.0:1784191830.648568:0:164684:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1784191830.648609:0:164685:0:(scrub.c:294:scrub_thread_prep()) lustre-OST0001: OI scrub prep, flags = 0x46 00100000:10000000:3.0:1784191830.648612:0:164685:0:(scrub.c:116:scrub_file_reset()) lustre-OST0001: reset OI scrub file, old flags = 0x0, add flags = 0x0 00100000:10000000:3.0:1784191830.648636:0:164685:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00000100:00100000:3.0:1784191830.648931:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827865856 00000100:00100000:3.0:1784191830.648940:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827865856 00000100:00100000:3.0:1784191830.648981:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827865984 00000100:00100000:3.0:1784191830.648984:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827865984 00000100:00100000:3.0:1784191830.648999:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1784191830.649007:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:106501:x1870858827865856:12345-0@lo:1000:lfsck.0 00000100:00100000:3.0:1784191830.649130:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:106501:x1870858827865856:12345-0@lo:1000:lfsck.0 Request processed in 123us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191830.649137:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1784191830.649159:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1784191830.649165:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:106501:x1870858827865984:12345-0@lo:1000:lfsck.0 00000100:00100000:3.0:1784191830.649207:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:106501:x1870858827865984:12345-0@lo:1000:lfsck.0 Request processed in 43us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191830.649213:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1784191830.649490:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827865984:0@lo:1000:lfsck.0 00000100:00100000:0.0:1784191830.649512:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827865856:0@lo:1000:lfsck.0 00100000:10000000:0.0:1784191830.649556:0:164682:0:(lfsck_layout.c:5600:lfsck_layout_slave_prep()) lustre-OST0000-osd: layout LFSCK slave prep done, start pos [1] 00100000:10000000:0.0:1784191830.649572:0:164683:0:(lfsck_layout.c:5600:lfsck_layout_slave_prep()) lustre-OST0001-osd: layout LFSCK slave prep done, start pos [1] 00100000:10000000:0.0:1784191830.649581:0:164684:0:(osd_scrub.c:1263:osd_scrub_main()) lustre-OST0000: OI scrub start, flags = 0x46, pos = 12 00100000:10000000:3.0:1784191830.650458:0:164685:0:(osd_scrub.c:1263:osd_scrub_main()) lustre-OST0001: OI scrub start, flags = 0x46, pos = 12 00000100:00100000:2.0:1784191830.654883:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:106500:x1870858827865600:12345-0@lo:1000:lfsck.0 Request processed in 9032us (9270us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191830.654899:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1784191830.657585:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827865600:0@lo:1000:lfsck.0 00000100:00100000:1.0:1784191830.657616:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827865728:0@lo:1000:lfsck.0 00100000:10000000:3.0:1784191830.658779:0:164685:0:(scrub.c:368:scrub_thread_post()) lustre-OST0001: OI scrub post with result = 1 00100000:10000000:3.0:1784191830.658823:0:164685:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1784191830.658826:0:164685:0:(osd_scrub.c:1303:osd_scrub_main()) lustre-OST0001: OI scrub: stop, pos = 25001: rc = 1 00100000:10000000:0.0:1784191830.660809:0:164684:0:(scrub.c:368:scrub_thread_post()) lustre-OST0000: OI scrub post with result = 1 00100000:10000000:0.0:1784191830.660851:0:164684:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1784191830.660854:0:164684:0:(osd_scrub.c:1303:osd_scrub_main()) lustre-OST0000: OI scrub: stop, pos = 25001: rc = 1 00100000:10000000:1.0:1784191830.665078:0:164682:0:(lfsck_layout.c:5489:lfsck_layout_slave_checkpoint()) lustre-OST0000-osd: layout LFSCK slave checkpoint at the pos [13], status = 1: rc = 0 00100000:10000000:1.0:1784191830.665090:0:164682:0:(lfsck_engine.c:1034:lfsck_master_engine()) lustre-OST0000-osd entry: oit_flags = 0x60003, dir_flags = 0x8006, oit_cookie = 13, dir_cookie = 0x0, parent = [0x0:0x0:0x0], pid = 164682 00100000:10000000:1.0:1784191830.665344:0:164682:0:(lfsck_engine.c:1053:lfsck_master_engine()) lustre-OST0000-osd ffff8af10f9d27c0 exit: oit_flags = 0x60003, dir_flags = 0x8006, oit_cookie = 451, dir_cookie = 0x0, parent = [0x0:0x0:0x0], pid = 164682: rc = 1 00100000:10000000:1.0:1784191830.665384:0:164682:0:(lfsck_layout.c:5105:lfsck_layout_slave_notify_master()) lustre-OST0000-osd: layout LFSCK slave notifies master 00000020:01000004:1.0:1784191830.665397:0:164682:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af10c3af800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784191830.665405:0:164682:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af10c3af800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784191830.665408:0:164682:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af10c3af800 3 00000100:00100000:1.0:1784191830.665448:0:164682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ef100 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-lwp-OST0000_UUID:164682:1870858827866112:0@lo:1101:lfsck.0 00100000:10000000:0.0:1784191830.666506:0:164683:0:(lfsck_layout.c:5489:lfsck_layout_slave_checkpoint()) lustre-OST0001-osd: layout LFSCK slave checkpoint at the pos [13], status = 1: rc = 0 00100000:10000000:0.0:1784191830.666514:0:164683:0:(lfsck_engine.c:1034:lfsck_master_engine()) lustre-OST0001-osd entry: oit_flags = 0x60003, dir_flags = 0x8006, oit_cookie = 13, dir_cookie = 0x0, parent = [0x0:0x0:0x0], pid = 164683 00100000:10000000:0.0:1784191830.666834:0:164683:0:(lfsck_engine.c:1053:lfsck_master_engine()) lustre-OST0001-osd ffff8af10f9d0000 exit: oit_flags = 0x60003, dir_flags = 0x8006, oit_cookie = 477, dir_cookie = 0x0, parent = [0x0:0x0:0x0], pid = 164683: rc = 1 00100000:10000000:0.0:1784191830.666855:0:164683:0:(lfsck_layout.c:5105:lfsck_layout_slave_notify_master()) lustre-OST0001-osd: layout LFSCK slave notifies master 00000020:01000004:0.0:1784191830.667220:0:164683:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af107838800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1784191830.667228:0:164683:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af107838800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1784191830.667230:0:164683:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af107838800 3 00000100:00100000:0.0:1784191830.667265:0:164683:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d634700 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-lwp-OST0001_UUID:164683:1870858827866240:0@lo:1101:lfsck.0 00000100:00100000:3.0:1784191830.668631:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1051f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:164681:x1870858827865344:12345-0@lo:1101:lfsck_layout.0 Request processed in 29291us (29511us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191830.668758:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1784191830.669011:0:164681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc65880 pname:cluuid:pid:xid:nid:opc:job lfsck_layout:lustre-MDT0000-mdtlov_UUID:164681:1870858827865344:0@lo:1101:lfsck_layout.0 00000100:00100000:1.0:1784191830.672098:0:164682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191830.672147:0:164682:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af109911840 going to sleep for 11 seconds 00000100:00100000:1.0:1784191830.675874:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827866112 00000100:00100000:1.0:1784191830.675888:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827866112 00000100:00100000:1.0:1784191830.675972:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1784191830.675981:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:164682:x1870858827866112:12345-0@lo:1101:lfsck.0 00100000:10000000:1.0:1784191830.676014:0:161504:0:(lfsck_layout.c:6680:lfsck_layout_master_in_notify()) lustre-MDT0000-osd: layout LFSCK master handles notify 3 from OST 0, status 1, flags 2, flags2 1 00000100:00100000:1.0:1784191830.676111:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:164682:x1870858827866112:12345-0@lo:1101:lfsck.0 Request processed in 130us (4017us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191830.676118:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1784191830.676173:0:164682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ef100 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-lwp-OST0000_UUID:164682:1870858827866112:0@lo:1101:lfsck.0 00100000:10000000:1.0:1784191830.676195:0:164682:0:(lfsck_layout.c:6257:lfsck_layout_slave_post()) lustre-OST0000-osd: layout LFSCK slave post done: rc = 0 00100000:10000000:1.0:1784191830.676207:0:164682:0:(lfsck_layout.c:6472:lfsck_layout_slave_double_scan()) lustre-OST0000-osd: layout LFSCK slave phase2 scan start 00000020:01000004:1.0:1784191830.676220:0:164682:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af10c3af800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784191830.676226:0:164682:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af10c3af800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784191830.676229:0:164682:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af10c3af800 3 00000100:00100000:1.0:1784191830.676256:0:164682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ef100 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-lwp-OST0000_UUID:164682:1870858827866368:0@lo:1102:lfsck.0 00000100:00100000:1.0:1784191830.676291:0:164682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191830.676320:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827866368 00000100:00100000:1.0:1784191830.676324:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827866368 00000100:00100000:1.0:1784191830.676347:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1784191830.676352:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:164682:x1870858827866368:12345-0@lo:1102:lfsck.0 00000100:00080000:3.0:1784191830.676394:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784191830.676406:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:164682:x1870858827866368:12345-0@lo:1102:lfsck.0 Request processed in 53us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191830.676412:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1784191830.676442:0:164682:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af109911840 going to sleep for 11 seconds 00000100:00100000:1.0:1784191830.676457:0:164682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ef100 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-lwp-OST0000_UUID:164682:1870858827866368:0@lo:1102:lfsck.0 00100000:10000000:1.0:1784191830.676886:0:164682:0:(lfsck_layout.c:5084:lfsck_layout_slave_query_master()) lustre-OST0000-osd: layout LFSCK slave queries master: rc = 0 00000100:00100000:0.0:1784191830.678277:0:164683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191830.678316:0:164683:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e738e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191830.678533:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827866240 00000100:00100000:1.0:1784191830.678542:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827866240 00000100:00100000:1.0:1784191830.678613:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1784191830.678622:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:164683:x1870858827866240:12345-0@lo:1101:lfsck.0 00100000:10000000:1.0:1784191830.678647:0:158665:0:(lfsck_layout.c:6680:lfsck_layout_master_in_notify()) lustre-MDT0000-osd: layout LFSCK master handles notify 3 from OST 1, status 1, flags 2, flags2 1 00000100:00100000:1.0:1784191830.678794:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:164683:x1870858827866240:12345-0@lo:1101:lfsck.0 Request processed in 173us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191830.678802:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00080000:0.0:1784191830.678877:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784191830.678907:0:164683:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d634700 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-lwp-OST0001_UUID:164683:1870858827866240:0@lo:1101:lfsck.0 00100000:10000000:0.0:1784191830.678924:0:164683:0:(lfsck_layout.c:6257:lfsck_layout_slave_post()) lustre-OST0001-osd: layout LFSCK slave post done: rc = 0 00100000:10000000:0.0:1784191830.678933:0:164683:0:(lfsck_layout.c:6472:lfsck_layout_slave_double_scan()) lustre-OST0001-osd: layout LFSCK slave phase2 scan start 00000020:01000004:0.0:1784191830.678943:0:164683:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af107838800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1784191830.678949:0:164683:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af107838800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1784191830.678952:0:164683:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af107838800 3 00000100:00100000:0.0:1784191830.678975:0:164683:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d634700 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-lwp-OST0001_UUID:164683:1870858827866496:0@lo:1102:lfsck.0 00000100:00100000:0.0:1784191830.679002:0:164683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191830.679027:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827866496 00000100:00100000:0.0:1784191830.679037:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827866496 00000100:00100000:0.0:1784191830.679066:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1784191830.679072:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:164683:x1870858827866496:12345-0@lo:1102:lfsck.0 00000100:00100000:0.0:1784191830.679107:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:164683:x1870858827866496:12345-0@lo:1102:lfsck.0 Request processed in 34us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191830.679113:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1784191830.679140:0:164683:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e738e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784191830.679154:0:164683:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d634700 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-lwp-OST0001_UUID:164683:1870858827866496:0@lo:1102:lfsck.0 00100000:10000000:0.0:1784191830.679163:0:164683:0:(lfsck_layout.c:5084:lfsck_layout_slave_query_master()) lustre-OST0001-osd: layout LFSCK slave queries master: rc = 0 00000100:00100000:2.0:1784191830.690201:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:164681:x1870858827865472:12345-0@lo:1101:lfsck_layout.0 Request processed in 50658us (50997us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191830.690220:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1784191830.690607:0:164681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc66d80 pname:cluuid:pid:xid:nid:opc:job lfsck_layout:lustre-MDT0000-mdtlov_UUID:164681:1870858827865472:0@lo:1101:lfsck_layout.0 00000100:00100000:0.0:1784191830.690618:0:164681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf07180 going to sleep for 0 seconds 00000100:00100000:0.0:1784191830.690956:0:164681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d634700 pname:cluuid:pid:xid:nid:opc:job lfsck_layout:lustre-MDT0000-mdtlov_UUID:164681:1870858827866624:0@lo:1000:lfsck_layout.0 00000100:00100000:0.0:1784191830.691012:0:164681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191830.691095:0:164681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e7389c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191830.691132:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827866624 00000100:00100000:1.0:1784191830.691933:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827866624 00000100:00100000:1.0:1784191830.692002:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1784191830.692011:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:164681:x1870858827866624:12345-0@lo:1000:lfsck_layout.0 00000100:00100000:1.0:1784191830.692119:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:164681:x1870858827866624:12345-0@lo:1000:lfsck_layout.0 Request processed in 108us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191830.692139:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1784191830.692222:0:164681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d634700 pname:cluuid:pid:xid:nid:opc:job lfsck_layout:lustre-MDT0000-mdtlov_UUID:164681:1870858827866624:0@lo:1000:lfsck_layout.0 00000100:00100000:0.0:1784191830.692313:0:164681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d634700 pname:cluuid:pid:xid:nid:opc:job lfsck_layout:lustre-MDT0000-mdtlov_UUID:164681:1870858827866752:0@lo:1000:lfsck_layout.0 00000100:00100000:0.0:1784191830.692344:0:164681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191830.692365:0:164681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf07180 going to sleep for 11 seconds 00000100:00100000:1.0:1784191830.692997:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827866752 00000100:00100000:1.0:1784191830.693003:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827866752 00000100:00100000:1.0:1784191830.693042:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1784191830.693049:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:164681:x1870858827866752:12345-0@lo:1000:lfsck_layout.0 00000100:00100000:1.0:1784191830.693120:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:164681:x1870858827866752:12345-0@lo:1000:lfsck_layout.0 Request processed in 71us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191830.693138:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1784191830.693209:0:164681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d634700 pname:cluuid:pid:xid:nid:opc:job lfsck_layout:lustre-MDT0000-mdtlov_UUID:164681:1870858827866752:0@lo:1000:lfsck_layout.0 00000100:00100000:0.0:1784191830.693271:0:164681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d634700 pname:cluuid:pid:xid:nid:opc:job lfsck_layout:lustre-MDT0000-mdtlov_UUID:164681:1870858827866880:0@lo:1000:lfsck_layout.0 00000100:00100000:0.0:1784191830.693300:0:164681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191830.693315:0:164681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf07480 going to sleep for 11 seconds 00000100:00100000:1.0:1784191830.694156:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827866880 00000100:00100000:1.0:1784191830.694163:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827866880 00000100:00100000:1.0:1784191830.694204:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1784191830.694211:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:164681:x1870858827866880:12345-0@lo:1000:lfsck_layout.0 00000100:00100000:1.0:1784191830.694321:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:164681:x1870858827866880:12345-0@lo:1000:lfsck_layout.0 Request processed in 110us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191830.694329:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1784191830.694473:0:164681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d634700 pname:cluuid:pid:xid:nid:opc:job lfsck_layout:lustre-MDT0000-mdtlov_UUID:164681:1870858827866880:0@lo:1000:lfsck_layout.0 00100000:10000000:2.0:1784191830.694561:0:164681:0:(lfsck_layout.c:4499:lfsck_layout_repair_encflag()) lustre-MDT0000-osd: layout LFSCK assistant repair of inconsistent file enc flag for: parent [0x200003ab3:0x6:0x0], child [0x280000401:0x244:0x0], OST-index 0, stripe-index 0: rc = 1 00000100:00100000:2.0:1784191830.694599:0:164681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4a80 pname:cluuid:pid:xid:nid:opc:job lfsck_layout:lustre-MDT0000-mdtlov_UUID:164681:1870858827867136:0@lo:1000:lfsck_layout.0 00000100:00100000:2.0:1784191830.694641:0:164681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191830.694663:0:164681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af21704e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191830.694721:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784191830.694739:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827867008:0@lo:1000:lfsck_layout.0 00000100:00100000:2.0:1784191830.694767:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191830.694876:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827867136 00000100:00100000:2.0:1784191830.694881:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827867136 00000100:00100000:2.0:1784191830.694909:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1784191830.694916:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:164681:x1870858827867136:12345-0@lo:1000:lfsck_layout.0 00000100:00100000:2.0:1784191830.694985:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:164681:x1870858827867136:12345-0@lo:1000:lfsck_layout.0 Request processed in 69us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191830.694992:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1784191830.695006:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827867008 00000100:00100000:2.0:1784191830.695009:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827867008 00000100:00100000:2.0:1784191830.695021:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1784191830.695026:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827867008:12345-0@lo:1000:lfsck_layout.0 00000100:00100000:2.0:1784191830.695167:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:106500:x1870858827867008:12345-0@lo:1000:lfsck_layout.0 Request processed in 140us (399us total) trans 21474836535 rc 0/0 00000100:00100000:2.0:1784191830.695175:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1784191830.695204:0:164681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4a80 pname:cluuid:pid:xid:nid:opc:job lfsck_layout:lustre-MDT0000-mdtlov_UUID:164681:1870858827867136:0@lo:1000:lfsck_layout.0 00100000:10000000:2.0:1784191830.695244:0:164681:0:(lfsck_layout.c:4499:lfsck_layout_repair_encflag()) lustre-MDT0000-osd: layout LFSCK assistant repair of inconsistent file enc flag for: parent [0x200003ab3:0x7:0x0], child [0x280000401:0x245:0x0], OST-index 0, stripe-index 0: rc = 1 00100000:10000000:2.0:1784191830.695256:0:164681:0:(lfsck_engine.c:1612:lfsck_assistant_engine()) lustre-MDT0000-osd: lfsck_layout LFSCK assistant thread post 00100000:10000000:2.0:1784191830.695277:0:164681:0:(lfsck_engine.c:1626:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant notified others for lfsck_layout post: rc = 0 00000100:00100000:2.0:1784191830.695290:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827867264:0@lo:1000:lfsck_layout.0 00000100:00100000:2.0:1784191830.695315:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191830.695353:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827867008:0@lo:1000:lfsck_layout.0 00000100:00100000:2.0:1784191830.695367:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827867264 00000100:00100000:2.0:1784191830.695370:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827867264 00000100:00100000:2.0:1784191830.695385:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1784191830.695391:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:106500:x1870858827867264:12345-0@lo:1000:lfsck_layout.0 00000100:00100000:2.0:1784191830.695463:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:106500:x1870858827867264:12345-0@lo:1000:lfsck_layout.0 Request processed in 71us (147us total) trans 21474836536 rc 0/0 00000100:00100000:2.0:1784191830.695470:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1784191830.695498:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827867264:0@lo:1000:lfsck_layout.0 00100000:10000000:1.0:1784191830.696106:0:164679:0:(lfsck_lib.c:2604:lfsck_post_generic()) lustre-MDT0000-osd: the assistant has done lfsck_layout post, rc = 1 00100000:10000000:1.0:1784191830.696151:0:164679:0:(lfsck_layout.c:6187:lfsck_layout_master_post()) lustre-MDT0000-osd: layout LFSCK master post done: rc = 0 00100000:10000000:1.0:1784191830.696165:0:164679:0:(lfsck_lib.c:2621:lfsck_double_scan_generic()) lustre-MDT0000-osd: waiting for assistant to do lfsck_layout double_scan, status 2 00100000:10000000:2.0:1784191830.702888:0:164681:0:(lfsck_engine.c:1644:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant sync before the second-stage scaning 00000004:00080000:2.0:1784191830.702938:0:164681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 5450882248046ns, next at 5420487679917ns, rc = 0 00080000:00080000:2.0:1784191830.702958:0:164681:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1784191830.702993:0:164681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 5450882303340ns, next at 5416918483924ns, rc = 0 00080000:00080000:2.0:1784191830.702997:0:164681:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00100000:10000000:1.0:1784191830.704015:0:164679:0:(lfsck_lib.c:2630:lfsck_double_scan_generic()) lustre-MDT0000-osd: the assistant has done lfsck_layout double_scan, status 0 00000004:00080000:2.0:1784191830.720608:0:158645:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 24 committed 00000004:00080000:2.0:1784191830.720636:0:158645:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 24 committed 00000001:00080000:2.0:1784191830.731505:0:158645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738610 is committed 00100000:10000000:2.0:1784191830.731539:0:164681:0:(lfsck_engine.c:1651:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant phase2 scan start, synced: rc = 0 00100000:10000000:2.0:1784191830.731557:0:164681:0:(lfsck_layout.c:4839:lfsck_layout_assistant_handler_p2()) lustre-MDT0000-osd: layout LFSCK phase2 scan start 00100000:10000000:2.0:1784191830.731560:0:164681:0:(lfsck_layout.c:4889:lfsck_layout_assistant_handler_p2()) lustre-MDT0000-osd: layout LFSCK phase2 scan stop: rc = 1 00000100:00100000:2.0:1784191830.731618:0:164681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4000 pname:cluuid:pid:xid:nid:opc:job lfsck_layout:lustre-MDT0000-mdtlov_UUID:164681:1870858827867392:0@lo:1101:lfsck_layout.0 00000100:00100000:2.0:1784191830.731719:0:164681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191830.731772:0:164681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_layout:lustre-MDT0000-mdtlov_UUID:164681:1870858827867520:0@lo:1101:lfsck_layout.0 00000100:00100000:2.0:1784191830.731795:0:164681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191830.731814:0:164681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af21704e900 going to sleep for 11 seconds 00000100:00100000:3.0:1784191830.736270:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827867392 00000100:00100000:3.0:1784191830.736283:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827867392 00000100:00100000:3.0:1784191830.736340:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827867520 00000100:00100000:3.0:1784191830.736343:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827867520 00000100:00100000:3.0:1784191830.736366:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1784191830.736375:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:164681:x1870858827867392:12345-0@lo:1101:lfsck_layout.0 00100000:10000000:3.0:1784191830.736405:0:162389:0:(lfsck_layout.c:6860:lfsck_layout_slave_in_notify()) lustre-OST0000-osd: layout LFSCK slave handle notify 4 from MDT 0, status 1 00000100:00100000:3.0:1784191830.736488:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:164681:x1870858827867392:12345-0@lo:1101:lfsck_layout.0 Request processed in 114us (4783us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191830.736495:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1784191830.736532:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1784191830.736539:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:164681:x1870858827867520:12345-0@lo:1101:lfsck_layout.0 00100000:10000000:3.0:1784191830.736550:0:162389:0:(lfsck_layout.c:6860:lfsck_layout_slave_in_notify()) lustre-OST0001-osd: layout LFSCK slave handle notify 4 from MDT 0, status 1 00000100:00100000:3.0:1784191830.736584:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:164681:x1870858827867520:12345-0@lo:1101:lfsck_layout.0 Request processed in 45us (4787us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191830.736591:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00100000:10000000:3.0:1784191830.736790:0:164683:0:(lfsck_layout.c:1503:lfsck_layout_double_scan_result()) lustre-OST0001-osd: layout LFSCK double scan: rc = 1 00100000:10000000:3.0:1784191830.736845:0:164683:0:(lfsck_layout.c:1544:lfsck_layout_double_scan_result()) lustre-OST0001-osd: layout LFSCK double scan result 3: rc = 0 00100000:10000000:3.0:1784191830.736849:0:164683:0:(lfsck_layout.c:5105:lfsck_layout_slave_notify_master()) lustre-OST0001-osd: layout LFSCK slave notifies master 00100000:10000000:3.0:1784191830.736868:0:164683:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00100000:10000000:3.0:1784191830.736870:0:164683:0:(lfsck_layout.c:6524:lfsck_layout_slave_double_scan()) lustre-OST0001-osd: layout LFSCK slave phase2 scan finished, status 3: rc = 0 00000100:00100000:2.0:1784191830.737184:0:164681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4000 pname:cluuid:pid:xid:nid:opc:job lfsck_layout:lustre-MDT0000-mdtlov_UUID:164681:1870858827867392:0@lo:1101:lfsck_layout.0 00000100:00100000:2.0:1784191830.737216:0:164681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job lfsck_layout:lustre-MDT0000-mdtlov_UUID:164681:1870858827867520:0@lo:1101:lfsck_layout.0 00000100:00100000:2.0:1784191830.737222:0:164681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af21704e900 going to sleep for 0 seconds 00100000:10000000:2.0:1784191830.737243:0:164681:0:(lfsck_engine.c:1760:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant sync before exit 00000004:00080000:2.0:1784191830.737283:0:164681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 5450916593174ns, next at 5420487679917ns, rc = 0 00080000:00080000:2.0:1784191830.737292:0:164681:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1784191830.737324:0:164681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 5450916634813ns, next at 5416918483924ns, rc = 0 00080000:00080000:2.0:1784191830.737329:0:164681:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00100000:10000000:2.0:1784191830.738578:0:164682:0:(lfsck_layout.c:1503:lfsck_layout_double_scan_result()) lustre-OST0000-osd: layout LFSCK double scan: rc = 1 00100000:10000000:2.0:1784191830.738630:0:164682:0:(lfsck_layout.c:1544:lfsck_layout_double_scan_result()) lustre-OST0000-osd: layout LFSCK double scan result 3: rc = 0 00100000:10000000:2.0:1784191830.738633:0:164682:0:(lfsck_layout.c:5105:lfsck_layout_slave_notify_master()) lustre-OST0000-osd: layout LFSCK slave notifies master 00100000:10000000:2.0:1784191830.738649:0:164682:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00100000:10000000:2.0:1784191830.738652:0:164682:0:(lfsck_layout.c:6524:lfsck_layout_slave_double_scan()) lustre-OST0000-osd: layout LFSCK slave phase2 scan finished, status 3: rc = 0 00000004:00080000:3.0:1784191830.739495:0:158645:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 25 committed 00000004:00080000:3.0:1784191830.739606:0:158645:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 25 committed 00100000:10000000:2.0:1784191830.740153:0:164681:0:(lfsck_engine.c:1766:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant synced before exit: rc = 0 00100000:10000000:2.0:1784191830.740158:0:164681:0:(lfsck_layout.c:1503:lfsck_layout_double_scan_result()) lustre-MDT0000-osd: layout LFSCK double scan: rc = 1 00100000:10000000:2.0:1784191830.740213:0:164681:0:(lfsck_layout.c:1544:lfsck_layout_double_scan_result()) lustre-MDT0000-osd: layout LFSCK double scan result 3: rc = 0 00100000:10000000:2.0:1784191830.740216:0:164681:0:(lfsck_engine.c:1778:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant phase2 scan finished: rc = 1 00100000:10000000:2.0:1784191830.740232:0:164681:0:(lfsck_engine.c:1790:lfsck_assistant_engine()) lustre-MDT0000-osd: lfsck_layout LFSCK assistant thread exit: rc = 1 00010000:00010000:1.0:1784191831.116170:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191831.564233:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784191831.564267:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827867648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191831.564338:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191831.564621:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827867648 00000100:00100000:2.0:1784191831.564630:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827867648 00000100:00100000:2.0:1784191831.564732:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1784191831.564745:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827867648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784191831.564780:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8249024 pending 0 free 71184384 avail 64016384 00000100:00100000:2.0:1784191831.564839:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827867648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191831.564846:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1784191831.564899:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827867648:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784191831.565052:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784191831.566031:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827867904:0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.566079:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191831.566109:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827868416:0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.566130:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191831.566144:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858827868928:0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.566167:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191831.566188:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784191831.566192:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827868032:0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.566213:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191831.566227:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827868544:0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.566329:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191831.566347:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858827869056:0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.566368:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191831.566399:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827868928 00000100:00100000:3.0:1784191831.566405:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827868928 00000100:00100000:3.0:1784191831.566598:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827869056 00000100:00100000:3.0:1784191831.566604:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827869056 00000100:00100000:3.0:1784191831.567373:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1784191831.567382:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858827868928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.568059:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858827868928:12345-0@lo:400:kworker.0 Request processed in 673us (1886us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191831.568069:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1784191831.568093:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1784191831.568100:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858827869056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.568140:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858827869056:12345-0@lo:400:kworker.0 Request processed in 41us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191831.568152:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:3.0:1784191831.568180:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191831.568197:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827868160:0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.568231:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191831.568427:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827867904 00000100:00100000:2.0:1784191831.568433:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827867904 00000100:00100000:2.0:1784191831.568478:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827868416 00000100:00100000:2.0:1784191831.568482:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827868416 00000100:00100000:2.0:1784191831.568511:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1784191831.568518:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827867904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191831.568556:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827867904:12345-0@lo:400:kworker.0 Request processed in 39us (2477us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191831.568562:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1784191831.568574:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1784191831.568579:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827868416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191831.568606:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827868416:12345-0@lo:400:kworker.0 Request processed in 26us (2475us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191831.568612:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1784191831.568750:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827868672:0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.568776:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191831.568791:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827869184:0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.568810:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191831.568830:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1784191831.568836:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827867776:0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.568860:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191831.568884:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827868288:0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.568905:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191831.568920:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858827868800:0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.568940:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191831.568954:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827869312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191831.568972:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191831.568999:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827869312 00000100:00100000:3.0:1784191831.569002:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827869312 00000100:00100000:3.0:1784191831.569033:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784191831.569038:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827869312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784191831.569055:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8249024 pending 0 free 71184384 avail 64016384 00000100:00100000:3.0:1784191831.569088:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827869312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191831.569104:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784191831.569121:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827868672 00000100:00100000:3.0:1784191831.569125:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827868672 00000100:00100000:3.0:1784191831.569141:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827869184 00000100:00100000:3.0:1784191831.569144:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827869184 00000100:00100000:3.0:1784191831.569164:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827868288 00000100:00100000:3.0:1784191831.569167:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827868288 00000100:00100000:3.0:1784191831.569176:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827868800 00000100:00100000:3.0:1784191831.569178:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827868800 00000100:00100000:3.0:1784191831.569190:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1784191831.569195:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af107905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827868672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.569227:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af107905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827868672:12345-0@lo:400:kworker.0 Request processed in 32us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191831.569233:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1784191831.569554:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1784191831.569563:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827869184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.569596:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827869184:12345-0@lo:400:kworker.0 Request processed in 35us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191831.569603:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1784191831.569616:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1784191831.569622:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827868288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.569648:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827868288:12345-0@lo:400:kworker.0 Request processed in 26us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191831.569653:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1784191831.569664:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1784191831.569670:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858827868800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.569739:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858827868800:12345-0@lo:400:kworker.0 Request processed in 69us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191831.569745:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:3.0:1784191831.569766:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191831.569798:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858827869056:0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.569811:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827867904:0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.569822:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827868416:0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.569834:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858827868928:0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.569877:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827868288:0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.569887:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858827868800:0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.569903:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827869312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191831.569913:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827868672:0@lo:400:kworker.0 00000100:00100000:3.0:1784191831.569922:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827869184:0@lo:400:kworker.0 00000100:00100000:2.0:1784191831.577461:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827868032 00000100:00100000:2.0:1784191831.577477:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827868032 00000100:00100000:2.0:1784191831.577549:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827868544 00000100:00100000:2.0:1784191831.577553:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827868544 00000100:00100000:2.0:1784191831.577583:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827868160 00000100:00100000:2.0:1784191831.577586:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827868160 00000100:00100000:2.0:1784191831.577611:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784191831.577623:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:106499:x1870858827868032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191831.577750:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:106499:x1870858827868032:12345-0@lo:400:kworker.0 Request processed in 129us (11535us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191831.577758:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784191831.577778:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1784191831.577785:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827868544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191831.577835:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827868544:12345-0@lo:400:kworker.0 Request processed in 51us (11507us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191831.577842:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1784191831.577854:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1784191831.577860:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af107904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827868160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191831.577896:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af107904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827868160:12345-0@lo:400:kworker.0 Request processed in 36us (9664us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191831.577904:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1784191831.577949:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784191831.577986:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827868032:0@lo:400:kworker.0 00000100:00100000:2.0:1784191831.577997:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827868544:0@lo:400:kworker.0 00000100:00100000:2.0:1784191831.578035:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827868160:0@lo:400:kworker.0 00000100:00100000:0.0:1784191831.580014:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827867776 00000100:00100000:0.0:1784191831.580027:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827867776 00000100:00100000:0.0:1784191831.580098:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1784191831.580119:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827867776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191831.580212:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827867776:12345-0@lo:400:kworker.0 Request processed in 94us (11350us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191831.580219:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1784191831.583664:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827867776:0@lo:400:kworker.0 00010000:00010000:1.0:1784191832.142204:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191833.163892:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191834.125062:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784191834.125103:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827869440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784191834.125176:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191834.125342:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827869440 00000100:00100000:2.0:1784191834.125350:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827869440 00000100:00100000:2.0:1784191834.125426:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1784191834.125438:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827869440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784191834.125471:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 21221056 pending 0 free 71041024 avail 63873024 00000100:00100000:2.0:1784191834.125524:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827869440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191834.125531:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1784191834.125594:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827869440:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784191834.125662:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784191834.188716:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191834.640727:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784191834.640763:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827869568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784191834.641014:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191834.641239:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827869568 00000100:00100000:1.0:1784191834.641249:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827869568 00000100:00100000:1.0:1784191834.641321:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1784191834.641334:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827869568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784191834.641395:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42786816 avail 36655104 00000100:00100000:1.0:1784191834.641473:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827869568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191834.641496:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1784191834.641919:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827869568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784191834.642534:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827869696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784191834.642608:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191834.642681:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827869696 00000100:00100000:1.0:1784191834.642718:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827869696 00000100:00100000:1.0:1784191834.642765:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1784191834.642774:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827869696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784191834.642813:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42655744 avail 36524032 00000100:00100000:1.0:1784191834.642878:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827869696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191834.642887:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1784191834.642929:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827869696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191835.152245:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827869824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784191835.152353:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191835.152680:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827869824 00000100:00100000:3.0:1784191835.152722:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827869824 00000100:00100000:3.0:1784191835.152820:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784191835.152851:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:106502:x1870858827869824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784191835.152883:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 21221056 pending 0 free 71041024 avail 63873024 00000100:00100000:3.0:1784191835.152972:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:106502:x1870858827869824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191835.152981:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1784191835.153039:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784191835.153160:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827869824:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784191835.212010:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191835.477764:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191835.477835:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812323072 00000100:00100000:1.0:1784191835.477847:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812323072 00000100:00100000:1.0:1784191835.477922:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 225 00000100:00100000:1.0:1784191835.477935:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9e3b1f6-8cce-446b-b02a-9948a606da8b+10:69111:x1870858812323072:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191835.478032:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9e3b1f6-8cce-446b-b02a-9948a606da8b+10:69111:x1870858812323072:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 99us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191835.478042:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 225 00000100:00100000:3.0:1784191835.478049:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191835.478189:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812323584 00000100:00100000:2.0:1784191835.478196:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812323584 00000100:00100000:2.0:1784191835.478312:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 138 00000100:00100000:1.0:1784191835.478321:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191835.478326:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69111:x1870858812323584:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191835.478355:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191835.478398:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69111:x1870858812323584:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 76us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191835.478414:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 138 00000100:00100000:2.0:1784191835.478460:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812323200 00000100:00100000:1.0:1784191835.478465:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191835.478466:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812323200 00000100:00100000:1.0:1784191835.478515:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812323328 00000100:00100000:1.0:1784191835.478518:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812323328 00000100:00100000:0.0:1784191835.478568:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812323456 00000100:00100000:0.0:1784191835.478572:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812323456 00000100:00080000:3.0:1784191835.478748:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784191835.478765:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784191835.478771:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784191835.478773:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784191835.479900:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 278 00000100:00100000:1.0:1784191835.479916:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69109:x1870858812323328:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191835.479999:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69109:x1870858812323328:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 88us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191835.480017:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 279 00000100:00100000:2.0:1784191835.480031:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+13:69111:x1870858812323200:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191835.480074:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+13:69111:x1870858812323200:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 46us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191835.480085:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 139 00000100:00100000:0.0:1784191835.480099:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69109:x1870858812323456:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191835.480134:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69109:x1870858812323456:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 42us (1670us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191835.480140:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 139 00000100:00100000:1.0:1784191835.480212:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 278 00000100:00100000:2.0:1784191835.480220:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 279 00010000:00010000:3.0:1784191836.246317:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191836.684238:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827869952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191836.684352:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191836.684479:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827869952 00000100:00100000:0.0:1784191836.684488:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827869952 00000100:00080000:3.0:1784191836.684533:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784191836.684604:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784191836.684617:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827869952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784191836.684656:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8249024 pending 0 free 71184384 avail 64016384 00000100:00100000:0.0:1784191836.684766:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827869952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 153us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191836.684775:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1784191836.685262:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827870208:0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.685337:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191836.685378:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827870720:0@lo:400:kworker.0 00000100:00100000:1.0:1784191836.685415:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827870208 00000100:00100000:1.0:1784191836.685421:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827870208 00000100:00100000:3.0:1784191836.685426:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191836.685443:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:106501:1870858827871232:0@lo:400:kworker.0 00000100:00100000:1.0:1784191836.685453:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827870720 00000100:00100000:1.0:1784191836.685456:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827870720 00000100:00100000:3.0:1784191836.685468:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191836.685476:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1784191836.685483:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827870208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.685489:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784191836.685493:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827870336:0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.685516:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191836.685521:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827870208:12345-0@lo:400:kworker.0 Request processed in 38us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191836.685528:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1784191836.685531:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827870848:0@lo:400:kworker.0 00000100:00100000:1.0:1784191836.685541:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1784191836.685546:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827870720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.685551:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191836.685569:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858827871360:0@lo:400:kworker.0 00000100:00100000:1.0:1784191836.685570:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827870720:12345-0@lo:400:kworker.0 Request processed in 25us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191836.685576:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1784191836.685617:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191836.685659:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827870208:0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.685669:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827870720:0@lo:400:kworker.0 00000100:00100000:0.0:1784191836.685715:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827871232 00000100:00100000:0.0:1784191836.685719:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827871232 00000100:00100000:3.0:1784191836.685730:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827870336 00000100:00100000:3.0:1784191836.685733:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827870336 00000100:00100000:3.0:1784191836.685762:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827870848 00000100:00100000:3.0:1784191836.685764:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827870848 00000100:00100000:0.0:1784191836.685768:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827871360 00000100:00100000:0.0:1784191836.685770:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827871360 00000100:00100000:3.0:1784191836.685785:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784191836.685790:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1784191836.685791:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:106501:x1870858827870336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191836.685802:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:106501:x1870858827871232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191836.685925:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1784191836.685932:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858827871360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191836.686033:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:106501:x1870858827871232:12345-0@lo:400:kworker.0 Request processed in 231us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191836.686040:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:0.0:1784191836.686060:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784191836.686064:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784191836.686066:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784191836.686133:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:106501:1870858827871232:0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.686794:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:106501:x1870858827870336:12345-0@lo:400:kworker.0 Request processed in 999us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191836.686803:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784191836.686824:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784191836.686834:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827870848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.686876:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827870848:12345-0@lo:400:kworker.0 Request processed in 45us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191836.686883:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1784191836.686889:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858827871360:12345-0@lo:400:kworker.0 Request processed in 958us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191836.686970:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827870080:0@lo:400:kworker.0 00000100:00100000:1.0:1784191836.686972:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1784191836.687017:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191836.687048:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827870080 00000100:00100000:1.0:1784191836.687055:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827870080 00000100:00100000:3.0:1784191836.687059:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:106500:1870858827870592:0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.687083:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191836.687106:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858827871104:0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.687128:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191836.687138:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1784191836.687144:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106500:x1870858827870080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.687147:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827871616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784191836.687176:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106500:x1870858827870080:12345-0@lo:400:kworker.0 Request processed in 32us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191836.687180:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191836.687183:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1784191836.687212:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827870080:0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.687231:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784191836.687238:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827870464:0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.687260:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191836.687287:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858827870976:0@lo:400:kworker.0 00000100:00100000:0.0:1784191836.687300:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827870464 00000100:00100000:0.0:1784191836.687305:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827870464 00000100:00100000:3.0:1784191836.687309:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191836.687332:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858827871488:0@lo:400:kworker.0 00000100:00100000:0.0:1784191836.687344:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784191836.687351:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827870464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.687353:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191836.687378:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827870592 00000100:00100000:3.0:1784191836.687382:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827870592 00000100:00100000:0.0:1784191836.687387:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827870464:12345-0@lo:400:kworker.0 Request processed in 37us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191836.687393:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1784191836.687405:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827871104 00000100:00080000:0.0:1784191836.687406:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784191836.687408:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827871104 00000100:00100000:3.0:1784191836.687425:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827870976 00000100:00100000:3.0:1784191836.687427:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827870976 00000100:00080000:0.0:1784191836.687430:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784191836.687438:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827871488 00000100:00100000:3.0:1784191836.687440:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827871488 00000100:00100000:3.0:1784191836.687467:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1784191836.687474:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106500:x1870858827870592:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784191836.687483:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191836.687505:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106500:x1870858827870592:12345-0@lo:400:kworker.0 Request processed in 32us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191836.687512:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1784191836.687518:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1784191836.687523:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1784191836.687526:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858827871104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.687528:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858827870976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.687553:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858827870976:12345-0@lo:400:kworker.0 Request processed in 24us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191836.687553:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858827871104:12345-0@lo:400:kworker.0 Request processed in 27us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191836.687560:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1784191836.687568:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1784191836.687573:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1784191836.687579:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858827871488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.687586:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827871616 00000100:00100000:3.0:1784191836.687590:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827871616 00000100:00100000:1.0:1784191836.687616:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858827871488:12345-0@lo:400:kworker.0 Request processed in 37us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191836.687622:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1784191836.687668:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784191836.687675:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827871616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784191836.687713:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8249024 pending 0 free 71184384 avail 64016384 00000100:00100000:3.0:1784191836.687745:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827871616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191836.687751:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784191836.688097:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827869952:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784191836.688137:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827870336:0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.688141:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827870464:0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.688151:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858827870976:0@lo:400:kworker.0 00000100:00100000:0.0:1784191836.688151:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827870848:0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.688160:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858827871488:0@lo:400:kworker.0 00000100:00100000:0.0:1784191836.688163:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858827871360:0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.688168:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:106500:1870858827870592:0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.688176:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858827871104:0@lo:400:kworker.0 00000100:00100000:3.0:1784191836.688188:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827871616:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1784191836.688665:0:160160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836536 is committed 00010000:00010000:1.0:1784191837.260608:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191838.302290:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191839.047896:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191839.048013:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812323712 00000100:00100000:2.0:1784191839.048029:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812323712 00000100:00100000:2.0:1784191839.048163:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 369 00000100:00100000:2.0:1784191839.048177:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+13:122596:x1870858812323712:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191839.048207:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191839.048236:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a439 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b582 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.048330:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a440 lrc: 3/1,0 mode: --/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.048348:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a440 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.048377:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a440 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191839.048442:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab3:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191839.048447:0:158666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191839.048495:0:158666:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a440 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.048528:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a439 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b582 expref: 15 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.048557:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a440 lrc: 3/0,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b582 expref: 14 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.048568:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:2.0:1784191839.048571:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191839.048576:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5800, rc 0) 00000100:00100000:2.0:1784191839.048656:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+14:122596:x1870858812323712:12345-192.168.204.16@tcp:101:rm.0 Request processed in 481us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191839.048664:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 369 00000100:00080000:0.0:1784191839.053603:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784191839.074306:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191839.074355:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812323968 00000100:00100000:3.0:1784191839.074367:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812323968 00000100:00100000:3.0:1784191839.074439:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 370 00000100:00100000:3.0:1784191839.074451:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+14:122596:x1870858812323968:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:3.0:1784191839.074480:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191839.074518:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a447 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b589 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191839.074685:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab3:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784191839.074952:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a447 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b589 expref: 16 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.074971:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191839.074975:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784191839.074981:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a447 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b589 expref: 16 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.075002:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7ce00, rc 0) 00000100:00100000:3.0:1784191839.075080:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+15:122596:x1870858812323968:12345-192.168.204.16@tcp:101:rm.0 Request processed in 631us (790us total) trans 34359738611 rc 301/301 00000100:00100000:3.0:1784191839.075089:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 370 00000100:00100000:0.0:1784191839.092952:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191839.093012:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812324096 00000100:00100000:0.0:1784191839.093041:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812324096 00000100:00100000:0.0:1784191839.093398:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 99 00000100:00100000:0.0:1784191839.093412:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+15:122596:x1870858812324096:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:3.0:1784191839.112135:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+15:122596:x1870858812324096:12345-192.168.204.16@tcp:37:rm.0 Request processed in 18711us (19181us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191839.112157:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 99 00000100:00100000:3.0:1784191839.117940:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191839.118114:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812324352 00000100:00100000:1.0:1784191839.118128:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812324352 00000100:00100000:1.0:1784191839.118210:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 100 00000100:00100000:1.0:1784191839.118223:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+15:122596:x1870858812324352:12345-192.168.204.16@tcp:35:rm.0 00000100:00100000:1.0:1784191839.118575:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+16:122596:x1870858812324352:12345-192.168.204.16@tcp:35:rm.0 Request processed in 354us (654us total) trans 34359738612 rc 0/0 00000100:00100000:1.0:1784191839.118605:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 100 00000100:00100000:1.0:1784191839.127167:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191839.131128:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812324608 00000100:00100000:2.0:1784191839.131152:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812324608 00000100:00100000:2.0:1784191839.131235:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 371 00000100:00100000:2.0:1784191839.131248:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+16:122596:x1870858812324608:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191839.131282:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191839.131314:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a455 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b590 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.131487:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a45c lrc: 3/1,0 mode: --/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.131506:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a45c lrc: 3/1,0 mode: CR/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.131521:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a45c lrc: 3/1,0 mode: CR/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191839.131535:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab3:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784191839.133030:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a455 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b590 expref: 19 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.133060:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a45c lrc: 3/0,0 mode: CR/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b590 expref: 18 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.133073:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:2.0:1784191839.133076:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784191839.133081:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4600, rc 0) 00000100:00100000:2.0:1784191839.133181:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+18:122596:x1870858812324608:12345-192.168.204.16@tcp:101:rm.0 Request processed in 1934us (6028us total) trans 34359738613 rc 0/0 00000100:00100000:2.0:1784191839.133191:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 371 00000100:00100000:0.0:1784191839.140595:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191839.140903:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812324736 00000100:00100000:1.0:1784191839.140918:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812324736 00000100:00100000:1.0:1784191839.141014:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 372 00000100:00100000:1.0:1784191839.141026:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+18:122596:x1870858812324736:12345-192.168.204.16@tcp:41:rm.0 00000004:00000024:1.0:1784191839.141106:0:161504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 142225408 avail 127889408 00000100:00100000:1.0:1784191839.141193:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+18:122596:x1870858812324736:12345-192.168.204.16@tcp:41:rm.0 Request processed in 169us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191839.141202:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 372 00000100:00100000:2.0:1784191839.152909:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191839.153608:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812324864 00000100:00100000:3.0:1784191839.153623:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812324864 00000100:00100000:3.0:1784191839.153727:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 373 00000100:00100000:3.0:1784191839.153741:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+18:122596:x1870858812324864:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:3.0:1784191839.153770:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191839.153800:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a46a lrc: 2/0,0 mode: --/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b597 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.153915:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a471 lrc: 3/1,0 mode: --/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.153933:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a471 lrc: 3/1,0 mode: CR/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.153945:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a471 lrc: 3/1,0 mode: CR/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.153961:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a478 lrc: 3/1,0 mode: --/PR res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.153969:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a478 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.153976:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a478 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154056:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a47f lrc: 3/1,0 mode: --/PR res: [0x200003ab3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154065:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a47f lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154072:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a47f lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191839.154124:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab3:0x6:0x0]: returning size 0 00000004:00200000:3.0:1784191839.154128:0:164531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784191839.154168:0:164531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a47f lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154192:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a47f lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154201:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a471 lrc: 3/1,0 mode: CR/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154208:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a471 lrc: 2/0,0 mode: CR/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154214:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a471 lrc: 3/0,0 mode: CR/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154221:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7c600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191839.154226:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a471 lrc: 3/0,0 mode: CR/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154234:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a471 lrc: 4/0,0 mode: CR/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154248:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:3.0:1784191839.154251:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191839.154255:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a471 lrc: 2/0,0 mode: --/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154262:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a471 lrc: 0/0,0 mode: --/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154279:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a478 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154284:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a478 lrc: 2/0,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154296:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a478 lrc: 3/0,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154301:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7d600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191839.154304:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a478 lrc: 3/0,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154310:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a478 lrc: 4/0,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154317:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0xc262d182 (ffff8af215ff6700) 00010000:00010000:3.0:1784191839.154319:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191839.154322:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a478 lrc: 2/0,0 mode: --/PR res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154328:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a478 lrc: 0/0,0 mode: --/PR res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154368:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a46a lrc: 0/0,0 mode: --/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b597 expref: 20 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154384:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a47f lrc: 3/0,0 mode: PR/PR res: [0x200003ab3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b597 expref: 19 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.154392:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x6:0x0].0x0 (ffff8af20db3d500) 00010000:00010000:3.0:1784191839.154394:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784191839.154397:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7c000, rc 0) 00000100:00100000:3.0:1784191839.154480:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+19:122596:x1870858812324864:12345-192.168.204.16@tcp:101:rm.0 Request processed in 741us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191839.154497:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 373 00000100:00100000:0.0:1784191839.170832:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191839.171576:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812325120 00000100:00100000:2.0:1784191839.171592:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812325120 00000100:00100000:2.0:1784191839.171685:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 374 00000100:00100000:2.0:1784191839.171735:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+19:122596:x1870858812325120:12345-192.168.204.16@tcp:36:rm.0 00010000:00010000:2.0:1784191839.171839:0:158666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784191839.171882:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a47f lrc: 0/0,0 mode: --/PR res: [0x200003ab3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b597 expref: 19 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.171919:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a3fa lrc: 0/0,0 mode: --/CR res: [0x200003ab3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b566 expref: 18 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.171933:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x6:0x0].0x0 (ffff8af20db3d500) 00010000:00010000:2.0:1784191839.171957:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a440 lrc: 0/0,0 mode: --/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b582 expref: 17 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.171967:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:2.0:1784191839.171971:0:158666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784191839.172000:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a486 lrc: 3/0,1 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172019:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a486 lrc: 3/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172032:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a486 lrc: 3/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172050:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a48d lrc: 3/0,1 mode: --/PW res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172058:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a48d lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172065:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a48d lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172169:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a494 lrc: 3/0,1 mode: --/EX res: [0x200003ab3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172177:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a494 lrc: 3/0,1 mode: EX/EX res: [0x200003ab3:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172184:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a494 lrc: 3/0,1 mode: EX/EX res: [0x200003ab3:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784191839.172520:0:158666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x20:0x0].42, 64 off10880 00000004:00080000:2.0:1784191839.172532:0:158666:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 5459351841908ns, next at 5460351839443ns, rc = 0 00010000:00010000:2.0:1784191839.172604:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a49b lrc: 3/0,1 mode: --/PW res: [0x200003ab3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172613:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a49b lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172623:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a49b lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172631:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a49b lrc: 4/0,1 mode: PW/PW res: [0x200003ab3:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172639:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a49b lrc: 4/0,1 mode: PW/PW res: [0x200003ab3:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172645:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a49b lrc: 3/0,0 mode: PW/PW res: [0x200003ab3:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172674:0:158666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191839.172733:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a494 lrc: 3/0,1 mode: EX/EX res: [0x200003ab3:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172748:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a494 lrc: 2/0,0 mode: EX/EX res: [0x200003ab3:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172755:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a494 lrc: 3/0,0 mode: EX/EX res: [0x200003ab3:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172761:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191839.172766:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a494 lrc: 3/0,0 mode: EX/EX res: [0x200003ab3:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172774:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a494 lrc: 4/0,0 mode: EX/EX res: [0x200003ab3:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172785:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x6:0x0].0x0 (ffff8af210e98000) 00010000:00010000:2.0:1784191839.172788:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784191839.172792:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a494 lrc: 2/0,0 mode: --/EX res: [0x200003ab3:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172799:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a494 lrc: 0/0,0 mode: --/EX res: [0x200003ab3:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172821:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a486 lrc: 4/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172827:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a486 lrc: 4/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172833:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a486 lrc: 3/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172838:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a486 lrc: 4/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172849:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191839.172851:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a486 lrc: 4/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172857:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a486 lrc: 5/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172864:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:2.0:1784191839.172866:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191839.172868:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a486 lrc: 3/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172874:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a486 lrc: 0/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191839.172883:0:158666:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000084529346 reply state 00000000984e53a4 transno 34359738614 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a48d lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172894:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a48d lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.172900:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0xc262d182 (ffff8af210e98d00) 00010000:00010000:2.0:1784191839.172902:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191839.172904:0:158666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784191839.173006:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+18:122596:x1870858812325120:12345-192.168.204.16@tcp:36:rm.0 Request processed in 1272us (2190us total) trans 34359738614 rc 0/0 00000100:00100000:2.0:1784191839.173014:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 374 00010000:00010000:3.0:1784191839.173951:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784191839.173962:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a49b lrc: 2/0,0 mode: PW/PW res: [0x200003ab3:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.173970:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4c00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191839.173975:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a49b lrc: 2/0,0 mode: PW/PW res: [0x200003ab3:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.173982:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a49b lrc: 3/0,0 mode: PW/PW res: [0x200003ab3:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.173996:0:160901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x6:0x0].0x0 (ffff8af210e98000) 00010000:00010000:3.0:1784191839.173999:0:160901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784191839.174002:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a49b lrc: 1/0,0 mode: --/PW res: [0x200003ab3:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.174008:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a49b lrc: 0/0,0 mode: --/PW res: [0x200003ab3:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.174026:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191839.174028:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191839.174029:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191839.184925:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191839.185105:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812325248 00000100:00100000:3.0:1784191839.185119:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812325248 00000100:00100000:3.0:1784191839.185204:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 375 00000100:00100000:3.0:1784191839.185216:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+18:122596:x1870858812325248:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:3.0:1784191839.185251:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191839.185280:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a4a2 lrc: 2/0,0 mode: --/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b59e expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.185403:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a4a9 lrc: 3/1,0 mode: --/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.185421:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a4a9 lrc: 3/1,0 mode: CR/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.185436:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a4a9 lrc: 3/1,0 mode: CR/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.185453:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a4b0 lrc: 3/1,0 mode: --/PR res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.185460:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a4b0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.185467:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a4b0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.185542:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a4b7 lrc: 3/1,0 mode: --/PR res: [0x200003ab3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.185561:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a4b7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.185568:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a4b7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191839.185627:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab3:0x4:0x0]: returning size 0 00000004:00200000:3.0:1784191839.185632:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784191839.185661:0:158667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a4b7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.185889:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a4b7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.185901:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a4a9 lrc: 3/1,0 mode: CR/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.185907:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a4a9 lrc: 2/0,0 mode: CR/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.185914:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a4a9 lrc: 3/0,0 mode: CR/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.185920:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7d600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191839.185924:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a4a9 lrc: 3/0,0 mode: CR/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.185933:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a4a9 lrc: 4/0,0 mode: CR/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.185948:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:3.0:1784191839.185951:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191839.185956:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a4a9 lrc: 2/0,0 mode: --/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.185962:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a4a9 lrc: 0/0,0 mode: --/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.185981:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a4b0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.185988:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a4b0 lrc: 2/0,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.186002:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a4b0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.186007:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7c600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191839.186010:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a4b0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.186017:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a4b0 lrc: 4/0,0 mode: PR/PR res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.186026:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x138b1e0d (ffff8af215ff6700) 00010000:00010000:3.0:1784191839.186029:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191839.186032:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a4b0 lrc: 2/0,0 mode: --/PR res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.186037:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4a4b0 lrc: 0/0,0 mode: --/PR res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.186072:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ce00/0xfeec3c2dc5a4a4a2 lrc: 0/0,0 mode: --/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b59e expref: 20 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.186087:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a4b7 lrc: 3/0,0 mode: PR/PR res: [0x200003ab3:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b59e expref: 19 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.186094:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x4:0x0].0x0 (ffff8af20db3d200) 00010000:00010000:3.0:1784191839.186096:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784191839.186099:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7dc00, rc 0) 00000100:00100000:3.0:1784191839.186222:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+19:122596:x1870858812325248:12345-192.168.204.16@tcp:101:rm.0 Request processed in 1007us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191839.186239:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 375 00000100:00100000:2.0:1784191839.196661:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191839.197161:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812325504 00000100:00100000:0.0:1784191839.197175:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812325504 00000100:00100000:0.0:1784191839.197260:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 376 00000100:00100000:0.0:1784191839.197273:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+19:122596:x1870858812325504:12345-192.168.204.16@tcp:36:rm.0 00010000:00010000:0.0:1784191839.197354:0:158665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784191839.197392:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a4b7 lrc: 0/0,0 mode: --/PR res: [0x200003ab3:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b59e expref: 19 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.197428:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a391 lrc: 0/0,0 mode: --/CR res: [0x200003ab3:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b543 expref: 18 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.197441:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x4:0x0].0x0 (ffff8af20db3d200) 00010000:00010000:0.0:1784191839.197455:0:158665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784191839.197614:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a4be lrc: 3/0,1 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.197634:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a4be lrc: 3/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.197646:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a4be lrc: 3/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.197664:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5000/0xfeec3c2dc5a4a4c5 lrc: 3/0,1 mode: --/PW res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.197873:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5000/0xfeec3c2dc5a4a4c5 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.197881:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5000/0xfeec3c2dc5a4a4c5 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.197959:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a4cc lrc: 3/0,1 mode: --/EX res: [0x200003ab3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.197967:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a4cc lrc: 3/0,1 mode: EX/EX res: [0x200003ab3:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.197973:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a4cc lrc: 3/0,1 mode: EX/EX res: [0x200003ab3:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784191839.198257:0:158665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x20:0x0].43, 64 off10944 00010000:00010000:0.0:1784191839.198320:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a4d3 lrc: 3/0,1 mode: --/PW res: [0x200003ab3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.198328:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a4d3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.198337:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a4d3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.198344:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a4d3 lrc: 4/0,1 mode: PW/PW res: [0x200003ab3:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.198352:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a4d3 lrc: 4/0,1 mode: PW/PW res: [0x200003ab3:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.198358:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a4d3 lrc: 3/0,0 mode: PW/PW res: [0x200003ab3:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.198396:0:158665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784191839.198422:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a4cc lrc: 3/0,1 mode: EX/EX res: [0x200003ab3:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.198429:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a4cc lrc: 2/0,0 mode: EX/EX res: [0x200003ab3:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.198436:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a4cc lrc: 3/0,0 mode: EX/EX res: [0x200003ab3:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.198442:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191839.198447:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a4cc lrc: 3/0,0 mode: EX/EX res: [0x200003ab3:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.198455:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a4cc lrc: 4/0,0 mode: EX/EX res: [0x200003ab3:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191839.199153:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191839.199163:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a4d3 lrc: 2/0,0 mode: PW/PW res: [0x200003ab3:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.199213:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x4:0x0].0x0 (ffff8af2331f1500) 00010000:00010000:0.0:1784191839.199218:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784191839.199224:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a4cc lrc: 2/0,0 mode: --/EX res: [0x200003ab3:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.199231:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a4cc lrc: 0/0,0 mode: --/EX res: [0x200003ab3:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.199261:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a4be lrc: 4/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.199267:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a4be lrc: 4/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.199273:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a4be lrc: 3/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.199291:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a4be lrc: 4/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.199297:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191839.199301:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a4be lrc: 4/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.199307:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a4be lrc: 5/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.199318:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:0.0:1784191839.199320:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191839.199323:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a4be lrc: 3/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.199328:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a4be lrc: 0/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191839.199340:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000298f1f54 reply state 000000008553c2f5 transno 34359738615 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5000/0xfeec3c2dc5a4a4c5 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.199354:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5000/0xfeec3c2dc5a4a4c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.199361:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x138b1e0d (ffff8af2331f1700) 00010000:00010000:0.0:1784191839.199363:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191839.199367:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784191839.199507:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+19:122596:x1870858812325504:12345-192.168.204.16@tcp:36:rm.0 Request processed in 2231us (2858us total) trans 34359738615 rc 0/0 00000100:00100000:0.0:1784191839.199517:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 376 00000100:00100000:0.0:1784191839.206430:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191839.206514:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812325760 00000100:00100000:2.0:1784191839.206558:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812325760 00000100:00100000:2.0:1784191839.206645:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 377 00000100:00100000:2.0:1784191839.206657:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+19:122596:x1870858812325760:12345-192.168.204.16@tcp:36:rm.0 00010000:00010000:2.0:1784191839.206752:0:161504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784191839.206800:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4a42b lrc: 0/0,0 mode: --/PR res: [0x200003ab3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b574 expref: 19 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.206827:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4e00/0xfeec3c2dc5a4a416 lrc: 0/0,0 mode: --/PR res: [0x200003ab3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b56d expref: 18 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.206840:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x7:0x0].0x0 (ffff8af210e98700) 00010000:00010000:2.0:1784191839.206853:0:161504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784191839.206879:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a4da lrc: 3/0,1 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.206895:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a4da lrc: 3/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.206906:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a4da lrc: 3/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.206921:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a4e1 lrc: 3/0,1 mode: --/PW res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.206929:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a4e1 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.206936:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a4e1 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.207025:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a4e8 lrc: 3/0,1 mode: --/EX res: [0x200003ab3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.207040:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a4e8 lrc: 3/0,1 mode: EX/EX res: [0x200003ab3:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.207047:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a4e8 lrc: 3/0,1 mode: EX/EX res: [0x200003ab3:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784191839.207308:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x20:0x0].44, 64 off11008 00010000:00010000:2.0:1784191839.207371:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a4ef lrc: 3/0,1 mode: --/PW res: [0x200003ab3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.207381:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a4ef lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.207389:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a4ef lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.207397:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a4ef lrc: 4/0,1 mode: PW/PW res: [0x200003ab3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.207404:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a4ef lrc: 4/0,1 mode: PW/PW res: [0x200003ab3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.207410:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a4ef lrc: 3/0,0 mode: PW/PW res: [0x200003ab3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191839.207954:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5200 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:1.0:1784191839.207964:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a4d3 lrc: 2/0,0 mode: PW/PW res: [0x200003ab3:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191839.207976:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a4d3 lrc: 3/0,0 mode: PW/PW res: [0x200003ab3:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191839.207990:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x4:0x0].0x0 (ffff8af2331f1500) 00010000:00010000:1.0:1784191839.207993:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784191839.207997:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a4d3 lrc: 1/0,0 mode: --/PW res: [0x200003ab3:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191839.208002:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a4d3 lrc: 0/0,0 mode: --/PW res: [0x200003ab3:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191839.208042:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191839.208047:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a4ef lrc: 4/0,0 mode: PW/PW res: [0x200003ab3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191839.208053:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4400 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:1.0:1784191839.208057:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a4ef lrc: 4/0,0 mode: PW/PW res: [0x200003ab3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191839.208064:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a4ef lrc: 5/0,0 mode: PW/PW res: [0x200003ab3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191839.208073:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x7:0x0].0x0 (ffff8af210e98200) 00010000:00010000:1.0:1784191839.208076:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784191839.208079:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a4ef lrc: 3/0,0 mode: --/PW res: [0x200003ab3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191839.208086:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191839.208088:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191839.208804:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191839.209161:0:161504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784191839.209174:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a4ef lrc: 0/0,0 mode: --/PW res: [0x200003ab3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.209304:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a4e8 lrc: 3/0,1 mode: EX/EX res: [0x200003ab3:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.209330:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a4e8 lrc: 2/0,0 mode: EX/EX res: [0x200003ab3:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.209339:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a4e8 lrc: 3/0,0 mode: EX/EX res: [0x200003ab3:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.209583:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191839.209593:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a4e8 lrc: 3/0,0 mode: EX/EX res: [0x200003ab3:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.209602:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a4e8 lrc: 4/0,0 mode: EX/EX res: [0x200003ab3:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.209661:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x7:0x0].0x0 (ffff8af210e98200) 00010000:00010000:2.0:1784191839.209664:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784191839.209669:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a4e8 lrc: 2/0,0 mode: --/EX res: [0x200003ab3:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.209676:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a4e8 lrc: 0/0,0 mode: --/EX res: [0x200003ab3:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.209725:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a4da lrc: 4/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.209732:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a4da lrc: 4/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.209739:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a4da lrc: 3/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.209744:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a4da lrc: 4/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.209757:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191839.209760:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a4da lrc: 4/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.209766:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a4da lrc: 5/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.209842:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:2.0:1784191839.209844:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191839.209847:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a4da lrc: 3/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.209854:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a4da lrc: 0/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191839.209870:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e217392 reply state 00000000c9dc15d8 transno 34359738616 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a4e1 lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.209884:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a4e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.209892:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x617c8261 (ffff8af210e98600) 00010000:00010000:2.0:1784191839.209894:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191839.209898:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784191839.210015:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+19:122596:x1870858812325760:12345-192.168.204.16@tcp:36:rm.0 Request processed in 3354us (3593us total) trans 34359738616 rc 0/0 00000100:00100000:2.0:1784191839.210026:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 377 00010000:00010000:1.0:1784191839.216855:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191839.217038:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191839.217240:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812326016 00000100:00100000:0.0:1784191839.217254:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812326016 00000100:00100000:0.0:1784191839.217327:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 378 00000100:00100000:0.0:1784191839.217351:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+19:122596:x1870858812326016:12345-192.168.204.16@tcp:36:rm.0 00010000:00010000:0.0:1784191839.217436:0:158667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784191839.217484:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a3c2 lrc: 0/0,0 mode: --/PR res: [0x200003ab3:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b551 expref: 19 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.217519:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a3ad lrc: 0/0,0 mode: --/PR res: [0x200003ab3:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b54a expref: 18 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.217532:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x5:0x0].0x0 (ffff8af210e98e00) 00010000:00010000:0.0:1784191839.217554:0:158667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784191839.217583:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a4f6 lrc: 3/0,1 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.217605:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a4f6 lrc: 3/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.217618:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a4f6 lrc: 3/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.217634:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a4fd lrc: 3/0,1 mode: --/PW res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.217641:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a4fd lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.217648:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a4fd lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.217785:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a504 lrc: 3/0,1 mode: --/EX res: [0x200003ab3:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.217799:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a504 lrc: 3/0,1 mode: EX/EX res: [0x200003ab3:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.217807:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a504 lrc: 3/0,1 mode: EX/EX res: [0x200003ab3:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784191839.218090:0:158667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x20:0x0].45, 64 off11072 00010000:00010000:0.0:1784191839.218145:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4a50b lrc: 3/0,1 mode: --/PW res: [0x200003ab3:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218154:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4a50b lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218163:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4a50b lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218172:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4a50b lrc: 4/0,1 mode: PW/PW res: [0x200003ab3:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218179:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4a50b lrc: 4/0,1 mode: PW/PW res: [0x200003ab3:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218186:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4a50b lrc: 3/0,0 mode: PW/PW res: [0x200003ab3:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218201:0:158667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784191839.218224:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a504 lrc: 3/0,1 mode: EX/EX res: [0x200003ab3:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218240:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a504 lrc: 2/0,0 mode: EX/EX res: [0x200003ab3:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218248:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a504 lrc: 3/0,0 mode: EX/EX res: [0x200003ab3:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218255:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191839.218260:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a504 lrc: 3/0,0 mode: EX/EX res: [0x200003ab3:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218268:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a504 lrc: 4/0,0 mode: EX/EX res: [0x200003ab3:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218277:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x5:0x0].0x0 (ffff8af2331f1200) 00010000:00010000:0.0:1784191839.218280:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784191839.218284:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a504 lrc: 2/0,0 mode: --/EX res: [0x200003ab3:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218291:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a504 lrc: 0/0,0 mode: --/EX res: [0x200003ab3:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218309:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a4f6 lrc: 3/0,1 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218315:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a4f6 lrc: 2/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218322:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a4f6 lrc: 3/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218327:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191839.218334:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a4f6 lrc: 3/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218341:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a4f6 lrc: 4/0,0 mode: CW/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218348:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:0.0:1784191839.218350:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191839.218352:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a4f6 lrc: 2/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218358:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a4f6 lrc: 0/0,0 mode: --/CW res: [0x200003ab3:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191839.218368:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ccac2365 reply state 0000000029216378 transno 34359738617 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a4fd lrc: 3/0,1 mode: PW/PW res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218381:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a4fd lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191839.218387:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0xcfba293b (ffff8af2331f1800) 00010000:00010000:0.0:1784191839.218390:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191839.218392:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784191839.218488:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+19:122596:x1870858812326016:12345-192.168.204.16@tcp:36:rm.0 Request processed in 1149us (1456us total) trans 34359738617 rc 0/0 00000100:00100000:0.0:1784191839.218497:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 378 00010000:00010000:3.0:1784191839.219136:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784191839.219147:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4a50b lrc: 2/0,0 mode: PW/PW res: [0x200003ab3:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.219155:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4200 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191839.219160:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4a50b lrc: 2/0,0 mode: PW/PW res: [0x200003ab3:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.219169:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4a50b lrc: 3/0,0 mode: PW/PW res: [0x200003ab3:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.219184:0:160901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x5:0x0].0x0 (ffff8af2331f1200) 00010000:00010000:3.0:1784191839.219187:0:160901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784191839.219191:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4a50b lrc: 1/0,0 mode: --/PW res: [0x200003ab3:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.219197:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4a50b lrc: 0/0,0 mode: --/PW res: [0x200003ab3:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191839.219216:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191839.219218:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191839.219220:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191839.223289:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191839.226727:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812326272 00000100:00100000:1.0:1784191839.226753:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812326272 00000100:00100000:1.0:1784191839.226843:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 101 00000100:00100000:1.0:1784191839.226858:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+19:122596:x1870858812326272:12345-192.168.204.16@tcp:35:rm.0 00000100:00100000:1.0:1784191839.227189:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+20:122596:x1870858812326272:12345-192.168.204.16@tcp:35:rm.0 Request processed in 334us (3913us total) trans 34359738618 rc 0/0 00000100:00100000:1.0:1784191839.227197:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 101 00000100:00100000:0.0:1784191839.234044:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191839.234187:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812326528 00000100:00100000:2.0:1784191839.234200:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812326528 00000100:00100000:2.0:1784191839.234306:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 379 00000100:00100000:2.0:1784191839.234336:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+20:122596:x1870858812326528:12345-192.168.204.16@tcp:36:rm.0 00010000:00010000:2.0:1784191839.234412:0:158665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784191839.234453:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a45c lrc: 0/0,0 mode: --/CR res: [0x200003ab3:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b590 expref: 20 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.234480:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a360 lrc: 0/0,0 mode: --/PR res: [0x200003ab3:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b535 expref: 19 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.234493:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98c00) 00010000:00010000:2.0:1784191839.234509:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5400/0xfeec3c2dc5a4a321 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b527 expref: 18 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.234517:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191839.234521:0:158665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784191839.234559:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a512 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.234575:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a512 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.234588:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a512 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.234603:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a519 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.234611:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a519 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.234618:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a519 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.234769:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a520 lrc: 3/0,1 mode: --/EX res: [0x200003ab3:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.234778:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a520 lrc: 3/0,1 mode: EX/EX res: [0x200003ab3:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.234786:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a520 lrc: 3/0,1 mode: EX/EX res: [0x200003ab3:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191839.235314:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab3:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784191839.235335:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a520 lrc: 3/0,1 mode: EX/EX res: [0x200003ab3:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.235343:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a520 lrc: 2/0,0 mode: EX/EX res: [0x200003ab3:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.235351:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a520 lrc: 3/0,0 mode: EX/EX res: [0x200003ab3:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.235359:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191839.235364:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a520 lrc: 3/0,0 mode: EX/EX res: [0x200003ab3:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.235372:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a520 lrc: 4/0,0 mode: EX/EX res: [0x200003ab3:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.235382:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x0 (ffff8af210e98700) 00010000:00010000:2.0:1784191839.235421:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784191839.235425:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a520 lrc: 2/0,0 mode: --/EX res: [0x200003ab3:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.235444:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a520 lrc: 0/0,0 mode: --/EX res: [0x200003ab3:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.235467:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a512 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.235474:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a512 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.235480:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a512 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.235486:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a512 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.235490:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191839.235493:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a512 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.235499:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a512 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.235507:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191839.235510:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191839.235512:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a512 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.235520:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a512 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191839.235528:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000645cf327 reply state 000000005a962aa8 transno 34359738619 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a519 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.235557:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a519 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.235565:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfabfbe3f (ffff8af210e98200) 00010000:00010000:2.0:1784191839.235568:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191839.235570:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784191839.235759:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+19:122596:x1870858812326528:12345-192.168.204.16@tcp:36:rm.0 Request processed in 1422us (1725us total) trans 34359738619 rc 0/0 00000100:00100000:2.0:1784191839.235768:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 379 00000100:00100000:0.0:1784191839.243947:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827871744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784191839.244058:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191839.244187:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827871744 00000100:00100000:1.0:1784191839.244197:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827871744 00000100:00100000:1.0:1784191839.244301:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784191839.244314:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1099f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827871744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784191839.244365:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 21221056 pending 0 free 71041024 avail 63873024 00000100:00100000:1.0:1784191839.244428:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1099f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827871744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191839.244438:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1784191839.244586:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784191839.244958:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827871744:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784191839.308520:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191839.653965:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191839.656396:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812326656 00000100:00100000:2.0:1784191839.656414:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812326656 00000100:00100000:2.0:1784191839.656523:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 380 00000100:00100000:2.0:1784191839.656547:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+19:122612:x1870858812326656:12345-192.168.204.16@tcp:101:lsof.0 00010000:00010000:2.0:1784191839.656583:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191839.656629:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a527 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b5a5 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.657068:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a52e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.657087:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a52e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.657100:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a52e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191839.657157:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191839.657177:0:161504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191839.657206:0:161504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a52e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.657236:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a527 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5a5 expref: 21 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.657258:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a52e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5a5 expref: 20 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191839.657268:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191839.657272:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191839.657275:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4400, rc 0) 00000100:00100000:2.0:1784191839.657425:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+20:122612:x1870858812326656:12345-192.168.204.16@tcp:101:lsof.0 Request processed in 891us (3475us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191839.657434:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 380 00000100:00100000:3.0:1784191839.756782:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827871872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784191839.756899:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191839.757115:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827871872 00000100:00100000:2.0:1784191839.757125:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827871872 00000100:00100000:2.0:1784191839.757201:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1784191839.757212:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858827871872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784191839.757264:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42655744 avail 36524032 00000100:00100000:2.0:1784191839.757348:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858827871872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191839.757356:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1784191839.757632:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827871872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784191839.758749:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784191839.758771:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827872000:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784191839.758848:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191839.759026:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827872000 00000100:00100000:1.0:1784191839.759034:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827872000 00000100:00100000:1.0:1784191839.759090:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1784191839.759100:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827872000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784191839.759136:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42786816 avail 36655104 00000100:00100000:1.0:1784191839.759200:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827872000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191839.759208:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1784191839.759415:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827872000:0@lo:41:osp-pre-1-0.0 00000004:00080000:1.0:1784191840.271228:0:158690:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 5460450536489ns, next at 5461450533856ns, rc = 0 00000100:00100000:0.0:1784191840.271452:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827872128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784191840.271538:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191840.275372:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827872128 00000100:00100000:3.0:1784191840.275388:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827872128 00000100:00100000:3.0:1784191840.275484:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784191840.275499:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827872128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784191840.275541:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 21221056 pending 0 free 71041024 avail 63873024 00000100:00100000:3.0:1784191840.275648:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827872128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (4120us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191840.275656:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784191840.275771:0:106500:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836536 gen 2 00000100:00100000:1.0:1784191840.275801:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827872128:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784191840.275990:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784191840.331980:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191840.605761:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191840.605815:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191840.605859:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191840.605894:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812326784 00000100:00100000:3.0:1784191840.605895:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191840.605910:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812326784 00000100:00100000:3.0:1784191840.605934:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191840.605988:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 227 00000100:00100000:1.0:1784191840.605999:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9e3b1f6-8cce-446b-b02a-9948a606da8b+10:69112:x1870858812326784:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191840.606120:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812327296 00000100:00100000:2.0:1784191840.606126:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812327168 00000100:00100000:0.0:1784191840.606127:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812327296 00000100:00100000:2.0:1784191840.606138:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812327168 00000100:00100000:0.0:1784191840.606205:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 143 00000100:00100000:0.0:1784191840.606217:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69112:x1870858812327296:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191840.606296:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812326912 00000100:00100000:3.0:1784191840.606302:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812326912 00000100:00100000:3.0:1784191840.606337:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812327040 00000100:00100000:3.0:1784191840.606340:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812327040 00000100:00100000:3.0:1784191840.606370:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 286 00000100:00100000:3.0:1784191840.606381:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+20:69109:x1870858812326912:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191840.615014:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9e3b1f6-8cce-446b-b02a-9948a606da8b+10:69112:x1870858812326784:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 9003us (9255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191840.615032:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 227 00000100:00100000:1.0:1784191840.616665:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 287 00000100:00100000:1.0:1784191840.616901:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69109:x1870858812327040:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191840.616976:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69109:x1870858812327040:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 287us (11042us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191840.616983:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 287 00000100:00080000:1.0:1784191840.617050:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784191840.617056:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784191840.617059:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784191840.617206:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69112:x1870858812327296:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 10990us (11388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191840.622656:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+20:69109:x1870858812326912:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 16259us (16745us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191840.622676:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 286 00000100:00100000:2.0:1784191840.629105:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 144 00000100:00100000:2.0:1784191840.629196:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69112:x1870858812327168:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191840.629373:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69112:x1870858812327168:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 249us (23513us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191840.629384:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 144 00000100:00100000:0.0:1784191840.630172:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 143 00010000:00010000:3.0:1784191841.356373:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191841.803998:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827872512:0@lo:400:kworker.0 00000100:00100000:3.0:1784191841.804088:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191841.804702:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827872256:0@lo:400:kworker.0 00000100:00100000:0.0:1784191841.804752:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191841.805193:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827872384:0@lo:400:kworker.0 00000100:00100000:2.0:1784191841.805224:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191841.805267:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827872896:0@lo:400:kworker.0 00000100:00100000:2.0:1784191841.805285:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191841.805299:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858827873408:0@lo:400:kworker.0 00000100:00100000:2.0:1784191841.805318:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191841.805331:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827873920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784191841.805349:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191841.805382:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827872384 00000100:00100000:2.0:1784191841.805388:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827872384 00000100:00100000:1.0:1784191841.810114:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827872640:0@lo:400:kworker.0 00000100:00100000:1.0:1784191841.810335:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827873920 00000100:00100000:1.0:1784191841.810342:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827873920 00000100:00100000:1.0:1784191841.810406:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784191841.810414:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827873920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784191841.810444:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8249024 pending 0 free 71184384 avail 64016384 00000100:00100000:1.0:1784191841.810508:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827873920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (5146us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191841.810516:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784191841.810548:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827873408 00000100:00100000:1.0:1784191841.810552:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827873408 00000100:00100000:1.0:1784191841.810578:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1784191841.810584:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858827873408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191841.810616:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858827873408:12345-0@lo:400:kworker.0 Request processed in 32us (5297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191841.810623:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:1.0:1784191841.810637:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784191841.810641:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784191841.816605:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191841.816650:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827873152:0@lo:400:kworker.0 00000100:00100000:3.0:1784191841.816726:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191841.816747:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858827873664:0@lo:400:kworker.0 00000100:00100000:3.0:1784191841.816773:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191841.816858:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784191841.816867:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827874048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784191841.816893:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191841.816931:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827873664 00000100:00100000:3.0:1784191841.816939:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827873664 00000100:00100000:3.0:1784191841.817002:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1784191841.817012:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858827873664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191841.817069:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858827873664:12345-0@lo:400:kworker.0 Request processed in 58us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191841.817077:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1784191841.817103:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827874048 00000100:00100000:3.0:1784191841.817107:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827874048 00000100:00100000:3.0:1784191841.817134:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784191841.817140:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827874048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784191841.817171:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8249024 pending 0 free 71184384 avail 64016384 00000100:00100000:3.0:1784191841.817206:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827874048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191841.817212:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784191841.817255:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827874048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784191841.817268:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858827873664:0@lo:400:kworker.0 00000100:00080000:3.0:1784191841.817308:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784191841.817312:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784191841.817326:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827873024:0@lo:400:kworker.0 00000100:00100000:3.0:1784191841.817352:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191841.817375:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858827873536:0@lo:400:kworker.0 00000100:00100000:3.0:1784191841.817410:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191841.817436:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827873536 00000100:00100000:3.0:1784191841.817440:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827873536 00000100:00080000:3.0:1784191841.817455:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191841.817482:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1784191841.817489:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858827873536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191841.817533:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858827873536:12345-0@lo:400:kworker.0 Request processed in 44us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191841.817540:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1784191841.817564:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858827873536:0@lo:400:kworker.0 00000100:00100000:0.0:1784191841.817706:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827872512 00000100:00100000:0.0:1784191841.817712:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827872512 00000100:00100000:0.0:1784191841.817743:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827872640 00000100:00100000:3.0:1784191841.817744:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858827873408:0@lo:400:kworker.0 00000100:00100000:0.0:1784191841.817746:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827872640 00000100:00100000:0.0:1784191841.817768:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827873152 00000100:00100000:3.0:1784191841.817770:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827873920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784191841.817772:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827873152 00000100:00100000:0.0:1784191841.817792:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827873024 00000100:00100000:0.0:1784191841.817795:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827873024 00000100:00100000:0.0:1784191841.817826:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1784191841.817835:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784191841.817836:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827872512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191841.817848:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827872640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191841.817882:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827872512:12345-0@lo:400:kworker.0 Request processed in 49us (13794us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191841.817889:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1784191841.817902:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827872640:12345-0@lo:400:kworker.0 Request processed in 56us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191841.817911:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1784191841.818511:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827872896 00000100:00100000:1.0:1784191841.818516:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827872896 00000100:00100000:0.0:1784191841.818616:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784191841.818626:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827873152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191841.818668:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827873152:12345-0@lo:400:kworker.0 Request processed in 45us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191841.818674:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784191841.818687:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784191841.818709:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827873024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191841.819159:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827873024:12345-0@lo:400:kworker.0 Request processed in 450us (1805us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191841.819166:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1784191841.819191:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191841.819216:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827872768:0@lo:400:kworker.0 00000100:00100000:0.0:1784191841.819249:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191841.819274:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827872768 00000100:00100000:0.0:1784191841.819278:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827872768 00000100:00100000:0.0:1784191841.819305:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1784191841.819311:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827872768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191841.819338:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827872768:12345-0@lo:400:kworker.0 Request processed in 27us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191841.819343:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1784191841.819371:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827872768:0@lo:400:kworker.0 00000100:00100000:0.0:1784191841.819378:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827873280:0@lo:400:kworker.0 00000100:00100000:0.0:1784191841.819468:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191841.819486:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827873792:0@lo:400:kworker.0 00000100:00100000:0.0:1784191841.819519:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191841.819632:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827873280 00000100:00100000:0.0:1784191841.819636:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827873280 00000100:00100000:0.0:1784191841.819658:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827873792 00000100:00100000:0.0:1784191841.819660:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827873792 00000100:00100000:0.0:1784191841.819678:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1784191841.819683:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827873280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191841.819923:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827873280:12345-0@lo:400:kworker.0 Request processed in 239us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191841.819930:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1784191841.819942:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1784191841.819999:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827873792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191841.820027:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827873792:12345-0@lo:400:kworker.0 Request processed in 80us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191841.820032:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:0.0:1784191841.820048:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784191841.820066:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827873280:0@lo:400:kworker.0 00000100:00100000:0.0:1784191841.820074:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827873792:0@lo:400:kworker.0 00000100:00100000:0.0:1784191841.820137:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1784191841.820143:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827872384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191841.820315:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1784191841.820324:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858827872896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191841.820356:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858827872896:12345-0@lo:400:kworker.0 Request processed in 35us (15071us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191841.820362:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1784191841.820417:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827872640:0@lo:400:kworker.0 00000100:00100000:2.0:1784191841.820431:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827873152:0@lo:400:kworker.0 00000100:00100000:3.0:1784191841.820458:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827872384:0@lo:400:kworker.0 00000100:00100000:2.0:1784191841.820470:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827872512:0@lo:400:kworker.0 00000100:00100000:3.0:1784191841.820478:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827872896:0@lo:400:kworker.0 00000100:00100000:2.0:1784191841.820488:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827873024:0@lo:400:kworker.0 00000100:00100000:0.0:1784191841.820654:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827872384:12345-0@lo:400:kworker.0 Request processed in 509us (15427us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191841.820661:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1784191841.820705:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827872256 00000100:00100000:0.0:1784191841.820709:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827872256 00000100:00100000:0.0:1784191841.821112:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1784191841.821120:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827872256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191841.821175:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827872256:12345-0@lo:400:kworker.0 Request processed in 57us (16423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191841.821183:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1784191841.823007:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827872256:0@lo:400:kworker.0 00000100:00100000:3.0:1784191842.226541:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191842.226587:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191842.226682:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812327552 00000100:00100000:2.0:1784191842.226712:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812327552 00000100:00100000:2.0:1784191842.226782:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812327424 00000100:00100000:2.0:1784191842.226784:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812327424 00000100:00100000:2.0:1784191842.226812:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 27 00000100:00100000:2.0:1784191842.226821:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9e3b1f6-8cce-446b-b02a-9948a606da8b+11:69110:x1870858812327552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191842.226840:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191842.226871:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a241 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b4be expref: 11 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191842.226899:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191842.226948:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9e3b1f6-8cce-446b-b02a-9948a606da8b+10:69110:x1870858812327552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 128us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191842.226956:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 27 00000100:00100000:2.0:1784191842.226975:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 28 00000100:00100000:2.0:1784191842.226981:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9e3b1f6-8cce-446b-b02a-9948a606da8b+9:69110:x1870858812327424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191842.226991:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191842.226999:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af10b5e5800/0xfeec3c2dc5a4a23a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b48d expref: 9 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191842.227009:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191842.227023:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9e3b1f6-8cce-446b-b02a-9948a606da8b+8:69110:x1870858812327424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 42us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191842.227028:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 28 00000100:00100000:2.0:1784191842.237007:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191842.244975:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812327680 00000100:00100000:3.0:1784191842.244989:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812327680 00000100:00100000:3.0:1784191842.245068:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 227 00000100:00100000:3.0:1784191842.245079:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69108:x1870858812327680:12345-192.168.204.16@tcp:9:umount.0 00000020:00000080:3.0:1784191842.245108:0:162389:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4a264 00000100:00080000:3.0:1784191842.245117:0:162389:0:(import.c:65:import_set_state_nolock()) ffff8af110dfc000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784191842.245162:0:162389:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869231 00000100:00080000:1.0:1784191842.245372:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784191842.245654:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191842.248053:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+2:69108:x1870858812327680:12345-192.168.204.16@tcp:9:umount.0 Request processed in 2964us (11044us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191842.248067:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 227 00000100:00100000:0.0:1784191842.248567:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191842.249467:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812327808 00000100:00100000:3.0:1784191842.249478:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812327808 00000100:00100000:3.0:1784191842.249973:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 29 00000100:00100000:3.0:1784191842.249983:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9e3b1f6-8cce-446b-b02a-9948a606da8b+8:69111:x1870858812327808:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191842.249998:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191842.250017:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af10b5e5600/0xfeec3c2dc5a4a248 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b4c5 expref: 8 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.250034:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191842.250091:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9e3b1f6-8cce-446b-b02a-9948a606da8b+7:69111:x1870858812327808:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 110us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191842.250098:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 29 00000100:00100000:1.0:1784191842.262279:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191842.262372:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812327936 00000100:00100000:0.0:1784191842.262382:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812327936 00000100:00100000:0.0:1784191842.262449:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 228 00000100:00100000:0.0:1784191842.262460:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69108:x1870858812327936:12345-192.168.204.16@tcp:9:umount.0 00000020:00000080:0.0:1784191842.262502:0:161232:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4a25d 00000100:00080000:0.0:1784191842.262511:0:161232:0:(import.c:65:import_set_state_nolock()) ffff8af107874800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784191842.262559:0:161232:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836536 00000100:00100000:0.0:1784191842.262739:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+2:69108:x1870858812327936:12345-192.168.204.16@tcp:9:umount.0 Request processed in 281us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191842.262747:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 228 00010000:00010000:0.0:1784191842.262765:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784191842.263005:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784191842.284234:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191842.284373:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812328192 00000100:00100000:0.0:1784191842.284382:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812328192 00000100:00100000:0.0:1784191842.284455:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 381 00000100:00100000:0.0:1784191842.284466:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+20:69108:x1870858812328192:12345-192.168.204.16@tcp:39:umount.0 00000020:00000080:0.0:1784191842.284508:0:164531:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4a24f 00000020:00010000:0.0:1784191842.284517:0:164531:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8af110df9800: total 0 00000100:00080000:0.0:1784191842.284521:0:164531:0:(import.c:65:import_set_state_nolock()) ffff8af110dfe000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784191842.284563:0:164531:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 8, last_transno is 34359738619 00000100:00100000:0.0:1784191842.284752:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+19:69108:x1870858812328192:12345-192.168.204.16@tcp:39:umount.0 Request processed in 287us (526us total) trans 34359738620 rc 0/0 00000100:00100000:0.0:1784191842.284759:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 381 00010000:00010000:1.0:1784191842.284954:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a4fd lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191842.284966:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a4fd lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191842.284973:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a4fd lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191842.284980:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191842.284984:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a4fd lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191842.284992:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a4fd lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191842.285010:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0xcfba293b (ffff8af2331f1800) 00010000:00010000:1.0:1784191842.285013:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191842.285017:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a4fd lrc: 2/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191842.285024:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a4fd lrc: 0/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0xcfba293b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191842.285049:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5000/0xfeec3c2dc5a4a4c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191842.285056:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5000/0xfeec3c2dc5a4a4c5 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191842.285072:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5000/0xfeec3c2dc5a4a4c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191842.285077:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191842.285080:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5000/0xfeec3c2dc5a4a4c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191842.285087:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5000/0xfeec3c2dc5a4a4c5 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191842.285094:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x138b1e0d (ffff8af2331f1700) 00010000:00010000:1.0:1784191842.285096:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191842.285099:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5000/0xfeec3c2dc5a4a4c5 lrc: 2/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191842.285104:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5000/0xfeec3c2dc5a4a4c5 lrc: 0/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0x138b1e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784191842.285122:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784191842.285323:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a519 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285393:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a519 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285401:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a519 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285407:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191842.285409:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a519 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285416:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a519 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285426:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfabfbe3f (ffff8af210e98200) 00010000:00010000:3.0:1784191842.285428:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191842.285431:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a519 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285438:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a519 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfabfbe3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285454:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a4e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285461:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a4e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285466:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a4e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285470:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191842.285479:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a4e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285485:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a4e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285504:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0x617c8261 (ffff8af210e98600) 00010000:00010000:3.0:1784191842.285506:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191842.285509:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a4e1 lrc: 2/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285514:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a4e1 lrc: 0/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0x617c8261 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285528:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a48d lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285535:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a48d lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285540:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a48d lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285545:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191842.285548:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a48d lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285553:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a48d lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285559:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab3:0x1:0x0].0xc262d182 (ffff8af210e98d00) 00010000:00010000:3.0:1784191842.285562:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191842.285569:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a48d lrc: 2/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285575:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a48d lrc: 0/0,0 mode: --/TXN res: [0x200003ab3:0x1:0x0].0xc262d182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1784191842.285596:0:160901:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8af110df9800: total 0 00010000:00010000:3.0:1784191842.285599:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191842.285660:0:160901:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8af110df9800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784191842.285685:0:160901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191842.285732:0:160901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784191842.285738:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a52e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5a5 expref: 13 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.285751:0:160901:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8af110df9800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1784191842.285761:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191842.285763:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191842.285765:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191842.297017:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191842.297532:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812328320 00000100:00100000:3.0:1784191842.297544:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812328320 00000100:00100000:3.0:1784191842.297633:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 382 00000100:00100000:3.0:1784191842.297644:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+5:69108:x1870858812328320:12345-192.168.204.16@tcp:39:umount.0 00000020:00000080:3.0:1784191842.297730:0:158665:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4a256 00000100:00080000:3.0:1784191842.297740:0:158665:0:(import.c:65:import_set_state_nolock()) ffff8af23d858000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784191842.297759:0:158665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 5, last_transno is 21474836525 00000100:00100000:3.0:1784191842.297943:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8673fc11-fb8a-4aba-9612-ff2cd2a411bc+3:69108:x1870858812328320:12345-192.168.204.16@tcp:39:umount.0 Request processed in 301us (935us total) trans 21474836526 rc 0/0 00000100:00100000:3.0:1784191842.297951:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 382 00010000:00010000:2.0:1784191842.298221:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784191842.298837:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784191842.365335:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191842.365452:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812328576 00000100:00100000:0.0:1784191842.365463:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812328576 00000100:00100000:0.0:1784191842.365534:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 229 00000100:00100000:0.0:1784191842.365546:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9e3b1f6-8cce-446b-b02a-9948a606da8b+7:69108:x1870858812328576:12345-192.168.204.16@tcp:251:umount.0 00000020:00000080:0.0:1784191842.365588:0:158658:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4a22c 00000020:00010000:0.0:1784191842.365596:0:158658:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8af23470e000: total 0 00000100:00080000:0.0:1784191842.365601:0:158658:0:(import.c:65:import_set_state_nolock()) ffff8af234708000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784191842.365724:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9e3b1f6-8cce-446b-b02a-9948a606da8b+3:69108:x1870858812328576:12345-192.168.204.16@tcp:251:umount.0 Request processed in 179us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191842.365741:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 229 00000020:00010000:2.0:1784191842.366246:0:158654:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8af23470e000: total 0 00010000:00010000:2.0:1784191842.366314:0:158654:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8af23470e000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784191842.366350:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af1019d5600/0xfeec3c2dc5a4a233 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b486 expref: 2 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191842.366367:0:158654:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8af23470e000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1784191842.366380:0:158654:0:(genops.c:906:class_export_put()) final put ffff8af23470e000/f9e3b1f6-8cce-446b-b02a-9948a606da8b 00010000:00010000:2.0:1784191842.366394:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191842.366396:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191842.366398:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784191842.366506:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23470e000/f9e3b1f6-8cce-446b-b02a-9948a606da8b for MGS 00000020:00000080:3.0:1784191842.366558:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af234708000 for MGS 00010000:00010000:3.0:1784191842.381819:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191842.691276:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191842.693252:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812328704 00000100:00100000:3.0:1784191842.693266:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812328704 00000100:00100000:3.0:1784191842.693335:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 230 00000100:00100000:3.0:1784191842.693344:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:69108:x1870858812328704:12345-192.168.204.16@tcp:250:mount.lustre.0 00010000:00080000:3.0:1784191842.693373:0:158659:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 9424fd8d-001c-4ed5-89e0-95e0bf2d2c97@192.168.204.16@tcp t0 exp 0000000000000000 cur 5462 last 0 00000020:00000080:3.0:1784191842.693537:0:158659:0:(genops.c:1406:class_connect()) connect: client 9424fd8d-001c-4ed5-89e0-95e0bf2d2c97, cookie 0xfeec3c2dc5a4a535 00000100:00080000:3.0:1784191842.693585:0:158659:0:(import.c:65:import_set_state_nolock()) ffff8af1086f7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784191842.693663:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+5:69108:x1870858812328704:12345-192.168.204.16@tcp:250:mount.lustre.0 Request processed in 311us (2391us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191842.693671:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 230 00000100:00100000:3.0:1784191842.712968:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191842.713131:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812328832 00000100:00100000:1.0:1784191842.713142:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812328832 00000100:00100000:1.0:1784191842.713200:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 231 00000100:00100000:1.0:1784191842.713211:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+5:122633:x1870858812328832:12345-192.168.204.16@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784191842.713228:0:158660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191842.713246:0:158660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af20cd7fe00/0xfeec3c2dc5a4a53c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b5ba expref: -99 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191842.713296:0:158660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af20cd7fe00/0xfeec3c2dc5a4a53c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5ba expref: 6 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191842.713308:0:158660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af20cd7fe00/0xfeec3c2dc5a4a53c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5ba expref: 6 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191842.713317:0:158660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7fe00, rc 0) 00000100:00100000:1.0:1784191842.713393:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+6:122633:x1870858812328832:12345-192.168.204.16@tcp:101:mount.lustre.0 Request processed in 183us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191842.713409:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 231 00000100:00100000:1.0:1784191842.730864:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191842.731956:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812328960 00000100:00100000:0.0:1784191842.731968:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812328960 00000100:00100000:0.0:1784191842.732221:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 232 00000100:00100000:0.0:1784191842.732232:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+6:122633:x1870858812328960:12345-192.168.204.16@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784191842.732391:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+6:122633:x1870858812328960:12345-192.168.204.16@tcp:501:mount.lustre.0 Request processed in 160us (1537us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784191842.732407:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 232 00000100:00100000:2.0:1784191842.750185:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191842.750432:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812329088 00000100:00100000:3.0:1784191842.750443:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812329088 00000100:00100000:3.0:1784191842.750518:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 233 00000100:00100000:3.0:1784191842.750529:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+6:122633:x1870858812329088:12345-192.168.204.16@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784191842.750549:0:158659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191842.750568:0:158659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af223b7ce00/0xfeec3c2dc5a4a543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b5c1 expref: -99 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.750601:0:158659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af223b7ce00/0xfeec3c2dc5a4a543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5c1 expref: 7 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.750613:0:158659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af223b7ce00/0xfeec3c2dc5a4a543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5c1 expref: 7 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191842.750624:0:158659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7ce00, rc 0) 00000100:00100000:3.0:1784191842.750918:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+7:122633:x1870858812329088:12345-192.168.204.16@tcp:101:mount.lustre.0 Request processed in 391us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191842.750925:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 233 00000100:00100000:3.0:1784191842.760186:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191842.760305:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812329216 00000100:00100000:0.0:1784191842.760316:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812329216 00000100:00100000:0.0:1784191842.760386:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 234 00000100:00100000:0.0:1784191842.760404:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+7:122633:x1870858812329216:12345-192.168.204.16@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784191842.762188:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+8:122633:x1870858812329216:12345-192.168.204.16@tcp:501:mount.lustre.0 Request processed in 1783us (1999us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191842.762203:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 234 00000100:00100000:0.0:1784191842.774813:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191842.775025:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812329344 00000100:00100000:1.0:1784191842.775037:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812329344 00000100:00100000:1.0:1784191842.775095:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 235 00000100:00100000:1.0:1784191842.775105:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+8:122633:x1870858812329344:12345-192.168.204.16@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784191842.775252:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+8:122633:x1870858812329344:12345-192.168.204.16@tcp:503:mount.lustre.0 Request processed in 147us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191842.775261:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 235 00000100:00100000:2.0:1784191842.788975:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191842.789930:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812329472 00000100:00100000:0.0:1784191842.789944:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812329472 00000100:00100000:0.0:1784191842.790011:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 236 00000100:00100000:0.0:1784191842.790022:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+8:122647:x1870858812329472:12345-192.168.204.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784191842.790258:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+8:122647:x1870858812329472:12345-192.168.204.16@tcp:502:llog_process_th.0 Request processed in 237us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191842.790267:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 236 00000100:00100000:0.0:1784191842.841458:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191842.843279:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812329600 00000100:00100000:3.0:1784191842.843294:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812329600 00000100:00100000:3.0:1784191842.843366:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 237 00000100:00100000:3.0:1784191842.843377:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+8:122647:x1870858812329600:12345-192.168.204.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784191842.843608:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+8:122647:x1870858812329600:12345-192.168.204.16@tcp:502:llog_process_th.0 Request processed in 231us (2157us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191842.843617:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 237 00000100:00100000:2.0:1784191842.858661:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191842.859496:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812329728 00000100:00100000:1.0:1784191842.859509:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812329728 00000100:00100000:1.0:1784191842.859570:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 238 00000100:00100000:1.0:1784191842.859580:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+8:122647:x1870858812329728:12345-192.168.204.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784191842.859984:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+8:122647:x1870858812329728:12345-192.168.204.16@tcp:502:llog_process_th.0 Request processed in 403us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191842.859994:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 238 00000100:00100000:2.0:1784191842.875507:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191842.875612:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812329856 00000100:00100000:0.0:1784191842.875622:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812329856 00000100:00100000:0.0:1784191842.875723:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 239 00000100:00100000:0.0:1784191842.875734:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+8:122633:x1870858812329856:12345-192.168.204.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784191842.875761:0:158658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191842.875791:0:158658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af10b5e5e00/0xfeec3c2dc5a4a54a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b5f2 expref: -99 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191842.875821:0:158658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af10b5e5e00/0xfeec3c2dc5a4a54a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5f2 expref: 9 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191842.875832:0:158658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af10b5e5e00/0xfeec3c2dc5a4a54a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5f2 expref: 9 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191842.875841:0:158658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5e00, rc 0) 00000100:00100000:0.0:1784191842.875911:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+9:122633:x1870858812329856:12345-192.168.204.16@tcp:101:mount.lustre.0 Request processed in 179us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191842.875919:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 239 00000100:00100000:0.0:1784191842.888464:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191842.890083:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812329984 00000100:00100000:3.0:1784191842.890096:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812329984 00000100:00100000:3.0:1784191842.890149:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 240 00000100:00100000:3.0:1784191842.890159:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+9:122633:x1870858812329984:12345-192.168.204.16@tcp:256:mount.lustre.0 20000000:01000000:3.0:1784191842.890184:0:158659:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1784191842.890205:0:158659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784191842.890209:0:158659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784191842.890213:0:158659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784191842.890216:0:158659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1784191842.890218:0:158659:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 36 00000100:00100000:3.0:1784191842.896302:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+9:122633:x1870858812329984:12345-192.168.204.16@tcp:256:mount.lustre.0 Request processed in 6131us (7895us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191842.896318:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 240 00000100:00100000:2.0:1784191842.904006:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191842.904161:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812330112 00000100:00100000:1.0:1784191842.904172:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812330112 00000100:00100000:1.0:1784191842.904228:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 241 00000100:00100000:1.0:1784191842.904238:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+9:122633:x1870858812330112:12345-192.168.204.16@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784191842.904255:0:158660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191842.904272:0:158660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af20cd7f000/0xfeec3c2dc5a4a551 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b5f9 expref: -99 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191842.904301:0:158660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af20cd7f000/0xfeec3c2dc5a4a551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5f9 expref: 10 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191842.904313:0:158660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af20cd7f000/0xfeec3c2dc5a4a551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5f9 expref: 10 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191842.904321:0:158660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f000, rc 0) 00000100:00100000:1.0:1784191842.904384:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:122633:x1870858812330112:12345-192.168.204.16@tcp:101:mount.lustre.0 Request processed in 147us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191842.904391:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 241 00000100:00100000:0.0:1784191842.911380:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191842.912615:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812330240 00000100:00100000:3.0:1784191842.912628:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812330240 00000100:00100000:3.0:1784191842.912735:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 242 00000100:00100000:3.0:1784191842.912776:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:122633:x1870858812330240:12345-192.168.204.16@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784191842.912949:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:122633:x1870858812330240:12345-192.168.204.16@tcp:501:mount.lustre.0 Request processed in 191us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191842.912957:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 242 00000100:00100000:2.0:1784191842.918545:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191842.918644:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812330368 00000100:00100000:1.0:1784191842.918664:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812330368 00000100:00100000:1.0:1784191842.918764:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 243 00000100:00100000:1.0:1784191842.918892:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:122633:x1870858812330368:12345-192.168.204.16@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784191842.919104:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:122633:x1870858812330368:12345-192.168.204.16@tcp:503:mount.lustre.0 Request processed in 329us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191842.919112:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 243 00000100:00100000:2.0:1784191842.942986:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191842.943293:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812330496 00000100:00100000:0.0:1784191842.943308:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812330496 00000100:00100000:0.0:1784191842.943403:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 244 00000100:00100000:0.0:1784191842.943414:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:122655:x1870858812330496:12345-192.168.204.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784191842.944793:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:122655:x1870858812330496:12345-192.168.204.16@tcp:502:llog_process_th.0 Request processed in 1368us (1811us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191842.944824:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 244 00000100:00100000:0.0:1784191842.957081:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191842.957192:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812330624 00000100:00100000:3.0:1784191842.957208:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812330624 00000100:00100000:3.0:1784191842.957284:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 245 00000100:00100000:3.0:1784191842.957296:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:122655:x1870858812330624:12345-192.168.204.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784191842.957538:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:122655:x1870858812330624:12345-192.168.204.16@tcp:502:llog_process_th.0 Request processed in 243us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191842.957555:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 245 00000100:00100000:2.0:1784191842.970031:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191842.970166:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191842.970270:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812330752 00000100:00100000:1.0:1784191842.970283:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812330752 00000100:00100000:1.0:1784191842.970335:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812331008 00000100:00100000:1.0:1784191842.970337:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812331008 00000100:00100000:1.0:1784191842.970361:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 383 00000100:00100000:1.0:1784191842.970371:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:69108:x1870858812330752:12345-192.168.204.16@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784191842.970418:0:164531:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp t0 exp 0000000000000000 cur 5463 last 0 00000020:00000080:1.0:1784191842.970469:0:164531:0:(genops.c:1406:class_connect()) connect: client 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a, cookie 0xfeec3c2dc5a4a558 00000004:00100000:1.0:1784191842.970513:0:164531:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784191842.970642:0:164531:0:(import.c:65:import_set_state_nolock()) ffff8af109055000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784191842.970781:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69108:x1870858812330752:12345-192.168.204.16@tcp:38:mount.lustre.0 Request processed in 409us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191842.970789:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 383 00000100:00100000:1.0:1784191842.970811:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 384 00000100:00100000:1.0:1784191842.970816:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:69108:x1870858812331008:12345-192.168.204.16@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784191842.970835:0:164531:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp t0 exp 0000000000000000 cur 5463 last 0 00000020:00000080:1.0:1784191842.970863:0:164531:0:(genops.c:1406:class_connect()) connect: client 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a, cookie 0xfeec3c2dc5a4a55f 00000004:00100000:1.0:1784191842.970878:0:164531:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784191842.970926:0:164531:0:(import.c:65:import_set_state_nolock()) ffff8af109053000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784191842.970949:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69108:x1870858812331008:12345-192.168.204.16@tcp:38:mount.lustre.0 Request processed in 131us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191842.970955:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 384 00000100:00100000:2.0:1784191843.003972:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191843.004094:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812330880 00000100:00100000:0.0:1784191843.004106:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812330880 00000100:00100000:0.0:1784191843.004205:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 385 00000100:00100000:0.0:1784191843.004219:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:0:x1870858812330880:12345-192.168.204.16@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784191843.004271:0:158666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42659840 avail 36528128 00000100:00100000:0.0:1784191843.004364:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:0:x1870858812330880:12345-192.168.204.16@tcp:41:mount.lustre.0 Request processed in 148us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191843.004372:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 385 00000100:00080000:1.0:1784191843.006462:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784191843.019120:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191843.019249:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191843.032681:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812331264 00000100:00100000:2.0:1784191843.032719:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812331264 00000100:00100000:2.0:1784191843.032930:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812331136 00000100:00100000:2.0:1784191843.032934:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812331136 00000100:00100000:2.0:1784191843.033001:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 386 00000100:00100000:2.0:1784191843.033014:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122633:x1870858812331264:12345-192.168.204.16@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784191843.033064:0:161504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42659840 avail 36528128 00000100:00100000:2.0:1784191843.033197:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122633:x1870858812331264:12345-192.168.204.16@tcp:41:mount.lustre.0 Request processed in 185us (14092us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191843.033206:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 386 00000100:00100000:2.0:1784191843.033228:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 387 00000100:00100000:2.0:1784191843.033235:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:0:x1870858812331136:12345-192.168.204.16@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784191843.033256:0:161504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42786816 avail 36655104 00000100:00100000:2.0:1784191843.033285:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:0:x1870858812331136:12345-192.168.204.16@tcp:41:mount.lustre.0 Request processed in 51us (14036us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191843.033292:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 387 00000100:00080000:3.0:1784191843.034330:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191843.036980:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191843.037238:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812331392 00000100:00100000:2.0:1784191843.037252:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812331392 00000100:00100000:2.0:1784191843.037332:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 388 00000100:00100000:2.0:1784191843.039048:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122633:x1870858812331392:12345-192.168.204.16@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784191843.039182:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122633:x1870858812331392:12345-192.168.204.16@tcp:40:mount.lustre.0 Request processed in 157us (2216us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191843.043332:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191843.043407:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191843.043441:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812331520 00000100:00100000:1.0:1784191843.043454:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812331520 00000100:00100000:1.0:1784191843.043515:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812331648 00000100:00100000:1.0:1784191843.043518:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812331648 00000100:00100000:1.0:1784191843.043829:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 229 00000100:00100000:1.0:1784191843.043844:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:69108:x1870858812331520:12345-192.168.204.16@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784191843.043893:0:162391:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp t0 exp 0000000000000000 cur 5463 last 0 00000020:00000080:1.0:1784191843.043932:0:162391:0:(genops.c:1406:class_connect()) connect: client 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a, cookie 0xfeec3c2dc5a4a566 00002000:00100000:1.0:1784191843.043947:0:162391:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a/ffff8af109056000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784191843.043973:0:162391:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784191843.044061:0:162391:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784191843.044098:0:162391:0:(import.c:65:import_set_state_nolock()) ffff8af109050000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784191843.044178:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69108:x1870858812331520:12345-192.168.204.16@tcp:8:mount.lustre.0 Request processed in 336us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191843.044186:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 229 00000100:00100000:1.0:1784191843.044207:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 230 00000100:00100000:1.0:1784191843.044211:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:69108:x1870858812331648:12345-192.168.204.16@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784191843.044226:0:162391:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp t0 exp 0000000000000000 cur 5463 last 0 00000020:00000080:1.0:1784191843.044243:0:162391:0:(genops.c:1406:class_connect()) connect: client 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a, cookie 0xfeec3c2dc5a4a56d 00002000:00100000:1.0:1784191843.044248:0:162391:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a/ffff8af109051800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784191843.044261:0:162391:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784191843.044293:0:162391:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784191843.044331:0:162391:0:(import.c:65:import_set_state_nolock()) ffff8af22dcdb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784191843.045198:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 388 00000100:00100000:3.0:1784191843.045375:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191843.045670:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69108:x1870858812331648:12345-192.168.204.16@tcp:8:mount.lustre.0 Request processed in 1454us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191843.045816:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 230 00000100:00100000:2.0:1784191843.045847:0:158677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812331776 00000100:00100000:2.0:1784191843.045856:0:158677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812331776 00000100:00100000:2.0:1784191843.045911:0:158677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 11 00000100:00100000:2.0:1784191843.045920:0:158677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1065ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122633:x1870858812331776:12345-192.168.204.16@tcp:900:mount.lustre.0 00000100:00100000:2.0:1784191843.045964:0:158677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1065ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122633:x1870858812331776:12345-192.168.204.16@tcp:900:mount.lustre.0 Request processed in 46us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191843.045971:0:158677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 11 00000100:00100000:3.0:1784191843.047947:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191843.048113:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812331904 00000100:00100000:0.0:1784191843.048124:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812331904 00000100:00100000:0.0:1784191843.048349:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 102 00000100:00100000:0.0:1784191843.048362:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122633:x1870858812331904:12345-192.168.204.16@tcp:33:mount.lustre.0 00000004:00200000:0.0:1784191843.048502:0:158669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1784191843.049298:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122633:x1870858812331904:12345-192.168.204.16@tcp:33:mount.lustre.0 Request processed in 936us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191843.049308:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 102 00010000:00010000:2.0:1784191843.404115:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191844.365631:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784191844.365670:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827874176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784191844.366540:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191844.367051:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827874176 00000100:00100000:1.0:1784191844.367063:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827874176 00000100:00100000:1.0:1784191844.367226:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1784191844.367239:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827874176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784191844.367275:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8228544 pending 0 free 71041024 avail 63873024 00000100:00100000:1.0:1784191844.367351:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827874176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191844.367359:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1784191844.367413:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191844.368378:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827874176:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784191844.430433:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191844.876633:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827874304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784191844.876770:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191844.876833:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784191844.876852:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827874432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191844.876879:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191844.876957:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827874304 00000100:00100000:2.0:1784191844.876967:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827874304 00000100:00100000:2.0:1784191844.877038:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827874432 00000100:00100000:2.0:1784191844.877041:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827874432 00000100:00100000:2.0:1784191844.877075:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1784191844.877086:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827874304:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784191844.877108:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1784191844.877121:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827874432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784191844.877132:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42786816 avail 36655104 00000004:00000024:1.0:1784191844.877148:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42659840 avail 36528128 00000100:00100000:2.0:1784191844.877210:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827874304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191844.877212:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827874432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191844.877226:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1784191844.877759:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827874432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191844.877776:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827874304:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1784191844.881256:0:158645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000001:00100000:3.0:1784191844.881270:0:158645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8673fc11-fb8a-4aba-9612-ff2cd2a411bc 00000001:00080000:3.0:1784191844.881280:0:158645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738620 is committed 00000004:00080000:3.0:1784191844.881289:0:158645:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 27 committed 00000004:00080000:3.0:1784191844.881317:0:158645:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 26 committed 00000020:00000080:3.0:1784191844.881325:0:158645:0:(genops.c:906:class_export_put()) final put ffff8af110df9800/8673fc11-fb8a-4aba-9612-ff2cd2a411bc 00000020:00000080:0.0:1784191844.881492:0:123300:0:(genops.c:865:class_export_destroy()) destroying export ffff8af110df9800/8673fc11-fb8a-4aba-9612-ff2cd2a411bc for lustre-MDT0000 00000020:00000080:0.0:1784191844.881562:0:123300:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af110dfe000 for lustre-MDT0000 00000100:00100000:0.0:1784191844.881928:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827874560:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784191844.882007:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191844.882084:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827874560 00000100:00100000:3.0:1784191844.882092:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827874560 00000100:00100000:3.0:1784191844.882157:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1784191844.882166:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827874560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1784191844.882205:0:162385:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:580 count 1 00002000:00010000:3.0:1784191844.882237:0:162385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x244:0x0] initial LVB size: 0, mtime: 0x6a589b53, atime: 0x6a589b53, ctime: 0x6a589b53, blocks: 0x0 00010000:00010000:3.0:1784191844.882245:0:162385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000794619ed/0xfeec3c2dc5a4a574 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191844.882263:0:162385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x244:0x0].0x0 since=5465s v=(0 0) 00010000:00010000:3.0:1784191844.882268:0:162385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x244:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191844.882274:0:162385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000794619ed/0xfeec3c2dc5a4a574 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191844.882291:0:162385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000794619ed/0xfeec3c2dc5a4a574 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191844.882301:0:162385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000794619ed/0xfeec3c2dc5a4a574 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191844.882308:0:162385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000794619ed/0xfeec3c2dc5a4a574 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191844.882326:0:162385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784191844.888686:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00080000:1.0:1784191844.888832:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784191844.888868:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191844.888880:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000794619ed/0xfeec3c2dc5a4a574 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.888897:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7c600 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:1.0:1784191844.888903:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000794619ed/0xfeec3c2dc5a4a574 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.888916:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000794619ed/0xfeec3c2dc5a4a574 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.888968:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000794619ed/0xfeec3c2dc5a4a574 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.888976:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000794619ed/0xfeec3c2dc5a4a574 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.889010:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191844.889012:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191844.889014:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191844.889048:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827874688:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784191844.889150:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191844.889244:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827874688 00000100:00100000:1.0:1784191844.889255:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827874688 00000100:00100000:1.0:1784191844.889314:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1784191844.889324:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:106500:x1870858827874688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1784191844.889365:0:160163:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:578 count 1 00002000:00010000:1.0:1784191844.889407:0:160163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x242:0x0] initial LVB size: 0, mtime: 0x6a589b51, atime: 0x6a589b51, ctime: 0x6a589b51, blocks: 0x0 00010000:00010000:1.0:1784191844.889415:0:160163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000618513d8/0xfeec3c2dc5a4a57b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.889431:0:160163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x242:0x0].0x0 since=5465s v=(0 0) 00010000:00010000:1.0:1784191844.889449:0:160163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191844.889458:0:160163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000618513d8/0xfeec3c2dc5a4a57b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.889486:0:160163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000618513d8/0xfeec3c2dc5a4a57b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.889498:0:160163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000618513d8/0xfeec3c2dc5a4a57b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.889506:0:160163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000618513d8/0xfeec3c2dc5a4a57b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.889530:0:160163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784191844.889792:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:106500:x1870858827874688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 468us (640us total) trans 21474836538 rc 0/0 00000100:00100000:1.0:1784191844.889800:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00010000:00010000:1.0:1784191844.889825:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191844.889831:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000618513d8/0xfeec3c2dc5a4a57b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.889840:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f400 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:1.0:1784191844.889843:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000618513d8/0xfeec3c2dc5a4a57b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.889852:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000618513d8/0xfeec3c2dc5a4a57b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.889866:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000618513d8/0xfeec3c2dc5a4a57b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.889881:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000618513d8/0xfeec3c2dc5a4a57b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.889901:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191844.889903:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191844.889905:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784191844.889947:0:106500:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af1016bdf80/2, rc 0, transno 21474836538 00000100:00100000:1.0:1784191844.889954:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827874688:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1784191844.890704:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:106499:x1870858827874560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8515us (8673us total) trans 21474836537 rc 0/0 00000100:00100000:3.0:1784191844.890721:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1784191844.893285:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827874816:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784191844.893400:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191844.893472:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784191844.893480:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827874944:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784191844.893507:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191844.893563:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827874816 00000100:00100000:1.0:1784191844.893574:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827874816 00000100:00100000:1.0:1784191844.893642:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827874944 00000100:00100000:1.0:1784191844.893646:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827874944 00000100:00100000:1.0:1784191844.893673:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1784191844.893683:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:106501:x1870858827874816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1784191844.893774:0:162339:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:581 count 1 00002000:00010000:1.0:1784191844.893834:0:162339:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x245:0x0] initial LVB size: 1, mtime: 0x6a589b53, atime: 0x0, ctime: 0x6a589b53, blocks: 0x8 00000100:00100000:2.0:1784191844.894553:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1784191844.894571:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:106501:x1870858827874944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784191844.894597:0:162386:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:579 count 1 00002000:00010000:2.0:1784191844.894623:0:162386:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x243:0x0] initial LVB size: 1, mtime: 0x6a589b51, atime: 0x0, ctime: 0x6a589b51, blocks: 0x8 00010000:00010000:2.0:1784191844.894632:0:162386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4a589 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191844.894673:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x243:0x0].0x0 since=5465s v=(0 0) 00010000:00010000:2.0:1784191844.894678:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x243:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191844.894686:0:162386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4a589 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191844.894733:0:162386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4a589 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191844.894753:0:162386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4a589 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191844.894787:0:162386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4a589 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191844.894814:0:162386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784191844.894951:0:162339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4a582 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.894961:0:162339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x245:0x0].0x0 since=5465s v=(0 0) 00010000:00010000:1.0:1784191844.894970:0:162339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x245:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191844.894975:0:162339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4a582 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.894984:0:162339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4a582 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.894992:0:162339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4a582 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.894998:0:162339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4a582 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.895014:0:162339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1784191844.895058:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:106501:x1870858827874944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 494us (1548us total) trans 21474836539 rc 0/0 00000100:00100000:2.0:1784191844.895066:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1784191844.895095:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:106501:x1870858827874816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1414us (1695us total) trans 21474836540 rc 0/0 00000100:00100000:1.0:1784191844.895102:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00010000:00010000:2.0:1784191844.895103:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784191844.895110:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4a589 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191844.895119:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4400 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:1.0:1784191844.895121:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191844.895125:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4a589 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.895126:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4a582 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.895134:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ee00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191844.895136:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4a589 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.895138:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4a582 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.895146:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4a582 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191844.895158:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4a589 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191844.895166:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4a589 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.895167:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4a582 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191844.895175:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4a582 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191844.895188:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191844.895190:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191844.895191:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191844.895193:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191844.895195:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191844.895197:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784191844.895248:0:106501:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af1016be300/2, rc 0, transno 21474836539 00000100:00100000:2.0:1784191844.895257:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827874944:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1784191844.895270:0:106501:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af1016bc380/2, rc 0, transno 21474836540 00000100:00100000:2.0:1784191844.895273:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827874816:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1784191844.899945:0:106499:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af1016bf100/2, rc 0, transno 21474836537 00000100:00100000:0.0:1784191844.899961:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827874560:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784191845.388461:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827875072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784191845.388542:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191845.389443:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827875072 00000100:00100000:1.0:1784191845.389453:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827875072 00000100:00100000:1.0:1784191845.389522:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784191845.389531:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:106499:x1870858827875072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784191845.389565:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8228544 pending 0 free 71049216 avail 63881216 00000100:00100000:1.0:1784191845.389639:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:106499:x1870858827875072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191845.389647:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784191845.389755:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827875072:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784191845.453487:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191846.476056:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191846.925514:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827875200:0@lo:400:kworker.0 00000100:00100000:3.0:1784191846.925608:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191846.925653:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:106500:1870858827875712:0@lo:400:kworker.0 00000100:00100000:3.0:1784191846.925728:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191846.925746:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858827876224:0@lo:400:kworker.0 00000100:00100000:3.0:1784191846.925766:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191846.925784:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858827876736:0@lo:400:kworker.0 00000100:00100000:3.0:1784191846.925804:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191846.925828:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784191846.925833:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827875584:0@lo:400:kworker.0 00000100:00100000:3.0:1784191846.925856:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191846.925873:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827876096:0@lo:400:kworker.0 00000100:00100000:3.0:1784191846.925891:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191846.925904:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858827876608:0@lo:400:kworker.0 00000100:00100000:3.0:1784191846.925923:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191846.925949:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d788e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827875456:0@lo:400:kworker.0 00000100:00100000:3.0:1784191846.925972:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191846.925991:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827875968:0@lo:400:kworker.0 00000100:00100000:3.0:1784191846.926021:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191846.926039:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858827876480:0@lo:400:kworker.0 00000100:00100000:3.0:1784191846.926074:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191846.926095:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1784191846.926101:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827875328:0@lo:400:kworker.0 00000100:00100000:3.0:1784191846.926125:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191846.926140:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827875840:0@lo:400:kworker.0 00000100:00100000:3.0:1784191846.926159:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191846.926172:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858827876352:0@lo:400:kworker.0 00000100:00100000:3.0:1784191846.926199:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191846.926224:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827875712 00000100:00100000:3.0:1784191846.926231:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827875712 00000100:00100000:3.0:1784191846.926273:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827876224 00000100:00100000:3.0:1784191846.926276:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827876224 00000100:00100000:3.0:1784191846.926288:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827876736 00000100:00100000:3.0:1784191846.926290:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827876736 00000100:00100000:3.0:1784191846.926309:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827876608 00000100:00100000:3.0:1784191846.926311:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827876608 00000100:00100000:3.0:1784191846.926322:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827876480 00000100:00100000:3.0:1784191846.926324:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827876480 00000100:00100000:3.0:1784191846.926334:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827876352 00000100:00100000:3.0:1784191846.926336:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827876352 00000100:00100000:3.0:1784191846.926352:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1784191846.926360:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106500:x1870858827875712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191846.926427:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106500:x1870858827875712:12345-0@lo:400:kworker.0 Request processed in 66us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191846.926434:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1784191846.926454:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1784191846.926459:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858827876224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191846.926486:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858827876224:12345-0@lo:400:kworker.0 Request processed in 27us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191846.926491:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1784191846.926501:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1784191846.926507:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858827876736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191846.926530:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858827876736:12345-0@lo:400:kworker.0 Request processed in 24us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191846.926536:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1784191846.927089:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827875200 00000100:00100000:1.0:1784191846.927095:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827875200 00000100:00100000:1.0:1784191846.927133:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1784191846.927140:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106500:x1870858827875200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191846.927181:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106500:x1870858827875200:12345-0@lo:400:kworker.0 Request processed in 41us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191846.927186:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1784191846.927238:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1784191846.927246:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858827876608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191846.927278:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858827876608:12345-0@lo:400:kworker.0 Request processed in 34us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191846.927284:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1784191846.927299:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1784191846.927305:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858827876480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191846.927338:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858827876480:12345-0@lo:400:kworker.0 Request processed in 33us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191846.927344:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1784191846.927356:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1784191846.927362:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858827876352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191846.927388:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858827876352:12345-0@lo:400:kworker.0 Request processed in 26us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191846.927394:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1784191846.927427:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827875584 00000100:00100000:1.0:1784191846.927431:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827875584 00000100:00100000:1.0:1784191846.927461:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827876096 00000100:00100000:1.0:1784191846.927465:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827876096 00000100:00100000:1.0:1784191846.927482:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827875456 00000100:00100000:1.0:1784191846.927484:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827875456 00000100:00100000:1.0:1784191846.927499:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827875968 00000100:00100000:1.0:1784191846.927502:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827875968 00000100:00100000:1.0:1784191846.927518:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784191846.927524:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827875584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191846.927551:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827875584:12345-0@lo:400:kworker.0 Request processed in 28us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191846.927564:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784191846.927575:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784191846.927579:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827876096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191846.927603:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827876096:12345-0@lo:400:kworker.0 Request processed in 24us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191846.927608:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784191846.927618:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784191846.927623:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:106502:x1870858827875456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191846.927643:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:106502:x1870858827875456:12345-0@lo:400:kworker.0 Request processed in 20us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191846.927648:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784191846.927658:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784191846.927663:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827875968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191846.927682:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827875968:12345-0@lo:400:kworker.0 Request processed in 20us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191846.927705:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:1.0:1784191846.927719:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784191846.927722:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784191846.927725:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784191846.927727:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784191846.927763:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858827876352:0@lo:400:kworker.0 00000100:00100000:1.0:1784191846.927776:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d788e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827875456:0@lo:400:kworker.0 00000100:00100000:1.0:1784191846.927785:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827875968:0@lo:400:kworker.0 00000100:00100000:1.0:1784191846.927794:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858827876480:0@lo:400:kworker.0 00000100:00100000:2.0:1784191846.929171:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827876864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784191846.929240:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191846.929308:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827875328 00000100:00100000:2.0:1784191846.929314:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827875328 00000100:00100000:2.0:1784191846.929476:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827875840 00000100:00100000:2.0:1784191846.929480:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827875840 00000100:00100000:2.0:1784191846.929504:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1784191846.929510:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827875328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191846.929561:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827875328:12345-0@lo:400:kworker.0 Request processed in 51us (3435us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191846.929585:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1784191846.929602:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1784191846.929607:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858827875840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191846.929636:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858827875840:12345-0@lo:400:kworker.0 Request processed in 29us (3477us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191846.929642:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1784191846.929677:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827876864 00000100:00100000:2.0:1784191846.929681:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827876864 00000100:00100000:2.0:1784191846.929729:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784191846.929735:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827876864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784191846.929769:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8249024 pending 0 free 71184384 avail 64016384 00000100:00100000:2.0:1784191846.929804:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827876864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191846.929809:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784191846.929853:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827876864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784191846.929928:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827875584:0@lo:400:kworker.0 00000100:00100000:2.0:1784191846.929938:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827876096:0@lo:400:kworker.0 00000100:00100000:2.0:1784191846.929949:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858827876608:0@lo:400:kworker.0 00000100:00100000:2.0:1784191846.929958:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827875200:0@lo:400:kworker.0 00000100:00100000:2.0:1784191846.929969:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:106500:1870858827875712:0@lo:400:kworker.0 00000100:00100000:2.0:1784191846.929980:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858827876224:0@lo:400:kworker.0 00000100:00100000:2.0:1784191846.929992:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858827876736:0@lo:400:kworker.0 00000100:00100000:1.0:1784191846.934272:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827875328:0@lo:400:kworker.0 00000100:00100000:1.0:1784191846.934298:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827875840:0@lo:400:kworker.0 00000100:00100000:0.0:1784191846.939681:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784191846.939732:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827876992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784191846.939828:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191846.941795:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827876992 00000100:00100000:3.0:1784191846.941809:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827876992 00000100:00100000:3.0:1784191846.941869:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1784191846.941879:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827876992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784191846.941907:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8249024 pending 0 free 71184384 avail 64016384 00000100:00100000:3.0:1784191846.941982:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827876992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (2155us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191846.941989:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784191846.942613:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827876992:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784191847.500602:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784191847.871766:0:164979:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-lfsck test 43: LFSCK does not loop endlessly on iget failure in scanning-phase1 ========================================================== 04:50:44 (1784191844) 00000001:00100000:0.0:1784191847.961500:0:159395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000001:00100000:0.0:1784191847.961544:0:159395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8673fc11-fb8a-4aba-9612-ff2cd2a411bc 00000001:00080000:0.0:1784191847.961558:0:159395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474836526 is committed 00000020:00000080:0.0:1784191847.961566:0:159395:0:(genops.c:906:class_export_put()) final put ffff8af104adb800/8673fc11-fb8a-4aba-9612-ff2cd2a411bc 00000001:00100000:1.0:1784191847.961723:0:160977:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000001:00100000:1.0:1784191847.961955:0:160977:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8673fc11-fb8a-4aba-9612-ff2cd2a411bc 00000020:00000080:1.0:1784191847.961958:0:160977:0:(genops.c:906:class_export_put()) final put ffff8af110dfc800/8673fc11-fb8a-4aba-9612-ff2cd2a411bc 00000020:00000080:1.0:1784191847.961993:0:123300:0:(genops.c:865:class_export_destroy()) destroying export ffff8af104adb800/8673fc11-fb8a-4aba-9612-ff2cd2a411bc for lustre-MDT0001 00000020:00000080:1.0:1784191847.962141:0:123300:0:(genops.c:865:class_export_destroy()) destroying export ffff8af110dfc800/8673fc11-fb8a-4aba-9612-ff2cd2a411bc for lustre-OST0001 00000020:00000080:1.0:1784191847.962168:0:123300:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af23d858000 for lustre-MDT0001 00000020:00000080:1.0:1784191847.962173:0:123300:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af110dfc000 for lustre-OST0001 00000001:00080000:3.0:1784191847.967039:0:160160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836540 is committed 00000001:00100000:3.0:1784191847.967078:0:160160:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000001:00100000:3.0:1784191847.967084:0:160160:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8673fc11-fb8a-4aba-9612-ff2cd2a411bc 00000020:00000080:3.0:1784191847.967089:0:160160:0:(genops.c:906:class_export_put()) final put ffff8af107877000/8673fc11-fb8a-4aba-9612-ff2cd2a411bc 00000020:00000080:1.0:1784191847.967459:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af107877000/8673fc11-fb8a-4aba-9612-ff2cd2a411bc for lustre-OST0000 00000020:00000080:1.0:1784191847.967539:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af107874800 for lustre-OST0000 00000100:00100000:1.0:1784191848.284615:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191848.284664:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191848.284703:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191848.284721:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191848.284744:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191848.284777:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812332032 00000100:00100000:1.0:1784191848.284789:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812332032 00000100:00100000:1.0:1784191848.284846:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 247 00000100:00100000:1.0:1784191848.284857:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812332032:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191848.284942:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812332032:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 87us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191848.284950:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 247 00000100:00100000:1.0:1784191848.284989:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812332160 00000100:00100000:1.0:1784191848.284993:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812332160 00000100:00100000:1.0:1784191848.285046:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812332288 00000100:00100000:1.0:1784191848.285050:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812332288 00000100:00100000:1.0:1784191848.285074:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 300 00000100:00100000:1.0:1784191848.285080:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812332160:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191848.285131:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812332160:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 51us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191848.285138:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 300 00000100:00100000:1.0:1784191848.285151:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 301 00000100:00100000:1.0:1784191848.285157:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812332288:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191848.285182:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812332288:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 25us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191848.285188:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 301 00000100:00100000:1.0:1784191848.285206:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812332416 00000100:00100000:1.0:1784191848.285209:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812332416 00000100:00100000:1.0:1784191848.285235:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812332544 00000100:00100000:1.0:1784191848.285276:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812332544 00000100:00100000:1.0:1784191848.286263:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 153 00000100:00100000:1.0:1784191848.286277:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69109:x1870858812332416:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191848.286342:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69109:x1870858812332416:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 70us (1742us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191848.286349:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 153 00000100:00100000:1.0:1784191848.286366:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 154 00000100:00100000:1.0:1784191848.286384:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812332544:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191848.286418:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812332544:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 45us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191848.286440:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 154 00000100:00080000:1.0:1784191848.302528:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784191848.302576:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784191848.302583:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784191848.302587:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784191848.524134:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191848.922140:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191848.922663:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812332672 00000100:00100000:3.0:1784191848.922678:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812332672 00000100:00100000:3.0:1784191848.922805:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 389 00000100:00100000:3.0:1784191848.922817:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:122829:x1870858812332672:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1784191848.922842:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191848.922868:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a590 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b62a expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191848.922953:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a597 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191848.922971:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191848.922988:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191848.923077:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784191848.923082:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784191848.923110:0:158667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191848.923140:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a590 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b62a expref: 7 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191848.923169:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a597 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b62a expref: 6 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191848.923180:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191848.923183:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784191848.923188:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7c200, rc 0) 00000100:00100000:3.0:1784191848.923287:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812332672:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 471us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191848.923295:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 389 00000100:00100000:3.0:1784191848.929152:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191848.929251:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812332800 00000100:00100000:2.0:1784191848.929275:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812332800 00000100:00100000:2.0:1784191848.929360:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 390 00000100:00100000:2.0:1784191848.929381:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812332800:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1784191848.929407:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191848.929441:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a59e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b631 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929558:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a5a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929577:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a5a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929593:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a5a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929609:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a5ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929616:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a5ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929622:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a5ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929675:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a5a5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929683:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a5a5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929737:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a5a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929746:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a5a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929752:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191848.929765:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a5a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929774:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a5a5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929790:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191848.929794:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191848.929800:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a5a5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929808:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a5a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929824:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a5ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929830:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a5ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929837:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a5ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929842:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191848.929845:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a5ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929852:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a5ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929860:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed36d805 (ffff8af202c46900) 00010000:00010000:2.0:1784191848.929862:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191848.929870:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a5ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929877:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a5ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929915:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a59e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b631 expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929926:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191848.929929:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191848.929933:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a59e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b631 expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191848.929943:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4200, rc 0) 00000100:00100000:2.0:1784191848.930026:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812332800:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 647us (889us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191848.930034:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 390 00000100:00100000:2.0:1784191848.940963:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191848.941424:0:158674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812332928 00000100:00100000:3.0:1784191848.941439:0:158674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812332928 00000100:00100000:3.0:1784191848.941517:0:158674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5 00000100:00100000:3.0:1784191848.941530:0:158674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:122829:x1870858812332928:12345-192.168.204.16@tcp:700:lfs.0 00000100:00100000:3.0:1784191848.941647:0:158674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:122829:x1870858812332928:12345-192.168.204.16@tcp:700:lfs.0 Request processed in 118us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191848.941656:0:158674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5 00000100:00100000:3.0:1784191848.967740:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191848.967921:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812333184 00000100:00100000:2.0:1784191848.967935:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812333184 00000100:00100000:2.0:1784191848.968014:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 391 00000100:00100000:2.0:1784191848.968025:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:122829:x1870858812333184:12345-192.168.204.16@tcp:36:lfs.0 00000100:00100000:2.0:1784191848.968175:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016be680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827877120:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191848.968241:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191848.968335:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1119a9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191848.974403:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827877120 00000100:00100000:0.0:1784191848.974422:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827877120 00000100:00100000:0.0:1784191848.974508:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1784191848.974520:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:161504:x1870858827877120:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191848.974678:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:161504:x1870858827877120:12345-0@lo:1000:mdt00_003.0 Request processed in 160us (6435us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191848.974685:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1784191848.975319:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016be680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827877120:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191848.989647:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827877248:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191848.989778:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191848.989844:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784191848.992762:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827877248 00000100:00100000:0.0:1784191848.992792:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827877248 00000100:00100000:0.0:1784191848.992897:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1784191848.992913:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:161504:x1870858827877248:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191848.993105:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:161504:x1870858827877248:12345-0@lo:1000:mdt00_003.0 Request processed in 196us (3327us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784191848.993113:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1784191848.993572:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827877248:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1784191848.993665:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191848.993677:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191848.993718:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191848.993744:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827877376:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1784191848.993801:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191848.993842:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784191848.999854:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827877376 00000100:00100000:0.0:1784191848.999876:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827877376 00000100:00100000:0.0:1784191848.999969:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1784191848.999982:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:161504:x1870858827877376:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1784191849.000013:0:161739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191849.000044:0:161739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a5ba lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a5b3 expref: -99 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.000112:0:161739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a597 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b62a expref: 5 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.000125:0:161739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a5ba lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a5b3 expref: 7 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.000186:0:161739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a597 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b62a expref: 5 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.000212:0:161739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a597 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b62a expref: 5 pid: 158667 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.000471:0:161739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf24700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827877504:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191849.000601:0:161739:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af20388de40 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.011631:0:161739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf24700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827877504:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191849.011756:0:161739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a5ba lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a5b3 expref: 7 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.011801:0:161739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.011805:0:161739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.011816:0:161739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a5ba lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a5b3 expref: 7 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.011830:0:161739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5800, rc 0) 00000100:00100000:2.0:1784191849.011940:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:161504:x1870858827877376:12345-0@lo:101:mdt00_003.0 Request processed in 11959us (18137us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.011951:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1784191849.012746:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827877376:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.012778:0:161504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a5ba expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.012794:0:161504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a5ba expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.014579:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191849.015058:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812333312 00000100:00100000:1.0:1784191849.015071:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812333312 00010000:00010000:1.0:1784191849.015131:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a597 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b62a expref: 6 pid: 158667 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.015204:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 88 00000100:00100000:1.0:1784191849.015218:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23f633850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812333312:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191849.015240:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191849.015249:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a597 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b62a expref: 6 pid: 158667 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.015266:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a597 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b62a expref: 6 pid: 158667 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.015296:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a597 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b62a expref: 6 pid: 158667 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.015321:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:1.0:1784191849.015330:0:158650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a5ba lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a5b3 expref: 6 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.015344:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a5ba lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a5b3 expref: 6 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.015356:0:158650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a5ba lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a5b3 expref: 6 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.015435:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a5ba lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a5b3 expref: 6 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.015452:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:158650:1870858827877632:0@lo:105: 00000100:00100000:1.0:1784191849.015522:0:158650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.015574:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.015772:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827877632 00000100:00100000:0.0:1784191849.015778:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827877632 00000100:00100000:0.0:1784191849.015937:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784191849.015948:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158650:x1870858827877632:12345-0@lo:105: 00010000:00010000:0.0:1784191849.015964:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a5ba expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.015978:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a5ba expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.015987:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a5ba expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.016010:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a5ba expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.016019:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a5ba expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.016029:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4a5ba expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.016054:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af20cd7f400) 00000100:00100000:0.0:1784191849.016120:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158650:x1870858827877632:12345-0@lo:105: Request processed in 173us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191849.016129:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1784191849.016346:0:161504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a5ba expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.016357:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a5ba expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191849.016403:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784191849.016455:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a5c1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.016464:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a5c1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.016474:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a5c1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.016497:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827877760:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1784191849.016539:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.016578:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827877760 00000100:00100000:1.0:1784191849.016585:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827877760 00000100:00100000:1.0:1784191849.016622:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1784191849.016629:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:161504:x1870858827877760:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.016663:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191849.016685:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4a5c8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a5c1 expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.016738:0:158671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4a5c8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a5c1 expref: 8 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.016753:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4a5c8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a5c1 expref: 8 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.016761:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed36d805 (ffff8af207498500) 00010000:00010000:1.0:1784191849.016764:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191849.016767:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7fc00, rc 0) 00000100:00100000:1.0:1784191849.017995:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:161504:x1870858827877760:12345-0@lo:101:mdt00_003.0 Request processed in 1356us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.018006:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1784191849.018056:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.018100:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827877760:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.018127:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a5c1 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a5c8 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.018142:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a5c1 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a5c8 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191849.019027:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1784191849.019121:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827877888:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.027069:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:158650:1870858827877632:0@lo:105: 00010000:00010000:3.0:1784191849.027117:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191849.027139:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.027343:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23f633850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812333312:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 12122us (12772us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.027367:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 88 00000100:00100000:1.0:1784191849.028472:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.037833:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827877888 00000100:00100000:0.0:1784191849.037858:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827877888 00000100:00100000:0.0:1784191849.037981:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1784191849.038319:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:161504:x1870858827877888:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.038506:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:161504:x1870858827877888:12345-0@lo:1000:mdt00_003.0 Request processed in 193us (11369us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191849.038515:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1784191849.039609:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827877888:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.039756:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827878016:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.040018:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.040061:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.040146:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827878016 00000100:00100000:2.0:1784191849.040163:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827878016 00000100:00100000:2.0:1784191849.040224:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1784191849.040234:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:161504:x1870858827878016:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.040357:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:161504:x1870858827878016:12345-0@lo:1000:mdt00_003.0 Request processed in 123us (339us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784191849.040374:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1784191849.040575:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827878016:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.040682:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827878144:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.040748:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.041727:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.041852:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827878144 00000100:00100000:3.0:1784191849.041862:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827878144 00000100:00100000:3.0:1784191849.041916:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1784191849.041927:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:161504:x1870858827878144:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.042070:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:161504:x1870858827878144:12345-0@lo:1000:mdt00_003.0 Request processed in 144us (1320us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784191849.042079:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1784191849.042121:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827878144:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.042207:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827878272:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.042242:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.042273:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.042463:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827878272 00000100:00100000:2.0:1784191849.042469:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827878272 00000100:00100000:2.0:1784191849.042511:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1784191849.042519:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:161504:x1870858827878272:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.042587:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:161504:x1870858827878272:12345-0@lo:1000:mdt00_003.0 Request processed in 68us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.042613:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:1.0:1784191849.043335:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827878272:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.043415:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827878400:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.043455:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.043485:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.043757:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827878400 00000100:00100000:2.0:1784191849.043764:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827878400 00000100:00100000:2.0:1784191849.043827:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1784191849.043836:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:161504:x1870858827878400:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.043940:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:161504:x1870858827878400:12345-0@lo:1000:mdt00_003.0 Request processed in 104us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.043948:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1784191849.044126:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827878400:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.044190:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827878528:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.044230:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.044251:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.044400:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827878528 00000100:00100000:3.0:1784191849.044404:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827878528 00000100:00100000:3.0:1784191849.044443:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1784191849.044450:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:161504:x1870858827878528:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.044518:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:161504:x1870858827878528:12345-0@lo:1000:mdt00_003.0 Request processed in 68us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.044525:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1784191849.044793:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827878528:0@lo:1000:mdt00_003.0 00080000:00000400:2.0:1784191849.046044:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 249 < left 336, rollback = 2 00080000:00000400:2.0:1784191849.046052:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/7, destroy: 0/0/0 00080000:00000400:2.0:1784191849.046054:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:2.0:1784191849.046056:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.046058:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/4, delete: 0/0/0 00080000:00000400:2.0:1784191849.046061:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191849.046127:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 248 < left 336, rollback = 2 00080000:00000400:2.0:1784191849.046131:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/7, destroy: 0/0/0 00080000:00000400:2.0:1784191849.046133:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:2.0:1784191849.046135:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.046137:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/5, delete: 0/0/0 00080000:00000400:2.0:1784191849.046139:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191849.046638:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 247 < left 336, rollback = 2 00080000:00000400:2.0:1784191849.046643:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/7, destroy: 0/0/0 00080000:00000400:2.0:1784191849.046645:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:2.0:1784191849.046647:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.046650:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/6, delete: 0/0/0 00080000:00000400:2.0:1784191849.046652:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191849.046673:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 247 < left 336, rollback = 2 00080000:00000400:2.0:1784191849.046676:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/7, destroy: 0/0/0 00080000:00000400:2.0:1784191849.046732:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:2.0:1784191849.046734:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.046736:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/6, delete: 0/0/0 00080000:00000400:2.0:1784191849.046737:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191849.046754:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 247 < left 336, rollback = 2 00080000:00000400:2.0:1784191849.046757:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/7, destroy: 0/0/0 00080000:00000400:2.0:1784191849.046758:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:2.0:1784191849.046761:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.046763:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/6, delete: 0/0/0 00080000:00000400:2.0:1784191849.046764:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191849.047500:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 247 < left 336, rollback = 2 00080000:00000400:2.0:1784191849.048036:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/7, destroy: 0/0/0 00080000:00000400:2.0:1784191849.048038:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:2.0:1784191849.048040:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.048042:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/6, delete: 0/0/0 00080000:00000400:2.0:1784191849.048045:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00000040:00080000:2.0:1784191849.050650:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002340:0x1:0x0].7, 2168 off41680 00000040:00080000:2.0:1784191849.052594:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab1:0x1:0x0].7, 2368 off42544 00000004:00080000:2.0:1784191849.052618:0:161504:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af2199ec480 with version 19 00000004:00080000:0.0:1784191849.056718:0:159400:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af10ef50540 version 19 rpc_version 19 00000020:00100000:2.0:1784191849.058397:0:159400:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784191849.058417:0:159400:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af10db45880 x1870858827878784/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784191849.058448:0:159400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db45880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827878784:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784191849.058547:0:159400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.058636:0:159400:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af202d61240 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.058704:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827878784 00000100:00100000:0.0:1784191849.058713:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827878784 00000100:00100000:0.0:1784191849.058961:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1784191849.058973:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:159400:x1870858827878784:12345-0@lo:1000:osp_up0-1.0 00080000:00000400:0.0:1784191849.059444:0:161739:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 253 < left 306, rollback = 2 00080000:00000400:0.0:1784191849.059468:0:161739:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:0.0:1784191849.059471:0:161739:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:0.0:1784191849.059473:0:161739:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/50/0, punch: 0/0/0, quota 1/3/2 00080000:00000400:0.0:1784191849.059476:0:161739:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/1, delete: 0/0/0 00080000:00000400:0.0:1784191849.059478:0:161739:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191849.059605:0:161739:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 251 < left 306, rollback = 2 00080000:00000400:0.0:1784191849.059608:0:161739:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:0.0:1784191849.059611:0:161739:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:0.0:1784191849.059612:0:161739:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/50/0, punch: 0/0/0, quota 1/3/2 00080000:00000400:0.0:1784191849.059627:0:161739:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/3, delete: 0/0/0 00080000:00000400:0.0:1784191849.059629:0:161739:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191849.059668:0:161739:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 249 < left 304, rollback = 2 00080000:00000400:0.0:1784191849.059671:0:161739:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:0.0:1784191849.059674:0:161739:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/2 00080000:00000400:0.0:1784191849.059675:0:161739:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/50/0, punch: 0/0/0, quota 1/3/2 00080000:00000400:0.0:1784191849.059677:0:161739:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/3, delete: 0/0/0 00080000:00000400:0.0:1784191849.059679:0:161739:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191849.061525:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:159400:x1870858827878784:12345-0@lo:1000:osp_up0-1.0 Request processed in 2544us (2967us total) trans 34359738621 rc 0/0 00000100:00100000:0.0:1784191849.061546:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1784191849.062111:0:159400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db45880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827878784:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1784191849.062505:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a5cf lrc: 3/0,1 mode: --/PW res: [0x240002343:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.062527:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a5cf lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.062556:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a5cf lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.062584:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a5d6 lrc: 3/0,1 mode: --/PW res: [0x240002340:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.062591:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a5d6 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.062596:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a5d6 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.062638:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e400/0xfeec3c2dc5a4a5dd lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.062645:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e400/0xfeec3c2dc5a4a5dd lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.062657:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e400/0xfeec3c2dc5a4a5dd lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.062680:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827878912:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1784191849.062767:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.063646:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.063968:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827878912 00000100:00100000:0.0:1784191849.063978:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827878912 00000100:00100000:2.0:1784191849.064419:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1784191849.064434:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:161504:x1870858827878912:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1784191849.064463:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191849.064507:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a5e4 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a5dd expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.065047:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a5e4 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a5dd expref: 10 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.065072:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a5e4 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a5dd expref: 10 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.065082:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x4:0x0].0x0 (ffff8af202c46900) 00010000:00010000:2.0:1784191849.065085:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.065090:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4800, rc 0) 00000100:00100000:2.0:1784191849.065266:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:161504:x1870858827878912:12345-0@lo:101:mdt00_003.0 Request processed in 835us (2498us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.065274:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1784191849.065590:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827878912:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1784191849.065617:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e400/0xfeec3c2dc5a4a5dd lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a5e4 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.065631:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e400/0xfeec3c2dc5a4a5dd lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a5e4 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191849.065666:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061f1c337 reply state 00000000938c14c4 transno 21474836527 ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a5d6 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.065964:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a5d6 lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.065973:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x4:0x0].0x0 (ffff8af207498d00) 00010000:00010000:3.0:1784191849.065976:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191849.065981:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784191849.066051:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e400/0xfeec3c2dc5a4a5dd lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a5e4 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.066062:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e400/0xfeec3c2dc5a4a5dd lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a5e4 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191849.066076:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0x4:0x0] 00000004:00010000:3.0:1784191849.066085:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061f1c337 reply state 00000000938c14c4 transno 21474836527 ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a5cf lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.066095:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a5cf lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.066101:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x1:0x0].0x0 (ffff8af207498800) 00010000:00010000:3.0:1784191849.066103:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191849.066105:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1784191849.066113:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x1:0x0]: returning size 4096 00000004:00080000:3.0:1784191849.066124:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1784191849.066133:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a5ba expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.066142:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a5ba expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.066328:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a5ba expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.066410:0:161504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1784191849.066418:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1784191849.066423:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a5c1 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a5c8 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.066430:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a5c1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a5c8 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.066547:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:122829:x1870858812333184:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 98521us (98820us total) trans 21474836527 rc 0/0 00000100:00100000:3.0:1784191849.066556:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 391 00010000:00010000:1.0:1784191849.066971:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191849.066981:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4a5ba expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.067056:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f400 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:1.0:1784191849.067062:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a5ba expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191849.067080:0:160901:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a5ba expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.067125:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a5ba expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.067132:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784191849.067214:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827879040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784191849.067438:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784191849.067508:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a5ba expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.067518:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5b3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a5ba expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.067536:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191849.067538:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191849.067540:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191849.067602:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827879040 00000100:00100000:3.0:1784191849.067610:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827879040 00000100:00100000:3.0:1784191849.067671:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784191849.067683:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:106499:x1870858827879040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784191849.067724:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191849.067753:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a5ba lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a5b3 expref: 10 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.067770:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191849.067787:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191849.073454:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:106499:x1870858827879040:12345-0@lo:103:ldlm_bl.0 Request processed in 5756us (5999us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.073500:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784191849.073664:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827879040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191849.096642:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191849.096823:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812333440 00000100:00100000:1.0:1784191849.096837:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812333440 00000100:00100000:1.0:1784191849.096921:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 392 00000100:00100000:1.0:1784191849.096934:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:122829:x1870858812333440:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1784191849.096963:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191849.097003:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b638 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.097094:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a5f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.097110:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.097147:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191849.097451:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784191849.097456:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784191849.097485:0:158665:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.097514:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a5eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b638 expref: 7 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.097543:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a5f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b638 expref: 6 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.097553:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:1.0:1784191849.097557:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784191849.097560:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7fa00, rc 0) 00000100:00100000:1.0:1784191849.097647:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812333440:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 716us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.097655:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 392 00000100:00100000:0.0:1784191849.107582:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191849.111147:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812333568 00000100:00100000:2.0:1784191849.114240:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812333568 00000100:00100000:2.0:1784191849.114370:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 393 00000100:00100000:2.0:1784191849.114383:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812333568:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1784191849.114415:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191849.114446:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a5f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b63f expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.114539:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a600 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.114575:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a600 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.114590:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a600 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.114607:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a607 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.114616:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.114622:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.114678:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a600 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.114704:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a600 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.114712:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a600 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.114719:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191849.114724:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a600 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.114733:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a600 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.114747:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.114756:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.114762:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a600 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.114768:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a600 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.114797:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.114972:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a607 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.115122:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a607 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.115132:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191849.115135:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a607 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.115142:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a607 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.115161:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x30d22c80 (ffff8af202c46600) 00010000:00010000:2.0:1784191849.115164:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.115167:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a607 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.115174:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a607 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.115214:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a5f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b63f expref: 7 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.115245:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.115248:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.115252:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a5f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b63f expref: 7 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.115262:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5a00, rc 0) 00000100:00100000:2.0:1784191849.115352:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812333568:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 970us (7786us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191849.115369:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 393 00000100:00100000:3.0:1784191849.117947:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191849.118287:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812333824 00000100:00100000:1.0:1784191849.118301:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812333824 00000100:00100000:1.0:1784191849.118392:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 394 00000100:00100000:1.0:1784191849.118404:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:122829:x1870858812333824:12345-192.168.204.16@tcp:36:lfs.0 00000100:00100000:1.0:1784191849.118580:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d788380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827879168:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.118648:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.118721:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.119021:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827879168 00000100:00100000:3.0:1784191849.119026:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827879168 00000100:00100000:3.0:1784191849.119074:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1784191849.119082:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:161504:x1870858827879168:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.119187:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:161504:x1870858827879168:12345-0@lo:1000:mdt00_003.0 Request processed in 105us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.119196:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1784191849.119449:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d788380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827879168:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.119519:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d788380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827879296:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.119561:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.119585:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.119971:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827879296 00000100:00100000:3.0:1784191849.119977:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827879296 00000100:00100000:3.0:1784191849.120246:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1784191849.120256:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:161504:x1870858827879296:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.120380:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:161504:x1870858827879296:12345-0@lo:1000:mdt00_003.0 Request processed in 125us (817us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784191849.120388:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1784191849.120460:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d788380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827879296:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1784191849.120539:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a60e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.120551:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a60e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.120562:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a60e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.120578:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d788380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827879424:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1784191849.120609:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.130177:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827879424 00000100:00100000:0.0:1784191849.130200:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827879424 00000100:00100000:3.0:1784191849.132246:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1784191849.132277:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:161504:x1870858827879424:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1784191849.132309:0:159636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191849.132451:0:159636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a615 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a60e expref: -99 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.132502:0:159636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a5f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b638 expref: 5 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.132515:0:159636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a615 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a60e expref: 10 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.132592:0:159636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a5f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b638 expref: 5 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.132612:0:159636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a5f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b638 expref: 5 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.132631:0:159636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233154000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:159636:1870858827879552:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191849.133491:0:159636:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.134096:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.140638:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191849.141941:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812333952 00000100:00100000:1.0:1784191849.141958:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812333952 00010000:00010000:1.0:1784191849.142023:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a5f2 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b638 expref: 6 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.142079:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 89 00000100:00100000:1.0:1784191849.142092:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812333952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191849.142114:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191849.142122:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a5f2 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b638 expref: 6 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.142171:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a5f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b638 expref: 6 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.142201:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:1.0:1784191849.142210:0:158651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a615 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a60e expref: 10 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.142223:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a615 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a60e expref: 10 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.142232:0:158651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a615 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a60e expref: 10 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.142276:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a615 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a60e expref: 10 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.142292:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:158651:1870858827879680:0@lo:105: 00000100:00100000:1.0:1784191849.142387:0:158651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.142440:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.142832:0:158648:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784191849.142849:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827879680 00000100:00100000:0.0:1784191849.142854:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827879680 00000100:00100000:0.0:1784191849.142909:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784191849.142918:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1014f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158651:x1870858827879680:12345-0@lo:105: 00010000:00010000:0.0:1784191849.142939:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a60e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a615 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.142949:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a60e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a615 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.142958:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a60e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a615 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.142966:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a60e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a615 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.142973:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a60e lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a615 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.142982:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a60e lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4a615 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.142998:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af20cd7f400) 00000100:00100000:0.0:1784191849.143053:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1014f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158651:x1870858827879680:12345-0@lo:105: Request processed in 135us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191849.143060:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784191849.145023:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:158651:1870858827879680:0@lo:105: 00010000:00010000:1.0:1784191849.145059:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191849.145165:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812333952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3072us (4538us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.145176:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 89 00010000:00010000:3.0:1784191849.149506:0:159636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a5f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b638 expref: 5 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.149556:0:159636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233154000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:159636:1870858827879552:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191849.149607:0:159636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a615 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a60e expref: 10 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.149619:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191849.149621:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191849.149625:0:159636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7c400, rc 0) 00000100:00100000:3.0:1784191849.149788:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:161504:x1870858827879424:12345-0@lo:101:mdt00_003.0 Request processed in 17526us (29177us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.149799:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1784191849.151786:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d788380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827879424:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.151856:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a60e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a615 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191849.151893:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784191849.151957:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4a61c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.151966:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4a61c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.151978:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4a61c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.152012:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d788380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827879808:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1784191849.152084:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.152133:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.152327:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827879808 00000100:00100000:0.0:1784191849.152336:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827879808 00000100:00100000:0.0:1784191849.152415:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1784191849.152427:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:161504:x1870858827879808:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1784191849.152448:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191849.152468:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4a623 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a61c expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.152512:0:158671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4a623 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a61c expref: 11 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.152540:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4a623 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a61c expref: 11 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.152550:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x30d22c80 (ffff8af2331f1f00) 00010000:00010000:0.0:1784191849.152554:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191849.152558:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4200, rc 0) 00000100:00100000:0.0:1784191849.152605:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:161504:x1870858827879808:12345-0@lo:101:mdt00_003.0 Request processed in 181us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191849.152611:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1784191849.153801:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d788380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827879808:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.155307:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4a61c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a623 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.155332:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4a61c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a623 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191849.155381:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1784191849.155462:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d788380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827879936:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.156919:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.156969:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.157311:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827879936 00000100:00100000:2.0:1784191849.157323:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827879936 00000100:00100000:2.0:1784191849.157401:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1784191849.157413:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:161504:x1870858827879936:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.157592:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:161504:x1870858827879936:12345-0@lo:1000:mdt00_003.0 Request processed in 181us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.157601:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1784191849.158179:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d788380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827879936:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.158285:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d788380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827880064:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.158336:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.158376:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.158621:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827880064 00000100:00100000:0.0:1784191849.158628:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827880064 00000100:00100000:0.0:1784191849.158681:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:0.0:1784191849.158731:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:161504:x1870858827880064:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.158867:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:161504:x1870858827880064:12345-0@lo:1000:mdt00_003.0 Request processed in 177us (530us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784191849.158875:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1784191849.159099:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d788380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827880064:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.159218:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827880192:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.159252:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.159307:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af202d61240 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.159470:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827880192 00000100:00100000:0.0:1784191849.159476:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827880192 00000100:00100000:0.0:1784191849.159507:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1784191849.159514:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:161504:x1870858827880192:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.159602:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:161504:x1870858827880192:12345-0@lo:1000:mdt00_003.0 Request processed in 86us (348us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784191849.159625:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1784191849.159746:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827880192:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.159826:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827880320:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.159852:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.159879:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af20dbf6240 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.160097:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827880320 00000100:00100000:3.0:1784191849.160102:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827880320 00000100:00100000:3.0:1784191849.160143:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1784191849.160159:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:161504:x1870858827880320:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.160241:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:161504:x1870858827880320:12345-0@lo:1000:mdt00_003.0 Request processed in 91us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.160248:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1784191849.160426:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827880320:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.160477:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827880448:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.160502:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.160526:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af20dbf6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.160658:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827880448 00000100:00100000:1.0:1784191849.160663:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827880448 00000100:00100000:1.0:1784191849.160735:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:1.0:1784191849.160744:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:161504:x1870858827880448:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.160930:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:161504:x1870858827880448:12345-0@lo:1000:mdt00_003.0 Request processed in 186us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.160937:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1784191849.161145:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827880448:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.161261:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827880576:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.161291:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.161314:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af20dbf6240 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.161370:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827880576 00000100:00100000:0.0:1784191849.161375:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827880576 00000100:00100000:0.0:1784191849.161409:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1784191849.161417:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:161504:x1870858827880576:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.161517:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:161504:x1870858827880576:12345-0@lo:1000:mdt00_003.0 Request processed in 101us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191849.161524:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1784191849.167022:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827880576:0@lo:1000:mdt00_003.0 00080000:00000400:2.0:1784191849.168425:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 258 < left 336, rollback = 2 00080000:00000400:2.0:1784191849.168436:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:2.0:1784191849.168439:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:2.0:1784191849.168441:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.168444:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/1, delete: 0/0/0 00080000:00000400:2.0:1784191849.168446:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191849.168546:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 257 < left 336, rollback = 2 00080000:00000400:2.0:1784191849.168550:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:2.0:1784191849.168552:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:2.0:1784191849.168554:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.168556:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/2, delete: 0/0/0 00080000:00000400:2.0:1784191849.168558:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191849.168953:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:2.0:1784191849.168956:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:2.0:1784191849.168958:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:2.0:1784191849.168960:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.168962:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:2.0:1784191849.168964:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191849.168991:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:2.0:1784191849.168993:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:2.0:1784191849.168995:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:2.0:1784191849.168997:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.168999:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:2.0:1784191849.169000:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191849.169008:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:2.0:1784191849.169010:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:2.0:1784191849.169012:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:2.0:1784191849.169014:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.169016:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:2.0:1784191849.169018:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191849.169049:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:2.0:1784191849.169052:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:2.0:1784191849.169054:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:2.0:1784191849.169056:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.169058:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:2.0:1784191849.169060:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00000040:00080000:2.0:1784191849.169134:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002340:0x1:0x0].8, 2168 off43848 00000040:00080000:2.0:1784191849.169220:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab1:0x1:0x0].8, 2368 off44912 00000004:00080000:2.0:1784191849.169228:0:161504:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af201442900 with version 20 00000004:00080000:3.0:1784191849.169313:0:159400:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af10ef50540 version 20 rpc_version 20 00000020:00100000:3.0:1784191849.169388:0:159400:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784191849.169401:0:159400:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af233154000 x1870858827880832/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191849.169431:0:159400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233154000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827880832:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784191849.169555:0:159400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.169610:0:159400:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.169754:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827880832 00000100:00100000:0.0:1784191849.169764:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827880832 00000100:00100000:0.0:1784191849.169849:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1784191849.169862:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:159400:x1870858827880832:12345-0@lo:1000:osp_up0-1.0 00080000:00000400:0.0:1784191849.170254:0:158671:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 292, rollback = 2 00080000:00000400:0.0:1784191849.170259:0:158671:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.170262:0:158671:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:0.0:1784191849.170264:0:158671:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/47/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.170267:0:158671:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/0, delete: 0/0/0 00080000:00000400:0.0:1784191849.170269:0:158671:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191849.170382:0:158671:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 292, rollback = 2 00080000:00000400:0.0:1784191849.170386:0:158671:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.170388:0:158671:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:0.0:1784191849.170389:0:158671:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/47/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.170391:0:158671:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/1, delete: 0/0/0 00080000:00000400:0.0:1784191849.170393:0:158671:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191849.170425:0:158671:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 292, rollback = 2 00080000:00000400:0.0:1784191849.170427:0:158671:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.170429:0:158671:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:0.0:1784191849.170431:0:158671:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/47/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.170448:0:158671:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/1, delete: 0/0/0 00080000:00000400:0.0:1784191849.170450:0:158671:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191849.170743:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:159400:x1870858827880832:12345-0@lo:1000:osp_up0-1.0 Request processed in 882us (1185us total) trans 34359738622 rc 0/0 00000100:00100000:0.0:1784191849.170755:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1784191849.171103:0:159400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233154000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827880832:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1784191849.171405:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a62a lrc: 3/0,1 mode: --/PW res: [0x240002343:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.171427:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a62a lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.171442:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a62a lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.171464:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4a631 lrc: 3/0,1 mode: --/PW res: [0x240002340:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.171471:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4a631 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.171477:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4a631 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.171514:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a638 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.171523:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a638 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.171603:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a638 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.171625:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf27480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827880960:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1784191849.171686:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.171742:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af21704e480 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.171817:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827880960 00000100:00100000:2.0:1784191849.171826:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827880960 00000100:00100000:2.0:1784191849.171881:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1784191849.171890:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:161504:x1870858827880960:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1784191849.171912:0:161739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191849.171934:0:161739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a63f lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a638 expref: -99 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.171973:0:161739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a63f lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a638 expref: 13 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.171987:0:161739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a63f lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a638 expref: 13 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.171998:0:161739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff8af202c46600) 00010000:00010000:2.0:1784191849.172001:0:161739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.172004:0:161739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5e00, rc 0) 00000100:00100000:2.0:1784191849.172053:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:161504:x1870858827880960:12345-0@lo:101:mdt00_003.0 Request processed in 163us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.172059:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:0.0:1784191849.172245:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf27480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827880960:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1784191849.172260:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a638 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a63f expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.172271:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a638 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a63f expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191849.172301:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a0f0eafd reply state 000000005cad2c53 transno 21474836528 ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4a631 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.172315:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4a631 lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.172322:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x5:0x0].0x0 (ffff8af2331f1b00) 00010000:00010000:0.0:1784191849.172325:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191849.172328:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191849.172334:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a638 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a63f expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.172342:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a638 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a63f expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191849.172353:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0x5:0x0] 00000004:00010000:0.0:1784191849.172368:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a0f0eafd reply state 000000005cad2c53 transno 21474836528 ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a62a lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.172376:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a62a lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.172393:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x2:0x0].0x0 (ffff8af2331f1a00) 00010000:00010000:0.0:1784191849.172395:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191849.172397:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1784191849.172404:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x2:0x0]: returning size 4096 00000004:00080000:0.0:1784191849.172414:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784191849.172426:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a60e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a615 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.172433:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a60e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a615 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.172439:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a60e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a615 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.172465:0:161504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1784191849.172470:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784191849.172475:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4a61c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a623 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.172482:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4a61c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a623 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.172793:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191849.172802:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a60e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4a615 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.172811:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f400 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:2.0:1784191849.172817:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a60e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a615 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191849.172826:0:158654:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a60e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a615 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.172859:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a60e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a615 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.172866:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191849.172907:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a60e lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a615 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.172915:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4a60e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a615 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.172933:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191849.172934:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191849.172936:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191849.172946:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784191849.172960:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827881088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784191849.173004:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.173090:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:122829:x1870858812333824:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 54684us (55152us total) trans 21474836528 rc 0/0 00000100:00100000:0.0:1784191849.173098:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 394 00000100:00100000:1.0:1784191849.173192:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827881088 00000100:00100000:1.0:1784191849.173198:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827881088 00000100:00100000:1.0:1784191849.173246:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784191849.173256:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+13:106499:x1870858827881088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191849.173269:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191849.173288:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a615 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a60e expref: 13 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.173305:0:160189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:1.0:1784191849.173309:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191849.173351:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:106499:x1870858827881088:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.173365:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784191849.174371:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827881088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191849.191320:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191849.191523:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812334080 00000100:00100000:2.0:1784191849.191539:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812334080 00000100:00100000:2.0:1784191849.191629:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 395 00000100:00100000:2.0:1784191849.191642:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:122829:x1870858812334080:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1784191849.191667:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191849.191730:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a646 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b646 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.191833:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a64d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.191852:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a64d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.191867:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a64d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191849.191933:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191849.191944:0:158666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191849.191972:0:158666:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a64d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.192002:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a646 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b646 expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.192024:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a64d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b646 expref: 6 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.192034:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.192038:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191849.192042:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5000, rc 0) 00000100:00100000:2.0:1784191849.192126:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812334080:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 487us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.192133:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 395 00000100:00100000:3.0:1784191849.204260:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191849.204516:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812334208 00000100:00100000:0.0:1784191849.204538:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812334208 00000100:00100000:0.0:1784191849.204605:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 396 00000100:00100000:0.0:1784191849.204616:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812334208:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1784191849.204640:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191849.204670:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a654 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b64d expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.204942:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a65b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.204959:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a65b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.204972:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a65b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.204992:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a662 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.205000:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.205008:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.205053:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a65b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.205061:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a65b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.205086:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a65b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.205187:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191849.205192:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a65b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.205200:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a65b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.205214:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:0.0:1784191849.205217:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191849.205222:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a65b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.205228:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a65b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.205244:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.205250:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a662 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.205257:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.205261:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191849.205264:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.205364:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a662 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.205374:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc86efa78 (ffff8af2331f1000) 00010000:00010000:0.0:1784191849.205377:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191849.205380:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a662 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.205386:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4a662 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.205421:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a654 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b64d expref: 7 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.205433:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:0.0:1784191849.205435:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191849.205439:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4a654 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b64d expref: 7 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.205450:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5800, rc 0) 00000100:00100000:0.0:1784191849.205527:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812334208:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 911us (1276us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191849.205535:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 396 00000100:00100000:3.0:1784191849.216061:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191849.216191:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812334464 00000100:00100000:0.0:1784191849.216202:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812334464 00000100:00100000:0.0:1784191849.216272:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 397 00000100:00100000:0.0:1784191849.216292:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:122829:x1870858812334464:12345-192.168.204.16@tcp:36:lfs.0 00000100:00100000:0.0:1784191849.216458:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827881216:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.216540:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.216574:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af109911600 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.216843:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827881216 00000100:00100000:1.0:1784191849.216848:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827881216 00000100:00100000:1.0:1784191849.216887:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1784191849.216894:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:161504:x1870858827881216:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.216978:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:161504:x1870858827881216:12345-0@lo:1000:mdt00_003.0 Request processed in 84us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.216986:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1784191849.217999:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827881216:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.218076:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827881344:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.218419:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.218450:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.218517:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827881344 00000100:00100000:2.0:1784191849.218532:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827881344 00000100:00100000:2.0:1784191849.218617:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1784191849.218628:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:161504:x1870858827881344:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.218852:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:161504:x1870858827881344:12345-0@lo:1000:mdt00_003.0 Request processed in 226us (433us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784191849.218861:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1784191849.219038:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827881344:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1784191849.219122:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.219135:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.219147:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.219177:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827881472:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1784191849.219237:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.219275:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.219544:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827881472 00000100:00100000:1.0:1784191849.219550:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827881472 00000100:00100000:1.0:1784191849.219591:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1784191849.219599:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:161504:x1870858827881472:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.219612:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191849.219633:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a670 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a669 expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.219666:0:158670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a64d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b646 expref: 5 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.219680:0:158670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a670 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a669 expref: 13 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.219731:0:158670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a64d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b646 expref: 5 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.219748:0:158670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a64d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b646 expref: 5 pid: 158666 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.219762:0:158670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d788380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:158670:1870858827881600:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191849.219914:0:158670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.225463:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191849.225744:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812334592 00000100:00100000:2.0:1784191849.225757:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812334592 00010000:00010000:2.0:1784191849.225825:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a64d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b646 expref: 6 pid: 158666 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191849.225885:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 90 00000100:00100000:2.0:1784191849.225919:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812334592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191849.225941:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191849.225949:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a64d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b646 expref: 6 pid: 158666 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.225966:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a64d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b646 expref: 6 pid: 158666 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.225996:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.226004:0:158650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a670 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a669 expref: 13 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.226020:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a670 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a669 expref: 13 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.226030:0:158650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a670 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a669 expref: 13 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.226075:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a670 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a669 expref: 13 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191849.226092:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdb9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:158650:1870858827881728:0@lo:105: 00000100:00100000:2.0:1784191849.226160:0:158650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.226213:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af104f1e600 going to sleep for 11 seconds 00010000:00010000:1.0:1784191849.228390:0:158670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a64d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b646 expref: 6 pid: 158666 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.228454:0:158670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d788380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:158670:1870858827881600:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191849.228498:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a670 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a669 expref: 13 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.228510:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:1.0:1784191849.228513:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191849.228516:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e200, rc 0) 00000100:00100000:1.0:1784191849.228611:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:161504:x1870858827881472:12345-0@lo:101:mdt00_003.0 Request processed in 9011us (9382us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.228622:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1784191849.229012:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827881472:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1784191849.229038:0:161504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a670 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.229052:0:161504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a670 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.229965:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827881728 00000100:00100000:3.0:1784191849.229977:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827881728 00000100:00100000:3.0:1784191849.230050:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784191849.230062:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158650:x1870858827881728:12345-0@lo:105: 00010000:00010000:3.0:1784191849.230077:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a670 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.230088:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a670 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.230098:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a670 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.230107:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a670 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.230127:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a670 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.230137:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4a670 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.230178:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af10b5e5800) 00010000:00010000:0.0:1784191849.230509:0:161504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a670 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.230520:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a670 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191849.230558:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784191849.230615:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4800/0xfeec3c2dc5a4a677 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.230622:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4800/0xfeec3c2dc5a4a677 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.230633:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4800/0xfeec3c2dc5a4a677 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.230658:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827881856:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1784191849.230757:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.232575:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158650:x1870858827881728:12345-0@lo:105: Request processed in 2505us (6404us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.232592:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784191849.233057:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdb9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:158650:1870858827881728:0@lo:105: 00010000:00010000:1.0:1784191849.233088:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191849.233163:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69109:x1870858812334592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7246us (7715us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.233173:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 90 00000100:00100000:0.0:1784191849.237544:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.238397:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827881856 00000100:00100000:1.0:1784191849.238412:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827881856 00000100:00100000:1.0:1784191849.238504:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1784191849.238517:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:161504:x1870858827881856:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.238545:0:161739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191849.238579:0:161739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a67e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a677 expref: -99 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.238619:0:161739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a67e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a677 expref: 14 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.238664:0:161739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a67e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a677 expref: 14 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.238674:0:161739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc86efa78 (ffff8af207498c00) 00010000:00010000:1.0:1784191849.238677:0:161739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191849.238682:0:161739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f200, rc 0) 00000100:00100000:1.0:1784191849.238820:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:161504:x1870858827881856:12345-0@lo:101:mdt00_003.0 Request processed in 305us (8063us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.238827:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1784191849.239158:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827881856:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1784191849.239186:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4800/0xfeec3c2dc5a4a677 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a67e expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.239209:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4800/0xfeec3c2dc5a4a677 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a67e expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191849.239250:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1784191849.239331:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827881984:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.239413:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.239458:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.239732:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827881984 00000100:00100000:1.0:1784191849.239740:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827881984 00000100:00100000:1.0:1784191849.239792:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1784191849.239801:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:161504:x1870858827881984:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.239907:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:161504:x1870858827881984:12345-0@lo:1000:mdt00_003.0 Request processed in 106us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.239915:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1784191849.240100:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827881984:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.240162:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827882112:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.240209:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.240237:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af104f1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.240580:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827882112 00000100:00100000:0.0:1784191849.240586:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827882112 00000100:00100000:0.0:1784191849.240633:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1784191849.240641:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:161504:x1870858827882112:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.240768:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:161504:x1870858827882112:12345-0@lo:1000:mdt00_003.0 Request processed in 128us (558us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784191849.240776:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1784191849.241864:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827882112:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.242008:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827882240:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.242062:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.242097:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af104f1ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.242176:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827882240 00000100:00100000:0.0:1784191849.242182:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827882240 00000100:00100000:0.0:1784191849.242413:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1784191849.242425:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:161504:x1870858827882240:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.242532:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:161504:x1870858827882240:12345-0@lo:1000:mdt00_003.0 Request processed in 109us (468us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784191849.242540:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1784191849.242604:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827882240:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.242657:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827882368:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.242682:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.250891:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af104f1e600 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.254908:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827882368 00000100:00100000:3.0:1784191849.254933:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827882368 00000100:00100000:3.0:1784191849.255035:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1784191849.255047:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:161504:x1870858827882368:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.255752:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:161504:x1870858827882368:12345-0@lo:1000:mdt00_003.0 Request processed in 703us (13065us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.255763:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:2.0:1784191849.260809:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827882368:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.262392:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b85c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827882496:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.262494:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.262551:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af104f1ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.262871:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827882496 00000100:00100000:1.0:1784191849.262881:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827882496 00000100:00100000:1.0:1784191849.263018:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1784191849.263030:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:161504:x1870858827882496:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.263182:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:161504:x1870858827882496:12345-0@lo:1000:mdt00_003.0 Request processed in 154us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.263191:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1784191849.263292:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b85c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827882496:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.263384:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b85c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827882624:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.263418:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.268135:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af104f1e600 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.271110:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827882624 00000100:00100000:3.0:1784191849.271133:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827882624 00000100:00100000:3.0:1784191849.271218:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1784191849.271231:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:161504:x1870858827882624:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.271638:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:161504:x1870858827882624:12345-0@lo:1000:mdt00_003.0 Request processed in 409us (8218us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.271646:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1784191849.277672:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b85c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827882624:0@lo:1000:mdt00_003.0 00080000:00000400:2.0:1784191849.285083:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 259 < left 336, rollback = 2 00080000:00000400:2.0:1784191849.285099:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:2.0:1784191849.285102:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:2.0:1784191849.285104:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.285107:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/1, delete: 0/0/0 00080000:00000400:2.0:1784191849.285122:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191849.285277:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 258 < left 336, rollback = 2 00080000:00000400:2.0:1784191849.285280:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:2.0:1784191849.285283:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:2.0:1784191849.285284:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.285286:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/2, delete: 0/0/0 00080000:00000400:2.0:1784191849.285288:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191849.286136:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:2.0:1784191849.286141:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:2.0:1784191849.286143:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:2.0:1784191849.286145:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.286148:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/4, delete: 0/0/0 00080000:00000400:2.0:1784191849.286150:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191849.286177:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:2.0:1784191849.286180:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:2.0:1784191849.286182:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:2.0:1784191849.286184:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.286186:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/4, delete: 0/0/0 00080000:00000400:2.0:1784191849.286188:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191849.286198:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:2.0:1784191849.286201:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:2.0:1784191849.286203:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:2.0:1784191849.286205:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.286207:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/4, delete: 0/0/0 00080000:00000400:2.0:1784191849.286209:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191849.286243:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:2.0:1784191849.286247:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:2.0:1784191849.286249:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:2.0:1784191849.286251:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.286253:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/4, delete: 0/0/0 00080000:00000400:2.0:1784191849.286255:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00000040:00080000:3.0:1784191849.291635:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002340:0x1:0x0].9, 2168 off46016 00000040:00080000:3.0:1784191849.292129:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab1:0x1:0x0].9, 2368 off47280 00000004:00080000:3.0:1784191849.292157:0:161504:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af1119a9c00 with version 21 00000004:00080000:2.0:1784191849.294972:0:159400:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af10ef50540 version 21 rpc_version 21 00000020:00100000:3.0:1784191849.298039:0:159400:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784191849.298065:0:159400:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af233155500 x1870858827882880/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191849.298100:0:159400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233155500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827882880:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784191849.298212:0:159400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.298349:0:159400:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.301510:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827882880 00000100:00100000:2.0:1784191849.301558:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827882880 00000100:00100000:3.0:1784191849.303492:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1784191849.303520:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:159400:x1870858827882880:12345-0@lo:1000:osp_up0-1.0 00080000:00000400:3.0:1784191849.304896:0:161739:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 292, rollback = 2 00080000:00000400:3.0:1784191849.304906:0:161739:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191849.304909:0:161739:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:3.0:1784191849.304912:0:161739:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/50/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191849.304914:0:161739:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/0, delete: 0/0/0 00080000:00000400:3.0:1784191849.304916:0:161739:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191849.305091:0:161739:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 292, rollback = 2 00080000:00000400:3.0:1784191849.305094:0:161739:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191849.305096:0:161739:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:3.0:1784191849.305099:0:161739:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/50/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191849.305101:0:161739:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/1, delete: 0/0/0 00080000:00000400:3.0:1784191849.305103:0:161739:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191849.305138:0:161739:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 292, rollback = 2 00080000:00000400:3.0:1784191849.305141:0:161739:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191849.305143:0:161739:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:3.0:1784191849.305145:0:161739:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/50/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191849.305147:0:161739:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/1, delete: 0/0/0 00080000:00000400:3.0:1784191849.305149:0:161739:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00000100:00100000:3.0:1784191849.305550:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:159400:x1870858827882880:12345-0@lo:1000:osp_up0-1.0 Request processed in 2040us (7333us total) trans 34359738623 rc 0/0 00000100:00100000:3.0:1784191849.305575:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1784191849.308958:0:159400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233155500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827882880:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1784191849.309250:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a685 lrc: 3/0,1 mode: --/PW res: [0x240002343:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.309270:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a685 lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.309285:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a685 lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.309308:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4a68c lrc: 3/0,1 mode: --/PW res: [0x240002340:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.309316:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4a68c lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.309322:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4a68c lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.309382:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7ca00/0xfeec3c2dc5a4a693 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.309390:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7ca00/0xfeec3c2dc5a4a693 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.309401:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7ca00/0xfeec3c2dc5a4a693 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.309426:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233156300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827883008:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1784191849.309514:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.309618:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.312433:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827883008 00000100:00100000:1.0:1784191849.312458:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827883008 00000100:00100000:1.0:1784191849.312548:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1784191849.312580:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af205713c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:161504:x1870858827883008:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.312616:0:159636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191849.312646:0:159636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4a69a lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a693 expref: -99 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.312685:0:159636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4a69a lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a693 expref: 16 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.312938:0:159636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4a69a lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a693 expref: 16 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.312948:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x6:0x0].0x0 (ffff8af207498300) 00010000:00010000:1.0:1784191849.312951:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191849.312955:0:159636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e600, rc 0) 00000100:00100000:1.0:1784191849.313121:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af205713c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:161504:x1870858827883008:12345-0@lo:101:mdt00_003.0 Request processed in 544us (3606us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.313129:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1784191849.316966:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233156300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827883008:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1784191849.317012:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7ca00/0xfeec3c2dc5a4a693 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a69a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.317032:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7ca00/0xfeec3c2dc5a4a693 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a69a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191849.317072:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b89c604c reply state 00000000e6d7ce3a transno 21474836529 ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4a68c lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.317089:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4a68c lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.317098:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x6:0x0].0x0 (ffff8af216636500) 00010000:00010000:3.0:1784191849.317102:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191849.317106:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784191849.317114:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7ca00/0xfeec3c2dc5a4a693 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a69a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.317122:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7ca00/0xfeec3c2dc5a4a693 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a69a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191849.317137:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0x6:0x0] 00000004:00010000:3.0:1784191849.317149:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b89c604c reply state 00000000e6d7ce3a transno 21474836529 ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a685 lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.317157:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a685 lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.317162:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x3:0x0].0x0 (ffff8af216636400) 00010000:00010000:3.0:1784191849.317189:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191849.317191:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1784191849.317199:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x3:0x0]: returning size 4096 00000004:00080000:3.0:1784191849.317213:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1784191849.317228:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a670 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.317237:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a670 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.317244:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a670 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.317363:0:161504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1784191849.317368:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1784191849.317373:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4800/0xfeec3c2dc5a4a677 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a67e expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.317380:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4800/0xfeec3c2dc5a4a677 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a67e expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.317512:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:122829:x1870858812334464:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 101228us (101459us total) trans 21474836529 rc 0/0 00000100:00100000:3.0:1784191849.317524:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 397 00010000:00010000:1.0:1784191849.321436:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191849.321456:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4a670 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.321472:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5800 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:1.0:1784191849.321481:0:158653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a670 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191849.321497:0:158653:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a670 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.321866:0:158653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a670 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.321874:0:158653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784191849.321951:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827883136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191849.322046:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784191849.322125:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a670 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.322135:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a669 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a670 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.322157:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191849.322160:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191849.322162:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191849.322236:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827883136 00000100:00100000:2.0:1784191849.322246:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827883136 00000100:00100000:2.0:1784191849.322329:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784191849.322340:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+16:106501:x1870858827883136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191849.322366:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191849.322393:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a670 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a669 expref: 16 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.322413:0:160189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.322420:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191849.326293:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191849.326561:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+15:106501:x1870858827883136:12345-0@lo:103:ldlm_bl.0 Request processed in 4219us (4510us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.326580:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784191849.326626:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812334720 00000100:00100000:2.0:1784191849.326637:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812334720 00000100:00100000:2.0:1784191849.326727:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 398 00000100:00100000:2.0:1784191849.326738:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:122829:x1870858812334720:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1784191849.326764:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191849.326790:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a6a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b654 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.326882:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a6a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.326901:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.326916:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191849.326991:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191849.326996:0:158666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191849.327023:0:158666:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.327052:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a6a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b654 expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.327072:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a6a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b654 expref: 6 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.327082:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.327086:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191849.327089:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5200, rc 0) 00000100:00100000:2.0:1784191849.327273:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812334720:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 536us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.327280:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 398 00000100:00100000:0.0:1784191849.331622:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827883136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784191849.335601:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191849.335867:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812334848 00000100:00100000:0.0:1784191849.335882:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812334848 00000100:00100000:0.0:1784191849.335968:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 399 00000100:00100000:0.0:1784191849.335982:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812334848:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1784191849.336032:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191849.336064:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a6af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b65b expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336165:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5600/0xfeec3c2dc5a4a6b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336184:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5600/0xfeec3c2dc5a4a6b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336198:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5600/0xfeec3c2dc5a4a6b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336215:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a6bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336222:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a6bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336228:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a6bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336411:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5600/0xfeec3c2dc5a4a6b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336420:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5600/0xfeec3c2dc5a4a6b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336427:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5600/0xfeec3c2dc5a4a6b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336434:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191849.336455:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5600/0xfeec3c2dc5a4a6b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336463:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5600/0xfeec3c2dc5a4a6b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336478:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:0.0:1784191849.336481:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191849.336486:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5600/0xfeec3c2dc5a4a6b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336493:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5600/0xfeec3c2dc5a4a6b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336508:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a6bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336514:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a6bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336520:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a6bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336526:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191849.336529:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a6bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336535:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a6bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336552:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4c99ad (ffff8af2331f1d00) 00010000:00010000:0.0:1784191849.336554:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191849.336566:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a6bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336572:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a6bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336614:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a6af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b65b expref: 7 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336626:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:0.0:1784191849.336628:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191849.336632:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a6af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b65b expref: 7 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.336642:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5a00, rc 0) 00000100:00100000:0.0:1784191849.337071:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812334848:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1090us (1492us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191849.337080:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 399 00000100:00100000:3.0:1784191849.345486:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191849.353264:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812335104 00000100:00100000:2.0:1784191849.354352:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812335104 00000100:00100000:3.0:1784191849.359451:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 400 00000100:00100000:3.0:1784191849.359470:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:122829:x1870858812335104:12345-192.168.204.16@tcp:36:lfs.0 00000100:00100000:3.0:1784191849.359800:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233155880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827883264:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.360056:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.360127:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.360163:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827883264 00000100:00100000:1.0:1784191849.360176:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827883264 00000100:00100000:1.0:1784191849.360239:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:1.0:1784191849.360251:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:161504:x1870858827883264:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.360537:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:161504:x1870858827883264:12345-0@lo:1000:mdt00_003.0 Request processed in 278us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.360549:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:3.0:1784191849.360766:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233155880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827883264:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.360839:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233155880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827883392:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.360873:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.360900:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.360985:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827883392 00000100:00100000:0.0:1784191849.360991:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827883392 00000100:00100000:0.0:1784191849.361036:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1784191849.361045:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:161504:x1870858827883392:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.361135:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:161504:x1870858827883392:12345-0@lo:1000:mdt00_003.0 Request processed in 92us (262us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784191849.361142:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:3.0:1784191849.361396:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233155880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827883392:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1784191849.361455:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.361468:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.361478:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.361491:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233155880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827883520:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1784191849.361519:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.361908:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.361971:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827883520 00000100:00100000:1.0:1784191849.361979:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827883520 00000100:00100000:1.0:1784191849.362097:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1784191849.362109:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:161504:x1870858827883520:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.362127:0:161739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191849.362164:0:161739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4a6cb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a6c4 expref: -99 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.362226:0:161739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a6a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b654 expref: 5 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.362237:0:161739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4a6cb lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a6c4 expref: 16 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.362269:0:161739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a6a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b654 expref: 5 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.364452:0:161739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a6a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b654 expref: 5 pid: 158666 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.364482:0:161739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78b800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827883648:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191849.364676:0:161739:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.370518:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191849.370800:0:161739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78b800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827883648:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191849.370858:0:161739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4a6cb lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a6c4 expref: 16 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.370876:0:161739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191849.370879:0:161739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191849.370884:0:161739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4a6cb lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a6c4 expref: 16 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.370922:0:161739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ea00, rc 0) 00000100:00100000:3.0:1784191849.371027:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:161504:x1870858827883520:12345-0@lo:101:mdt00_003.0 Request processed in 8918us (9506us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.371038:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:2.0:1784191849.372478:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233155880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827883520:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1784191849.372514:0:161504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a6cb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.372541:0:161504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a6cb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.375401:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812335232 00000100:00100000:0.0:1784191849.375424:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812335232 00010000:00010000:0.0:1784191849.375497:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a6a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b654 expref: 6 pid: 158666 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.376314:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 91 00000100:00100000:0.0:1784191849.376329:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69110:x1870858812335232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191849.376351:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191849.376372:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a6a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b654 expref: 6 pid: 158666 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.376389:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a6a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b654 expref: 6 pid: 158666 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.376421:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a6a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b654 expref: 6 pid: 158666 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.376444:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:0.0:1784191849.376452:0:158651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4a6cb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a6c4 expref: 15 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.376466:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4a6cb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a6c4 expref: 15 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.376476:0:158651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4a6cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a6c4 expref: 15 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.376542:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4a6cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a6c4 expref: 15 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.376561:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:158651:1870858827883776:0@lo:105: 00000100:00100000:0.0:1784191849.376665:0:158651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.376771:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6a540 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.378617:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827883776 00000100:00100000:3.0:1784191849.378634:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827883776 00000100:00100000:3.0:1784191849.378774:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784191849.378787:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158651:x1870858827883776:12345-0@lo:105: 00010000:00010000:3.0:1784191849.378809:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a6cb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.378822:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a6cb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.378833:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a6cb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.378843:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a6cb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.378852:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a6cb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.378863:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4a6cb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.378920:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af223b7de00) 00000100:00100000:3.0:1784191849.379024:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158651:x1870858827883776:12345-0@lo:105: Request processed in 240us (2359us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.379034:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1784191849.379044:0:161504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a6cb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.379058:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a6cb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191849.379095:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784191849.379158:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f800/0xfeec3c2dc5a4a6d2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.379166:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f800/0xfeec3c2dc5a4a6d2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.379191:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f800/0xfeec3c2dc5a4a6d2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.379214:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827883904:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1784191849.379257:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.379293:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.379508:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827883904 00000100:00100000:3.0:1784191849.379516:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827883904 00000100:00100000:3.0:1784191849.379568:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1784191849.379576:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:161504:x1870858827883904:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1784191849.379598:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191849.379619:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4a6d9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a6d2 expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.379645:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4a6d9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a6d2 expref: 17 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.379666:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4a6d9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a6d2 expref: 17 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.379675:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4c99ad (ffff8af216636000) 00010000:00010000:3.0:1784191849.379678:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191849.379682:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7d000, rc 0) 00000100:00100000:3.0:1784191849.379760:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+17:161504:x1870858827883904:12345-0@lo:101:mdt00_003.0 Request processed in 184us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.379776:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:1.0:1784191849.379826:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827883904:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.379844:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f800/0xfeec3c2dc5a4a6d2 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a6d9 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.379855:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f800/0xfeec3c2dc5a4a6d2 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a6d9 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191849.379872:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1784191849.379964:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827884032:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.379992:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.380012:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1780 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.380139:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:158651:1870858827883776:0@lo:105: 00010000:00010000:0.0:1784191849.380385:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191849.380449:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812335232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4121us (9942us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191849.380459:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 91 00000100:00100000:3.0:1784191849.381759:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827884032 00000100:00100000:3.0:1784191849.381973:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827884032 00000100:00100000:3.0:1784191849.382067:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1784191849.382078:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:161504:x1870858827884032:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.382610:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:161504:x1870858827884032:12345-0@lo:1000:mdt00_003.0 Request processed in 533us (2615us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.382620:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1784191849.389992:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827884032:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.392506:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233154e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827884160:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.392629:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.393579:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.403909:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827884160 00000100:00100000:1.0:1784191849.403932:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827884160 00000100:00100000:1.0:1784191849.404037:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1784191849.404050:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:161504:x1870858827884160:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.405416:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:161504:x1870858827884160:12345-0@lo:1000:mdt00_003.0 Request processed in 1362us (12781us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784191849.405432:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1784191849.410132:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233154e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827884160:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.410351:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827884288:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.410449:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.410482:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6a180 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.411937:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827884288 00000100:00100000:1.0:1784191849.411953:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827884288 00000100:00100000:1.0:1784191849.412065:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1784191849.412077:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:161504:x1870858827884288:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.412342:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:161504:x1870858827884288:12345-0@lo:1000:mdt00_003.0 Request processed in 266us (1892us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784191849.412363:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1784191849.413004:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827884288:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.413126:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827884416:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.413253:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.413362:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6a180 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.413422:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827884416 00000100:00100000:3.0:1784191849.413429:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827884416 00000100:00100000:3.0:1784191849.413481:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1784191849.413491:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+17:161504:x1870858827884416:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.413592:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+17:161504:x1870858827884416:12345-0@lo:1000:mdt00_003.0 Request processed in 103us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.413600:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1784191849.414263:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827884416:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.414669:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827884544:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.415472:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.415554:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6a180 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.419861:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827884544 00000100:00100000:1.0:1784191849.419878:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827884544 00000100:00100000:1.0:1784191849.420096:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:1.0:1784191849.420108:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:161504:x1870858827884544:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.420258:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:161504:x1870858827884544:12345-0@lo:1000:mdt00_003.0 Request processed in 153us (4788us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.420265:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1784191849.420514:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827884544:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.420646:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827884672:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.420780:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.420819:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6a180 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.421485:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827884672 00000100:00100000:3.0:1784191849.421494:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827884672 00000100:00100000:3.0:1784191849.421560:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1784191849.421571:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:161504:x1870858827884672:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.421680:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:161504:x1870858827884672:12345-0@lo:1000:mdt00_003.0 Request processed in 110us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.421706:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1784191849.422379:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827884672:0@lo:1000:mdt00_003.0 00080000:00000400:0.0:1784191849.423205:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 259 < left 336, rollback = 2 00080000:00000400:0.0:1784191849.423212:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.423215:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:0.0:1784191849.423216:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.423218:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/1, delete: 0/0/0 00080000:00000400:0.0:1784191849.423220:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191849.423297:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 258 < left 336, rollback = 2 00080000:00000400:0.0:1784191849.423300:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.423302:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:0.0:1784191849.423304:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.423306:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/2, delete: 0/0/0 00080000:00000400:0.0:1784191849.423308:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191849.423494:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 257 < left 336, rollback = 2 00080000:00000400:0.0:1784191849.423498:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.423500:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:0.0:1784191849.423502:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.423504:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:0.0:1784191849.423506:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191849.423524:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 257 < left 336, rollback = 2 00080000:00000400:0.0:1784191849.423527:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.423529:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:0.0:1784191849.423531:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.423534:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:0.0:1784191849.423536:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191849.423545:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 257 < left 336, rollback = 2 00080000:00000400:0.0:1784191849.423547:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.423549:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:0.0:1784191849.423551:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.423553:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:0.0:1784191849.423555:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191849.423583:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 257 < left 336, rollback = 2 00080000:00000400:0.0:1784191849.423586:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.423594:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:0.0:1784191849.423596:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.423598:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:0.0:1784191849.423600:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00000040:00080000:0.0:1784191849.423721:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002340:0x1:0x0].10, 2168 off48184 00000040:00080000:0.0:1784191849.423816:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab1:0x1:0x0].10, 2368 off49648 00000004:00080000:0.0:1784191849.423824:0:161504:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af227a6a540 with version 22 00000004:00080000:3.0:1784191849.425729:0:159400:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af10ef50540 version 22 rpc_version 22 00000020:00100000:3.0:1784191849.425801:0:159400:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784191849.425816:0:159400:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af233157480 x1870858827884928/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191849.425849:0:159400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233157480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827884928:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784191849.425971:0:159400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.426029:0:159400:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.426252:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827884928 00000100:00100000:1.0:1784191849.426263:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827884928 00000100:00100000:1.0:1784191849.426348:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:1.0:1784191849.426368:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:159400:x1870858827884928:12345-0@lo:1000:osp_up0-1.0 00080000:00000400:1.0:1784191849.426821:0:161739:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 292, rollback = 2 00080000:00000400:1.0:1784191849.426827:0:161739:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191849.426830:0:161739:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:1.0:1784191849.426833:0:161739:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/50/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.426836:0:161739:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/0, delete: 0/0/0 00080000:00000400:1.0:1784191849.426838:0:161739:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191849.426992:0:161739:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 258 < left 292, rollback = 2 00080000:00000400:1.0:1784191849.426996:0:161739:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191849.426998:0:161739:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:1.0:1784191849.426999:0:161739:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/50/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.427002:0:161739:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/1, delete: 0/0/0 00080000:00000400:1.0:1784191849.427004:0:161739:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191849.427183:0:161739:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 258 < left 292, rollback = 2 00080000:00000400:1.0:1784191849.427187:0:161739:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191849.427188:0:161739:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:1.0:1784191849.427190:0:161739:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/50/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.427193:0:161739:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/1, delete: 0/0/0 00080000:00000400:1.0:1784191849.427195:0:161739:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00000100:00100000:1.0:1784191849.427506:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:159400:x1870858827884928:12345-0@lo:1000:osp_up0-1.0 Request processed in 1138us (1534us total) trans 34359738624 rc 0/0 00000100:00100000:1.0:1784191849.427517:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:0.0:1784191849.428049:0:159400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233157480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827884928:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1784191849.433036:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4a6e0 lrc: 3/0,1 mode: --/PW res: [0x240002343:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.433064:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4a6e0 lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.433078:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4a6e0 lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.433105:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4a6e7 lrc: 3/0,1 mode: --/PW res: [0x240002340:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.433112:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4a6e7 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.433119:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4a6e7 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.433168:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7d800/0xfeec3c2dc5a4a6ee lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.433176:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7d800/0xfeec3c2dc5a4a6ee lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.433189:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7d800/0xfeec3c2dc5a4a6ee lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.433220:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233155880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827885056:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1784191849.433307:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.433371:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.433533:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827885056 00000100:00100000:1.0:1784191849.433544:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827885056 00000100:00100000:1.0:1784191849.433615:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1784191849.433627:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:161504:x1870858827885056:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.433654:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191849.433676:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a6f5 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a6ee expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.433732:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a6f5 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a6ee expref: 19 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.433747:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a6f5 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a6ee expref: 19 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.433757:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x7:0x0].0x0 (ffff8af207498200) 00010000:00010000:1.0:1784191849.433760:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191849.433764:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e200, rc 0) 00000100:00100000:1.0:1784191849.433817:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:161504:x1870858827885056:12345-0@lo:101:mdt00_003.0 Request processed in 191us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.433826:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1784191849.434055:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233155880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827885056:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1784191849.434073:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7d800/0xfeec3c2dc5a4a6ee lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a6f5 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.434085:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7d800/0xfeec3c2dc5a4a6ee lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a6f5 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191849.434111:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f59d694 reply state 0000000095265127 transno 21474836530 ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4a6e7 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.434126:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4a6e7 lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.434133:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x7:0x0].0x0 (ffff8af215ff6900) 00010000:00010000:3.0:1784191849.434136:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191849.434140:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784191849.434147:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7d800/0xfeec3c2dc5a4a6ee lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a6f5 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.434155:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7d800/0xfeec3c2dc5a4a6ee lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a6f5 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191849.434169:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0x7:0x0] 00000004:00010000:3.0:1784191849.434176:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f59d694 reply state 0000000095265127 transno 21474836530 ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4a6e0 lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.434184:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4a6e0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.434190:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x4:0x0].0x0 (ffff8af216636900) 00010000:00010000:3.0:1784191849.434198:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191849.434201:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1784191849.434209:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x4:0x0]: returning size 4096 00000004:00080000:3.0:1784191849.434219:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1784191849.434231:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a6cb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.434240:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a6cb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.434248:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a6cb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.434273:0:161504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1784191849.434278:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1784191849.434283:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f800/0xfeec3c2dc5a4a6d2 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a6d9 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.434291:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f800/0xfeec3c2dc5a4a6d2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a6d9 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.434403:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:122829:x1870858812335104:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 74935us (88932us total) trans 21474836530 rc 0/0 00000100:00100000:3.0:1784191849.434412:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 400 00010000:00010000:1.0:1784191849.434665:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191849.434674:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4a6cb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.434685:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7de00 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:1.0:1784191849.434716:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a6cb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191849.434727:0:160901:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a6cb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.434771:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a6cb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.434778:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784191849.434839:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1784191849.434862:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a6cb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.434871:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7de00/0xfeec3c2dc5a4a6c4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a6cb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.434895:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191849.434897:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191849.434899:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191849.440365:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191849.440474:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812335360 00000100:00100000:2.0:1784191849.440488:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812335360 00000100:00100000:2.0:1784191849.440573:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 401 00000100:00100000:2.0:1784191849.440586:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:122829:x1870858812335360:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1784191849.440613:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191849.440640:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a6fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b662 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.440755:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a703 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.440775:0:158665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4a6cb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a6c4 expref: 18 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.440785:0:158665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a703 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.440834:0:158665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4a6cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfeec3c2dc5a4a6c4 expref: 18 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191849.440855:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b86a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:158665:1870858827885312:0@lo:104: 00000100:00100000:2.0:1784191849.440920:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.440978:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2206fd600 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.441000:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827885312 00000100:00100000:2.0:1784191849.441003:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827885312 00000100:00100000:2.0:1784191849.441040:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784191849.441067:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158665:x1870858827885312:12345-0@lo:104: 00010000:00010000:2.0:1784191849.441077:0:158648:0:(ldlm_lockd.c:2448:ldlm_callback_handler()) callback on lock 0xfeec3c2dc5a4a6c4 - lock disappeared 00010000:00010000:2.0:1784191849.441130:0:158648:0:(ldlm_lockd.c:2345:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-0@lo lock=0xfeec3c2dc5a4a6c4: rc = 0 req@ffff8af106b84380 x1870858827885312/t0(0) o104->lustre-MDT0001-mdtlov_UUID@0@lo:20/0 lens 328/224 e 0 to 0 dl 1784191860 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784191849.441141:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158665:x1870858827885312:12345-0@lo:104: Request processed in 76us (222us total) trans 0 rc -22/-22 00000100:00100000:2.0:1784191849.441148:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1784191849.441197:0:158665:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 0@lo) returned -22 from blocking AST (req@00000000511be450 x1870858827885312) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4a6cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xfeec3c2dc5a4a6c4 expref: 18 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.441228:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4a6cb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xfeec3c2dc5a4a6c4 expref: 18 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191849.441247:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b86a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:158665:1870858827885312:0@lo:104: 00010000:00010000:2.0:1784191849.441271:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.441276:0:158665:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a703 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.441284:0:158665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a703 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.441291:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a703 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.441309:0:158665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a703 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.441320:0:158665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a703 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.441333:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a703 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191849.441402:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191849.441407:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191849.441434:0:158665:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a703 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.441472:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a6fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b662 expref: 7 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.441487:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a703 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b662 expref: 6 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.441494:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.441497:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191849.441499:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4600, rc 0) 00000100:00100000:2.0:1784191849.442797:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812335360:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2203us (2447us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.442809:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 401 00000100:00100000:0.0:1784191849.449898:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827885184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191849.449999:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.450490:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827885184 00000100:00100000:2.0:1784191849.450501:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827885184 00000100:00100000:2.0:1784191849.450599:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784191849.450610:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23d2c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+18:106501:x1870858827885184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191849.450629:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191849.450633:0:158652:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie feec3c2dc5a4a6cb) 00010000:00010000:2.0:1784191849.450636:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191849.450792:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23d2c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+18:106501:x1870858827885184:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (791us total) trans 0 rc 116/116 00000100:00100000:2.0:1784191849.450801:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784191849.455035:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191849.455087:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812335488 00000100:00100000:2.0:1784191849.455098:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812335488 00000100:00100000:2.0:1784191849.455161:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 402 00000100:00100000:2.0:1784191849.455173:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812335488:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1784191849.455201:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191849.455227:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4e00/0xfeec3c2dc5a4a70a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b669 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455324:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a711 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455341:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a711 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455366:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a711 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455384:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a718 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455392:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455399:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455459:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a711 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455487:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a711 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455495:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a711 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455502:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191849.455508:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a711 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455516:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a711 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455531:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.455534:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.455540:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a711 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455547:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a711 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455563:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455570:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a718 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455575:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a718 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455580:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191849.455593:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a718 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455600:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a718 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455609:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x96709776 (ffff8af202c46e00) 00010000:00010000:2.0:1784191849.455612:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.455615:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a718 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455621:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a718 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455670:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4e00/0xfeec3c2dc5a4a70a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b669 expref: 7 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455683:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.455685:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.455711:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4e00/0xfeec3c2dc5a4a70a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b669 expref: 7 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.455722:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4e00, rc 0) 00000100:00100000:2.0:1784191849.455804:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812335488:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 632us (784us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191849.455812:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 402 00000100:00100000:0.0:1784191849.460617:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827885184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784191849.466315:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191849.466412:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812335744 00000100:00100000:3.0:1784191849.466426:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812335744 00000100:00100000:3.0:1784191849.466516:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 403 00000100:00100000:3.0:1784191849.466529:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:122829:x1870858812335744:12345-192.168.204.16@tcp:36:lfs.0 00000100:00100000:3.0:1784191849.466758:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827885440:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.466830:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.466881:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.466996:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827885440 00000100:00100000:1.0:1784191849.467001:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827885440 00000100:00100000:1.0:1784191849.467045:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1784191849.467053:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:161504:x1870858827885440:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.467550:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:161504:x1870858827885440:12345-0@lo:1000:mdt00_003.0 Request processed in 488us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.467576:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:0.0:1784191849.469534:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827885440:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.469653:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827885568:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.469797:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.469832:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af21704e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.470027:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827885568 00000100:00100000:3.0:1784191849.470035:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827885568 00000100:00100000:3.0:1784191849.470093:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1784191849.470105:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:161504:x1870858827885568:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.470242:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:161504:x1870858827885568:12345-0@lo:1000:mdt00_003.0 Request processed in 138us (445us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784191849.470250:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:0.0:1784191849.472530:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827885568:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1784191849.472656:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.472669:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.472682:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.472763:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827885696:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1784191849.472856:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.472912:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af21704e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.473171:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827885696 00000100:00100000:1.0:1784191849.473180:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827885696 00000100:00100000:1.0:1784191849.473249:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:1.0:1784191849.473260:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:161504:x1870858827885696:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.473281:0:161739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191849.473303:0:161739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a726 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a71f expref: -99 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.473342:0:161739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a703 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b662 expref: 5 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.473364:0:161739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a726 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a71f expref: 19 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.473398:0:161739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a703 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b662 expref: 5 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.473417:0:161739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a703 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b662 expref: 5 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.473431:0:161739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827885824:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191849.473522:0:161739:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.477037:0:161739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827885824:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191849.477105:0:161739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a726 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a71f expref: 19 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.477147:0:161739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:1.0:1784191849.477151:0:161739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191849.477155:0:161739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a726 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a71f expref: 19 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.477168:0:161739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f400, rc 0) 00000100:00100000:1.0:1784191849.477254:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+19:161504:x1870858827885696:12345-0@lo:101:mdt00_003.0 Request processed in 3986us (4388us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.477264:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1784191849.477449:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827885696:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1784191849.477473:0:161504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.477486:0:161504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191849.477911:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191849.478770:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812335872 00000100:00100000:1.0:1784191849.478782:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812335872 00010000:00010000:1.0:1784191849.478834:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a703 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b662 expref: 6 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.478886:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 92 00000100:00100000:1.0:1784191849.478898:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812335872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191849.478921:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191849.478928:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a703 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b662 expref: 6 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.478943:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a703 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b662 expref: 6 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.479103:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4a703 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b662 expref: 6 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.479144:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:1.0:1784191849.479152:0:158650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a726 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a71f expref: 18 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.479165:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a726 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a71f expref: 18 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.479176:0:158650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a726 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a71f expref: 18 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.479222:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a726 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a71f expref: 18 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.479237:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:158650:1870858827885952:0@lo:105: 00000100:00100000:1.0:1784191849.479304:0:158650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.479365:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.479460:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827885952 00000100:00100000:2.0:1784191849.479466:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827885952 00000100:00100000:2.0:1784191849.479545:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784191849.479553:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158650:x1870858827885952:12345-0@lo:105: 00010000:00010000:2.0:1784191849.479564:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.479575:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.479585:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.479592:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.479601:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.479609:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4a726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.479639:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af10b5e5a00) 00000100:00100000:2.0:1784191849.479723:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158650:x1870858827885952:12345-0@lo:105: Request processed in 171us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.479730:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784191849.479837:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:158650:1870858827885952:0@lo:105: 00010000:00010000:3.0:1784191849.479859:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191849.479919:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69112:x1870858812335872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1023us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.479928:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 92 00010000:00010000:1.0:1784191849.483278:0:161504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.483304:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191849.483370:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784191849.483449:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a72d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.483459:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a72d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.483496:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a72d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.483528:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827886080:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1784191849.483612:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.483681:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827886080 00000100:00100000:1.0:1784191849.483714:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827886080 00000100:00100000:1.0:1784191849.483800:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1784191849.483812:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:161504:x1870858827886080:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.483836:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191849.483857:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4a734 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a72d expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.483890:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4a734 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a72d expref: 20 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.483907:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4a734 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a72d expref: 20 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.483918:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x96709776 (ffff8af207498900) 00010000:00010000:1.0:1784191849.483922:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191849.483925:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ea00, rc 0) 00000100:00100000:1.0:1784191849.483975:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:161504:x1870858827886080:12345-0@lo:101:mdt00_003.0 Request processed in 165us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.483983:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1784191849.484016:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.484388:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827886080:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.484423:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a72d lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a734 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.484436:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a72d lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a734 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191849.484456:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1784191849.484505:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827886208:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.484545:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.484574:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.485519:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827886208 00000100:00100000:3.0:1784191849.485950:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827886208 00000100:00100000:3.0:1784191849.486093:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1784191849.486105:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:161504:x1870858827886208:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.488778:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:161504:x1870858827886208:12345-0@lo:1000:mdt00_003.0 Request processed in 2663us (4219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.488797:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1784191849.490804:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784191849.490835:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827886336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784191849.490928:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.492993:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827886208:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.493114:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827886464:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.493185:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.493329:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.495090:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827886464 00000100:00100000:2.0:1784191849.495107:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827886464 00000100:00100000:3.0:1784191849.495179:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827886336 00000100:00100000:3.0:1784191849.495187:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827886336 00000100:00100000:2.0:1784191849.495195:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:2.0:1784191849.495209:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:161504:x1870858827886464:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.495252:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1784191849.495262:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827886336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784191849.495295:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8228544 pending 0 free 71049216 avail 63881216 00000100:00080000:0.0:1784191849.495712:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784191849.495874:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827886336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 613us (4946us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.495883:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784191849.496019:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827886336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784191849.500214:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:161504:x1870858827886464:12345-0@lo:1000:mdt00_003.0 Request processed in 4991us (7011us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784191849.500236:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1784191849.500338:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827886464:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.505337:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827886592:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.505532:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.505594:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.505925:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827886592 00000100:00100000:3.0:1784191849.506131:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827886592 00000100:00100000:3.0:1784191849.506210:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:3.0:1784191849.506224:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:161504:x1870858827886592:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.506425:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:161504:x1870858827886592:12345-0@lo:1000:mdt00_003.0 Request processed in 204us (893us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784191849.506434:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1784191849.506510:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827886592:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.506588:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827886720:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.506617:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.506649:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.506719:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827886720 00000100:00100000:0.0:1784191849.506724:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827886720 00000100:00100000:0.0:1784191849.506762:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1784191849.506769:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:161504:x1870858827886720:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.506830:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:161504:x1870858827886720:12345-0@lo:1000:mdt00_003.0 Request processed in 62us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191849.506836:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1784191849.506932:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827886720:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.507199:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827886848:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.507224:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.507249:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.508099:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827886848 00000100:00100000:2.0:1784191849.508109:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827886848 00000100:00100000:2.0:1784191849.508170:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1784191849.508180:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:161504:x1870858827886848:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.508304:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:161504:x1870858827886848:12345-0@lo:1000:mdt00_003.0 Request processed in 126us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.508312:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:1.0:1784191849.508570:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827886848:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.508656:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827886976:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.508721:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.508754:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.511131:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827886976 00000100:00100000:0.0:1784191849.511156:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827886976 00000100:00100000:0.0:1784191849.511256:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1784191849.511269:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:161504:x1870858827886976:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.511444:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:161504:x1870858827886976:12345-0@lo:1000:mdt00_003.0 Request processed in 177us (2721us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191849.511453:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:1.0:1784191849.515924:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827886976:0@lo:1000:mdt00_003.0 00080000:00000400:1.0:1784191849.516808:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 258 < left 336, rollback = 2 00080000:00000400:1.0:1784191849.516815:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:1.0:1784191849.516818:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:1.0:1784191849.516820:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.516823:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/1, delete: 0/0/0 00080000:00000400:1.0:1784191849.516824:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191849.516901:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 257 < left 336, rollback = 2 00080000:00000400:1.0:1784191849.516904:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:1.0:1784191849.516906:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:1.0:1784191849.516908:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.516910:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/2, delete: 0/0/0 00080000:00000400:1.0:1784191849.516912:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191849.517080:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:1.0:1784191849.517086:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:1.0:1784191849.517088:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:1.0:1784191849.517090:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.517092:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:1.0:1784191849.517093:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191849.517112:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:1.0:1784191849.517114:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:1.0:1784191849.517122:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:1.0:1784191849.517124:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.517126:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:1.0:1784191849.517129:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191849.517142:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:1.0:1784191849.517144:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:1.0:1784191849.517146:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:1.0:1784191849.517149:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.517151:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:1.0:1784191849.517152:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191849.517181:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:1.0:1784191849.517184:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:1.0:1784191849.517186:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:1.0:1784191849.517188:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.517190:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:1.0:1784191849.517192:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00000040:00080000:1.0:1784191849.517373:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002340:0x1:0x0].11, 2168 off50352 00000040:00080000:1.0:1784191849.517474:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab1:0x1:0x0].11, 2368 off52016 00000004:00080000:1.0:1784191849.517482:0:161504:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af2035a1e40 with version 23 00000004:00080000:0.0:1784191849.519215:0:159400:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af10ef50540 version 23 rpc_version 23 00000020:00100000:0.0:1784191849.519294:0:159400:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784191849.519309:0:159400:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af227e61880 x1870858827887232/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784191849.519375:0:159400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e61880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827887232:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784191849.519483:0:159400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.519534:0:159400:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af21704e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.519621:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827887232 00000100:00100000:2.0:1784191849.519630:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827887232 00000100:00100000:2.0:1784191849.519730:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1784191849.519742:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:159400:x1870858827887232:12345-0@lo:1000:osp_up0-1.0 00080000:00000400:2.0:1784191849.520167:0:158671:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 292, rollback = 2 00080000:00000400:2.0:1784191849.520172:0:158671:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191849.520174:0:158671:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:2.0:1784191849.520177:0:158671:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/47/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.520179:0:158671:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/0, delete: 0/0/0 00080000:00000400:2.0:1784191849.520181:0:158671:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191849.520361:0:158671:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 292, rollback = 2 00080000:00000400:2.0:1784191849.520365:0:158671:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191849.520367:0:158671:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:2.0:1784191849.520369:0:158671:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/47/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.520371:0:158671:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/1, delete: 0/0/0 00080000:00000400:2.0:1784191849.520373:0:158671:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191849.520412:0:158671:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 292, rollback = 2 00080000:00000400:2.0:1784191849.520416:0:158671:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191849.520424:0:158671:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:2.0:1784191849.520427:0:158671:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/47/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191849.520429:0:158671:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/1, delete: 0/0/0 00080000:00000400:2.0:1784191849.520431:0:158671:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191849.520670:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:159400:x1870858827887232:12345-0@lo:1000:osp_up0-1.0 Request processed in 928us (1185us total) trans 34359738625 rc 0/0 00000100:00100000:2.0:1784191849.520681:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1784191849.521017:0:159400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e61880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827887232:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1784191849.522478:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a73b lrc: 3/0,1 mode: --/PW res: [0x240002343:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.522501:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a73b lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.522514:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a73b lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.522540:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126800/0xfeec3c2dc5a4a742 lrc: 3/0,1 mode: --/PW res: [0x240002340:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.522547:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126800/0xfeec3c2dc5a4a742 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.522573:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126800/0xfeec3c2dc5a4a742 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.522626:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127400/0xfeec3c2dc5a4a749 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.522633:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127400/0xfeec3c2dc5a4a749 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.522644:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127400/0xfeec3c2dc5a4a749 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.522672:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827887360:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1784191849.522778:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.522878:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef50840 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.538541:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827887360 00000100:00100000:0.0:1784191849.538564:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827887360 00000100:00100000:0.0:1784191849.538683:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1784191849.538714:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:161504:x1870858827887360:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1784191849.538753:0:159636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191849.538788:0:159636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a750 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a749 expref: -99 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.538831:0:159636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a750 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a749 expref: 22 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.538850:0:159636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a750 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a749 expref: 22 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.538860:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x8:0x0].0x0 (ffff8af2331f1d00) 00010000:00010000:0.0:1784191849.538863:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191849.538868:0:159636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4c00, rc 0) 00000100:00100000:0.0:1784191849.538973:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:161504:x1870858827887360:12345-0@lo:101:mdt00_003.0 Request processed in 263us (16194us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191849.538980:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1784191849.541337:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827887360:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.541390:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127400/0xfeec3c2dc5a4a749 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a750 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.541407:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127400/0xfeec3c2dc5a4a749 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a750 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191849.541448:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d9ae366 reply state 00000000f6298e4e transno 21474836531 ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126800/0xfeec3c2dc5a4a742 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.541468:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126800/0xfeec3c2dc5a4a742 lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.541477:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x8:0x0].0x0 (ffff8af207498e00) 00010000:00010000:1.0:1784191849.541503:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191849.541508:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191849.541516:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127400/0xfeec3c2dc5a4a749 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a750 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.541525:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127400/0xfeec3c2dc5a4a749 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a750 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191849.541541:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0x8:0x0] 00000004:00010000:1.0:1784191849.541551:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d9ae366 reply state 00000000f6298e4e transno 21474836531 ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a73b lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.541560:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a73b lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.541566:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x5:0x0].0x0 (ffff8af207498600) 00010000:00010000:1.0:1784191849.541569:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191849.541571:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1784191849.541578:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x5:0x0]: returning size 4096 00000004:00080000:1.0:1784191849.541591:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784191849.541602:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.541609:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.541616:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.541974:0:161504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1784191849.541983:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1784191849.542080:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a72d lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a734 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.542091:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a72d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a734 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.542246:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:122829:x1870858812335744:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 75715us (75942us total) trans 21474836531 rc 0/0 00000100:00100000:3.0:1784191849.542255:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 403 00000100:00100000:1.0:1784191849.553119:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1784191849.553371:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1784191849.553380:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812336000 00010000:00010000:2.0:1784191849.553384:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4a726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.553393:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812336000 00010000:00010000:2.0:1784191849.553396:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5a00 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:2.0:1784191849.553404:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191849.553414:0:158654:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.553467:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 404 00000100:00100000:3.0:1784191849.553478:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:122829:x1870858812336000:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1784191849.553600:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191849.553630:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4a757 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b670 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.553813:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.553823:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191849.553853:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.553861:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a71f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.553903:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827887488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191849.553971:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784191849.554036:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191849.554038:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191849.554040:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191849.554247:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827887488 00000100:00100000:2.0:1784191849.554253:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827887488 00000100:00100000:2.0:1784191849.554308:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784191849.554316:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+22:106500:x1870858827887488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191849.554330:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191849.554363:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4a726 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a71f expref: 22 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.554385:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.554391:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191849.554436:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+21:106500:x1870858827887488:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (465us total) trans 0 rc 0/0 00010000:00010000:3.0:1784191849.554449:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a75e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191849.554453:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:3.0:1784191849.554466:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a75e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.554478:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a75e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191849.554503:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827887488:0@lo:103:ldlm_bl.0 00000004:00200000:3.0:1784191849.554619:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784191849.554623:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784191849.554650:0:158665:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a75e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.554677:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4a757 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b670 expref: 7 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.554723:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a75e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b670 expref: 6 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.554731:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191849.554734:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784191849.554737:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7de00, rc 0) 00000100:00100000:3.0:1784191849.554913:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812336000:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1436us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.554920:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 404 00010000:00010000:1.0:1784191849.557234:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191849.568847:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191849.568953:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812336128 00000100:00100000:2.0:1784191849.568983:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812336128 00000100:00100000:2.0:1784191849.569079:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 405 00000100:00100000:2.0:1784191849.569094:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812336128:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1784191849.569124:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191849.569165:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a765 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b677 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.569487:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a76c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.569507:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a76c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.569523:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a76c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.570053:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a773 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.570079:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.570093:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.570148:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a76c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.570172:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a76c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.570178:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a76c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.570185:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a76c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.570191:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191849.570195:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a76c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.570211:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a76c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.570227:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.570230:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.570235:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a76c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.570243:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4a76c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.570258:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.570264:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a773 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.570269:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a773 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.570281:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191849.570284:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a773 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.570290:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a773 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.570299:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a253ddb (ffff8af202c46e00) 00010000:00010000:2.0:1784191849.570302:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.570305:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a773 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.570311:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5c00/0xfeec3c2dc5a4a773 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.572362:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a765 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b677 expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.572383:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.572386:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.572391:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b677 expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.572406:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4c00, rc 0) 00000100:00100000:3.0:1784191849.573055:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812336128:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3952us (4211us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191849.573070:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 405 00000100:00100000:2.0:1784191849.589875:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191849.589921:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812336384 00000100:00100000:0.0:1784191849.589959:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812336384 00000100:00100000:0.0:1784191849.590056:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 406 00000100:00100000:0.0:1784191849.590069:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:122829:x1870858812336384:12345-192.168.204.16@tcp:36:lfs.0 00000100:00100000:0.0:1784191849.590250:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827887616:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.590344:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.590393:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6a480 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.590618:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827887616 00000100:00100000:1.0:1784191849.590623:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827887616 00000100:00100000:1.0:1784191849.590675:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1784191849.590684:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:161504:x1870858827887616:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.590815:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:161504:x1870858827887616:12345-0@lo:1000:mdt00_003.0 Request processed in 131us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.590824:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:0.0:1784191849.591046:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827887616:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.591124:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827887744:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.591155:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.591182:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.591267:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827887744 00000100:00100000:1.0:1784191849.591281:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827887744 00000100:00100000:1.0:1784191849.591318:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1784191849.591326:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:161504:x1870858827887744:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.591418:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:161504:x1870858827887744:12345-0@lo:1000:mdt00_003.0 Request processed in 93us (263us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784191849.591438:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1784191849.591675:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827887744:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1784191849.591770:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.591782:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.591793:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.591806:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827887872:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1784191849.591833:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.591846:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.591902:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827887872 00000100:00100000:1.0:1784191849.591906:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827887872 00000100:00100000:1.0:1784191849.591939:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1784191849.591945:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:161504:x1870858827887872:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.591956:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191849.591974:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4a781 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a77a expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.592001:0:158671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a75e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b670 expref: 5 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.592013:0:158671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4a781 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a77a expref: 22 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.592042:0:158671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a75e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b670 expref: 5 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.592058:0:158671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a75e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b670 expref: 5 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.592071:0:158671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78b800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827888000:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191849.592165:0:158671:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef50840 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.594503:0:158671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78b800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827888000:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191849.594561:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4a781 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a77a expref: 22 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.594604:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.594607:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.594612:0:158671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4a781 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a77a expref: 22 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.594625:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233126400, rc 0) 00000100:00100000:2.0:1784191849.594745:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:161504:x1870858827887872:12345-0@lo:101:mdt00_003.0 Request processed in 2798us (2910us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.594756:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1784191849.595070:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827887872:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1784191849.595106:0:161504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a781 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.595133:0:161504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a781 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191849.597548:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191849.597970:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812336512 00000100:00100000:0.0:1784191849.597983:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812336512 00010000:00010000:0.0:1784191849.598043:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a75e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b670 expref: 6 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.598102:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 93 00000100:00100000:0.0:1784191849.598113:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812336512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191849.598133:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191849.598141:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a75e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b670 expref: 6 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.598158:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a75e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b670 expref: 6 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.598188:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a75e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b670 expref: 6 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.598215:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:0.0:1784191849.598223:0:158651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4a781 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a77a expref: 21 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.598245:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4a781 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a77a expref: 21 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.598285:0:158651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4a781 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a77a expref: 21 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.598327:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4a781 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a77a expref: 21 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.598343:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e63100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:158651:1870858827888128:0@lo:105: 00000100:00100000:0.0:1784191849.598418:0:158651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.598478:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.599730:0:158649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827888128 00000100:00100000:1.0:1784191849.599744:0:158649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827888128 00000100:00100000:1.0:1784191849.599809:0:158649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784191849.599820:0:158649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:158651:x1870858827888128:12345-0@lo:105: 00010000:00010000:1.0:1784191849.599851:0:158649:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a781 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.599865:0:158649:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a781 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.599875:0:158649:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a781 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.599885:0:158649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a781 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.599894:0:158649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a781 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.599906:0:158649:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4a781 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.599929:0:158649:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af10b5e5c00) 00000100:00100000:1.0:1784191849.600019:0:158649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:158651:x1870858827888128:12345-0@lo:105: Request processed in 199us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.600027:0:158649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784191849.601560:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e63100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:158651:1870858827888128:0@lo:105: 00010000:00010000:3.0:1784191849.601599:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191849.601723:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69112:x1870858812336512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3572us (4150us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.601736:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 93 00010000:00010000:0.0:1784191849.601993:0:161504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a781 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.602006:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a781 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191849.602035:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784191849.602110:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5000/0xfeec3c2dc5a4a788 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.602120:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5000/0xfeec3c2dc5a4a788 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.602133:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5000/0xfeec3c2dc5a4a788 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.602156:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827888256:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1784191849.602220:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.602714:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6a480 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.604317:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827888256 00000100:00100000:3.0:1784191849.604334:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827888256 00000100:00100000:3.0:1784191849.604426:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1784191849.604439:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:161504:x1870858827888256:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1784191849.604466:0:159636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191849.604501:0:159636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4a78f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a788 expref: -99 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.604644:0:159636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4a78f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a788 expref: 23 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.604665:0:159636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4a78f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a788 expref: 23 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.604676:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a253ddb (ffff8af215ff6e00) 00010000:00010000:3.0:1784191849.604679:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191849.604683:0:159636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7da00, rc 0) 00000100:00100000:3.0:1784191849.605475:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+23:161504:x1870858827888256:12345-0@lo:101:mdt00_003.0 Request processed in 1034us (3251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.605508:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1784191849.605809:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827888256:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.605837:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5000/0xfeec3c2dc5a4a788 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a78f expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.605851:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5000/0xfeec3c2dc5a4a788 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a78f expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191849.605891:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1784191849.605962:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827888384:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.606018:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.606047:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105047c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.606144:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827888384 00000100:00100000:0.0:1784191849.606151:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827888384 00000100:00100000:0.0:1784191849.606204:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1784191849.606214:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:161504:x1870858827888384:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.606751:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:161504:x1870858827888384:12345-0@lo:1000:mdt00_003.0 Request processed in 538us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191849.606760:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:1.0:1784191849.607175:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827888384:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.607253:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827888512:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.607302:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.607326:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105047180 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.608209:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827888512 00000100:00100000:0.0:1784191849.608218:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827888512 00000100:00100000:0.0:1784191849.608290:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1784191849.608300:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+23:161504:x1870858827888512:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.608448:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+23:161504:x1870858827888512:12345-0@lo:1000:mdt00_003.0 Request processed in 149us (1147us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784191849.608455:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1784191849.608856:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827888512:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.609187:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827888640:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.609499:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.609885:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.610751:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827888640 00000100:00100000:0.0:1784191849.610761:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827888640 00000100:00100000:0.0:1784191849.610835:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1784191849.610845:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:161504:x1870858827888640:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.610985:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:161504:x1870858827888640:12345-0@lo:1000:mdt00_003.0 Request processed in 141us (1486us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784191849.610993:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1784191849.614750:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827888640:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.614914:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827888768:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.615001:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.615042:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105047780 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.620600:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827888768 00000100:00100000:0.0:1784191849.620624:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827888768 00000100:00100000:0.0:1784191849.620743:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:0.0:1784191849.620757:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+23:161504:x1870858827888768:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.620929:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+23:161504:x1870858827888768:12345-0@lo:1000:mdt00_003.0 Request processed in 175us (5927us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191849.620960:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1784191849.621298:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827888768:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.621410:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827888896:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.621456:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.621490:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105047780 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.621708:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827888896 00000100:00100000:0.0:1784191849.621713:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827888896 00000100:00100000:0.0:1784191849.621755:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:0.0:1784191849.621763:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:161504:x1870858827888896:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.621860:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:161504:x1870858827888896:12345-0@lo:1000:mdt00_003.0 Request processed in 97us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191849.621867:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1784191849.621988:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827888896:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.622036:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827889024:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.622061:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.622085:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105047780 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.622143:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827889024 00000100:00100000:0.0:1784191849.622147:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827889024 00000100:00100000:0.0:1784191849.622172:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:0.0:1784191849.622179:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+23:161504:x1870858827889024:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.622237:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+23:161504:x1870858827889024:12345-0@lo:1000:mdt00_003.0 Request processed in 58us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191849.622243:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1784191849.622362:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827889024:0@lo:1000:mdt00_003.0 00080000:00000400:1.0:1784191849.623114:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 258 < left 336, rollback = 2 00080000:00000400:1.0:1784191849.623126:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:1.0:1784191849.623129:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:1.0:1784191849.623131:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.623133:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/1, delete: 0/0/0 00080000:00000400:1.0:1784191849.623135:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191849.623208:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 257 < left 336, rollback = 2 00080000:00000400:1.0:1784191849.623212:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:1.0:1784191849.623214:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:1.0:1784191849.623216:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.623218:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/2, delete: 0/0/0 00080000:00000400:1.0:1784191849.623220:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191849.623411:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:1.0:1784191849.623415:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:1.0:1784191849.623418:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:1.0:1784191849.623420:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.623422:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:1.0:1784191849.623425:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191849.623444:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:1.0:1784191849.623446:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:1.0:1784191849.623449:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:1.0:1784191849.623451:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.623453:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:1.0:1784191849.623455:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191849.623464:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:1.0:1784191849.623467:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:1.0:1784191849.623469:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:1.0:1784191849.623471:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.623473:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:1.0:1784191849.623474:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191849.623501:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:1.0:1784191849.623504:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:1.0:1784191849.623507:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:1.0:1784191849.623514:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.623516:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:1.0:1784191849.623518:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00000040:00080000:1.0:1784191849.623610:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002340:0x1:0x0].12, 2168 off52520 00000040:00080000:1.0:1784191849.623731:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab1:0x1:0x0].12, 2368 off54384 00000004:00080000:1.0:1784191849.623738:0:161504:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af105047a80 with version 24 00000004:00080000:0.0:1784191849.623937:0:159400:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af10ef50540 version 24 rpc_version 24 00000020:00100000:0.0:1784191849.623982:0:159400:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784191849.623993:0:159400:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af227e62a00 x1870858827889280/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784191849.624019:0:159400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e62a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827889280:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784191849.624093:0:159400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.624134:0:159400:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6a480 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.624209:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827889280 00000100:00100000:3.0:1784191849.624217:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827889280 00000100:00100000:3.0:1784191849.624278:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:3.0:1784191849.624288:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:159400:x1870858827889280:12345-0@lo:1000:osp_up0-1.0 00080000:00000400:3.0:1784191849.624617:0:161739:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 292, rollback = 2 00080000:00000400:3.0:1784191849.624621:0:161739:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191849.624624:0:161739:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:3.0:1784191849.624627:0:161739:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/50/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191849.624630:0:161739:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/0, delete: 0/0/0 00080000:00000400:3.0:1784191849.624632:0:161739:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191849.624787:0:161739:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 258 < left 292, rollback = 2 00080000:00000400:3.0:1784191849.624791:0:161739:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191849.624793:0:161739:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:3.0:1784191849.624795:0:161739:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/50/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191849.624797:0:161739:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/1, delete: 0/0/0 00080000:00000400:3.0:1784191849.624799:0:161739:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191849.624828:0:161739:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 258 < left 292, rollback = 2 00080000:00000400:3.0:1784191849.624831:0:161739:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191849.624833:0:161739:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:3.0:1784191849.624835:0:161739:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/50/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191849.624837:0:161739:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/1, delete: 0/0/0 00080000:00000400:3.0:1784191849.624839:0:161739:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00000100:00100000:3.0:1784191849.628178:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:159400:x1870858827889280:12345-0@lo:1000:osp_up0-1.0 Request processed in 3880us (4073us total) trans 34359738626 rc 0/0 00000100:00100000:3.0:1784191849.628201:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:0.0:1784191849.628508:0:159400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e62a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827889280:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1784191849.633126:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a796 lrc: 3/0,1 mode: --/PW res: [0x240002343:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.633149:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a796 lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.633162:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a796 lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.633190:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a79d lrc: 3/0,1 mode: --/PW res: [0x240002340:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.633198:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a79d lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.633205:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a79d lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.633252:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7c600/0xfeec3c2dc5a4a7a4 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.633258:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7c600/0xfeec3c2dc5a4a7a4 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.633269:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7c600/0xfeec3c2dc5a4a7a4 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.633296:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827889408:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1784191849.633509:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.633559:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.634137:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827889408 00000100:00100000:2.0:1784191849.634145:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827889408 00000100:00100000:2.0:1784191849.634204:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1784191849.634215:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+24:161504:x1870858827889408:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1784191849.634241:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191849.634263:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a7ab lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a7a4 expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.634287:0:158671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a7ab lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a7a4 expref: 25 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.634313:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a7ab lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a7a4 expref: 25 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.634321:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x9:0x0].0x0 (ffff8af202c46e00) 00010000:00010000:2.0:1784191849.634323:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.634335:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4c00, rc 0) 00000100:00100000:2.0:1784191849.634574:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+25:161504:x1870858827889408:12345-0@lo:101:mdt00_003.0 Request processed in 361us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.634582:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:3.0:1784191849.635533:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827889408:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1784191849.635561:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7c600/0xfeec3c2dc5a4a7a4 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a7ab expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.635574:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7c600/0xfeec3c2dc5a4a7a4 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a7ab expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191849.635599:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9b6a396 reply state 000000003b7c9c8f transno 21474836532 ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a79d lrc: 3/0,1 mode: PW/PW res: [0x240002340:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.635611:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a79d lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.635618:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x9:0x0].0x0 (ffff8af215ff6f00) 00010000:00010000:3.0:1784191849.635621:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191849.635624:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784191849.635630:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7c600/0xfeec3c2dc5a4a7a4 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a7ab expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.635637:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7c600/0xfeec3c2dc5a4a7a4 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a7ab expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191849.635649:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0x9:0x0] 00000004:00010000:3.0:1784191849.635656:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9b6a396 reply state 000000003b7c9c8f transno 21474836532 ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a796 lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.635663:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a796 lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.635668:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x6:0x0].0x0 (ffff8af215ff6500) 00010000:00010000:3.0:1784191849.635682:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191849.635685:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1784191849.635708:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x6:0x0]: returning size 4096 00000004:00080000:3.0:1784191849.635719:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1784191849.635729:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a781 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.635737:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a781 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.635744:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a781 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.635769:0:161504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1784191849.635773:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1784191849.635778:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5000/0xfeec3c2dc5a4a788 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a78f expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.635785:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5000/0xfeec3c2dc5a4a788 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a78f expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.636014:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:122829:x1870858812336384:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 45945us (46147us total) trans 21474836532 rc 0/0 00000100:00100000:3.0:1784191849.636023:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 406 00010000:00010000:1.0:1784191849.636072:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191849.636589:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4a781 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.636607:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5c00 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:1.0:1784191849.636617:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a781 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191849.636629:0:160901:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a781 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.636897:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a781 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.636905:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784191849.637003:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827889536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191849.637108:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.637250:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827889536 00000100:00100000:3.0:1784191849.637263:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827889536 00010000:00010000:1.0:1784191849.637266:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a781 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.637363:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784191849.637373:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+25:106501:x1870858827889536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784191849.637390:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191849.637429:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4a781 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a77a expref: 25 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.637452:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191849.637456:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784191849.638361:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a77a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a781 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.638387:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191849.638390:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191849.638393:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191849.655336:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+24:106501:x1870858827889536:12345-0@lo:103:ldlm_bl.0 Request processed in 17950us (18213us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.657649:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784191849.659270:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191849.659432:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812336640 00000100:00100000:3.0:1784191849.659441:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812336640 00000100:00100000:3.0:1784191849.659499:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 407 00000100:00100000:3.0:1784191849.659508:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:122829:x1870858812336640:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1784191849.659988:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191849.660012:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a7b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b67e expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.660084:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a7b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.660098:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.660111:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191849.660156:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784191849.660160:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784191849.660180:0:158665:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.660235:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4a7b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b67e expref: 7 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.660257:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a7b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b67e expref: 6 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.660534:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827889536:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784191849.661339:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191849.661342:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784191849.661346:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7c000, rc 0) 00000100:00100000:3.0:1784191849.661440:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812336640:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1928us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.661449:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 407 00000100:00100000:2.0:1784191849.670451:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191849.670528:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812336768 00000100:00100000:3.0:1784191849.670539:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812336768 00000100:00100000:3.0:1784191849.670602:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 408 00000100:00100000:3.0:1784191849.670612:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812336768:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1784191849.670634:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191849.670654:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4a7c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b685 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.670863:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a7c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.670878:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a7c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.670889:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a7c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.670932:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4a7ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.670940:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4a7ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.670948:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4a7ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.670997:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a7c7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.671005:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a7c7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.671010:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a7c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.671016:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a7c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.671022:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7de00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191849.671027:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a7c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.671034:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a7c7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.671047:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191849.671049:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191849.671053:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a7c7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.671067:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4a7c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.671085:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4a7ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.671092:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4a7ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.671098:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4a7ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.671102:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af110db3e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191849.671106:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4a7ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.671111:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4a7ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.671118:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcaaa8ec3 (ffff8af215ff6d00) 00010000:00010000:3.0:1784191849.671121:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191849.671123:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4a7ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.671128:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4a7ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.671158:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4a7c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b685 expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.671179:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191849.671181:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191849.671186:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4a7c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b685 expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.671205:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7d400, rc 0) 00000100:00100000:3.0:1784191849.671271:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812336768:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 660us (828us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191849.671279:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 408 00000100:00100000:1.0:1784191849.687575:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191849.688013:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812337024 00000100:00100000:3.0:1784191849.688025:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812337024 00000100:00100000:3.0:1784191849.688094:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 409 00000100:00100000:3.0:1784191849.688105:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:122829:x1870858812337024:12345-192.168.204.16@tcp:36:lfs.0 00000100:00100000:3.0:1784191849.688233:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827889664:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.688282:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.688318:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.688400:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827889664 00000100:00100000:0.0:1784191849.688405:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827889664 00000100:00100000:0.0:1784191849.688448:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:0.0:1784191849.688456:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:161504:x1870858827889664:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.688546:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:161504:x1870858827889664:12345-0@lo:1000:mdt00_003.0 Request processed in 90us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191849.688554:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:3.0:1784191849.688823:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827889664:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.688872:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827889792:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.688898:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.688921:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.689015:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827889792 00000100:00100000:0.0:1784191849.689020:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827889792 00000100:00100000:0.0:1784191849.689055:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1784191849.689062:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+24:161504:x1870858827889792:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.689137:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+24:161504:x1870858827889792:12345-0@lo:1000:mdt00_003.0 Request processed in 75us (238us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784191849.689144:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:3.0:1784191849.689247:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827889792:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1784191849.689296:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3e00/0xfeec3c2dc5a4a7d5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.689326:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3e00/0xfeec3c2dc5a4a7d5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.689336:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3e00/0xfeec3c2dc5a4a7d5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.689360:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827889920:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1784191849.689385:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.689411:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.689510:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827889920 00000100:00100000:0.0:1784191849.689515:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827889920 00000100:00100000:0.0:1784191849.689554:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:0.0:1784191849.689560:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:161504:x1870858827889920:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1784191849.689572:0:161739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191849.689588:0:161739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a7dc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a7d5 expref: -99 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.689612:0:161739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a7b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b67e expref: 5 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.689623:0:161739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a7dc lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a7d5 expref: 25 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.689659:0:161739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a7b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b67e expref: 5 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.689673:0:161739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a7b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b67e expref: 5 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.689684:0:161739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd0000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827890048:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191849.689785:0:161739:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2035a1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.700834:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191849.701292:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812337152 00000100:00100000:3.0:1784191849.701305:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812337152 00010000:00010000:3.0:1784191849.701367:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a7b9 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b67e expref: 6 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.701488:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 94 00000100:00100000:3.0:1784191849.701500:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69110:x1870858812337152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191849.701532:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191849.701540:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a7b9 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b67e expref: 6 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.701557:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a7b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b67e expref: 6 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.701584:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191849.701592:0:158650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a7dc lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a7d5 expref: 25 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.701627:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a7dc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a7d5 expref: 25 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.701637:0:158650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a7dc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a7d5 expref: 25 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.701673:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a7dc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a7d5 expref: 25 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.701727:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233155880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:158650:1870858827890176:0@lo:105: 00000100:00100000:3.0:1784191849.701787:0:158650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.701828:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.702994:0:158649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827890176 00000100:00100000:2.0:1784191849.703006:0:158649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827890176 00000100:00100000:2.0:1784191849.703068:0:158649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784191849.703077:0:158649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af107907b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:158650:x1870858827890176:12345-0@lo:105: 00010000:00010000:2.0:1784191849.703090:0:158649:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3e00/0xfeec3c2dc5a4a7d5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a7dc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.703102:0:158649:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3e00/0xfeec3c2dc5a4a7d5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a7dc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.703112:0:158649:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3e00/0xfeec3c2dc5a4a7d5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a7dc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.703121:0:158649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3e00/0xfeec3c2dc5a4a7d5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a7dc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.703130:0:158649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3e00/0xfeec3c2dc5a4a7d5 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a7dc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.703139:0:158649:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3e00/0xfeec3c2dc5a4a7d5 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4a7dc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.703174:0:158649:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af110db3e00) 00000100:00100000:2.0:1784191849.703261:0:158649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af107907b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:158650:x1870858827890176:12345-0@lo:105: Request processed in 186us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.703269:0:158649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784191849.703323:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233155880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:158650:1870858827890176:0@lo:105: 00010000:00010000:2.0:1784191849.703344:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191849.703406:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69110:x1870858812337152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1906us (2581us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.703414:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 94 00010000:00010000:0.0:1784191849.704680:0:161739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4a7b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b67e expref: 5 pid: 158665 timeout: 5569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.704736:0:161739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd0000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827890048:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191849.704768:0:161739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a7dc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a7d5 expref: 25 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.704780:0:161739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:0.0:1784191849.704783:0:161739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191849.704787:0:161739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4a00, rc 0) 00000100:00100000:0.0:1784191849.704876:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+25:161504:x1870858827889920:12345-0@lo:101:mdt00_003.0 Request processed in 15314us (15489us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191849.704884:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:3.0:1784191849.706222:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827889920:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1784191849.706250:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3e00/0xfeec3c2dc5a4a7d5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a7dc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191849.706287:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1784191849.706336:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4a7e3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.706569:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4a7e3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.706585:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4a7e3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.706609:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af107905880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827890304:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1784191849.706679:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.706741:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.706777:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827890304 00000100:00100000:0.0:1784191849.706785:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827890304 00000100:00100000:0.0:1784191849.706853:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1784191849.706862:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af107904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+25:161504:x1870858827890304:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1784191849.706888:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191849.706905:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4a7ea lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a7e3 expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.706929:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4a7ea lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a7e3 expref: 26 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.706943:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4a7ea lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a7e3 expref: 26 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.706952:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcaaa8ec3 (ffff8af2331f1700) 00010000:00010000:0.0:1784191849.706955:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191849.706959:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4400, rc 0) 00000100:00100000:0.0:1784191849.706999:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af107904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+26:161504:x1870858827890304:12345-0@lo:101:mdt00_003.0 Request processed in 137us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191849.707006:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1784191849.707024:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af107905880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827890304:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1784191849.707043:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4a7e3 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a7ea expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.707053:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4a7e3 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a7ea expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191849.707068:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1784191849.707166:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827890432:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.707207:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.707232:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af109911600 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.707488:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827890432 00000100:00100000:3.0:1784191849.707494:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827890432 00000100:00100000:3.0:1784191849.707528:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1784191849.707535:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+26:161504:x1870858827890432:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.707602:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+26:161504:x1870858827890432:12345-0@lo:1000:mdt00_003.0 Request processed in 67us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.707609:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:0.0:1784191849.707685:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827890432:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.707758:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827890560:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.707785:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.707798:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2387a7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.707857:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827890560 00000100:00100000:3.0:1784191849.707862:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827890560 00000100:00100000:3.0:1784191849.707897:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1784191849.707904:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+26:161504:x1870858827890560:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.707977:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+26:161504:x1870858827890560:12345-0@lo:1000:mdt00_003.0 Request processed in 73us (191us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784191849.707983:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1784191849.708046:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827890560:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.708117:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827890688:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.708153:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.710047:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2387a7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.715576:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827890688 00000100:00100000:3.0:1784191849.715595:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827890688 00000100:00100000:1.0:1784191849.716012:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:1.0:1784191849.716025:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+26:161504:x1870858827890688:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.716213:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+26:161504:x1870858827890688:12345-0@lo:1000:mdt00_003.0 Request processed in 190us (8057us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784191849.716221:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1784191849.716314:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827890688:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.716444:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827890816:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.716487:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.717034:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2206fd240 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.717076:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827890816 00000100:00100000:0.0:1784191849.717082:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827890816 00000100:00100000:0.0:1784191849.717165:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:0.0:1784191849.717185:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+26:161504:x1870858827890816:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.717724:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+26:161504:x1870858827890816:12345-0@lo:1000:mdt00_003.0 Request processed in 549us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191849.717733:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:0.0:1784191849.731588:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827890816:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.731724:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827890944:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.731793:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.731831:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2387a7540 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.731901:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827890944 00000100:00100000:2.0:1784191849.731908:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827890944 00000100:00100000:2.0:1784191849.731958:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1784191849.731968:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+26:161504:x1870858827890944:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.732069:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+26:161504:x1870858827890944:12345-0@lo:1000:mdt00_003.0 Request processed in 103us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.732077:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:0.0:1784191849.732929:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827890944:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.733000:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827891072:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.733038:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.733081:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2387a7540 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.733659:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827891072 00000100:00100000:1.0:1784191849.733666:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827891072 00000100:00100000:1.0:1784191849.733762:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1784191849.733772:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+26:161504:x1870858827891072:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.733884:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+26:161504:x1870858827891072:12345-0@lo:1000:mdt00_003.0 Request processed in 112us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.733891:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:0.0:1784191849.734088:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827891072:0@lo:1000:mdt00_003.0 00080000:00000400:0.0:1784191849.735120:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 259 < left 336, rollback = 2 00080000:00000400:0.0:1784191849.735127:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.735130:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:0.0:1784191849.735132:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.735134:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/1, delete: 0/0/0 00080000:00000400:0.0:1784191849.735136:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191849.735208:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 258 < left 336, rollback = 2 00080000:00000400:0.0:1784191849.735212:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.735219:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:0.0:1784191849.735221:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.735223:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/2, delete: 0/0/0 00080000:00000400:0.0:1784191849.735225:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191849.736878:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:0.0:1784191849.736889:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.736892:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:0.0:1784191849.736894:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.736896:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/4, delete: 0/0/0 00080000:00000400:0.0:1784191849.736898:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191849.736930:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:0.0:1784191849.736933:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.736935:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:0.0:1784191849.736937:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.736939:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/4, delete: 0/0/0 00080000:00000400:0.0:1784191849.736941:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191849.736951:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:0.0:1784191849.736953:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.736955:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:0.0:1784191849.736957:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.736958:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/4, delete: 0/0/0 00080000:00000400:0.0:1784191849.736961:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191849.737008:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:0.0:1784191849.737011:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.737013:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:0.0:1784191849.737014:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.737016:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/4, delete: 0/0/0 00080000:00000400:0.0:1784191849.737018:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00000040:00080000:0.0:1784191849.737130:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002340:0x1:0x0].13, 2168 off54688 00000040:00080000:0.0:1784191849.737241:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab1:0x1:0x0].13, 2368 off56752 00000004:00080000:0.0:1784191849.737248:0:161504:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af2387a7cc0 with version 25 00000004:00080000:3.0:1784191849.737322:0:159400:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af10ef50540 version 25 rpc_version 25 00000020:00100000:3.0:1784191849.737385:0:159400:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784191849.737398:0:159400:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af107905880 x1870858827891328/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191849.737425:0:159400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af107905880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827891328:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784191849.737508:0:159400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.737563:0:159400:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.737845:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827891328 00000100:00100000:1.0:1784191849.737853:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827891328 00000100:00100000:1.0:1784191849.737913:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:1.0:1784191849.737923:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+26:159400:x1870858827891328:12345-0@lo:1000:osp_up0-1.0 00080000:00000400:1.0:1784191849.738266:0:159636:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 292, rollback = 2 00080000:00000400:1.0:1784191849.738271:0:159636:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191849.738273:0:159636:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:1.0:1784191849.738275:0:159636:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/47/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.738277:0:159636:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/0, delete: 0/0/0 00080000:00000400:1.0:1784191849.738279:0:159636:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191849.738414:0:159636:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 292, rollback = 2 00080000:00000400:1.0:1784191849.738418:0:159636:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191849.738420:0:159636:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:1.0:1784191849.738422:0:159636:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/47/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.738424:0:159636:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/1, delete: 0/0/0 00080000:00000400:1.0:1784191849.738431:0:159636:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191849.738461:0:159636:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 292, rollback = 2 00080000:00000400:1.0:1784191849.738464:0:159636:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191849.738466:0:159636:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:1.0:1784191849.738468:0:159636:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/47/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.738470:0:159636:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/1, delete: 0/0/0 00080000:00000400:1.0:1784191849.738472:0:159636:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00000100:00100000:1.0:1784191849.739105:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+27:159400:x1870858827891328:12345-0@lo:1000:osp_up0-1.0 Request processed in 1180us (1593us total) trans 34359738627 rc 0/0 00000100:00100000:1.0:1784191849.739115:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:3.0:1784191849.739417:0:159400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af107905880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827891328:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1784191849.739676:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a7f1 lrc: 3/0,1 mode: --/PW res: [0x240002343:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.739735:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a7f1 lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.739749:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a7f1 lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.739770:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a7f8 lrc: 3/0,1 mode: --/PW res: [0x240002340:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.739777:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a7f8 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.739784:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a7f8 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.739823:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5600/0xfeec3c2dc5a4a7ff lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.739830:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5600/0xfeec3c2dc5a4a7ff lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.739840:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5600/0xfeec3c2dc5a4a7ff lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.739860:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827891456:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1784191849.739909:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.740290:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827891456 00000100:00100000:2.0:1784191849.740297:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827891456 00000100:00100000:2.0:1784191849.740341:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1784191849.740360:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+27:161504:x1870858827891456:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1784191849.740395:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191849.740413:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a806 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a7ff expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.740447:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a806 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a7ff expref: 28 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.740459:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a806 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a7ff expref: 28 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.740468:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff8af202c46200) 00010000:00010000:2.0:1784191849.740471:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.740474:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4000, rc 0) 00000100:00100000:2.0:1784191849.740513:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+28:161504:x1870858827891456:12345-0@lo:101:mdt00_003.0 Request processed in 163us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.740519:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1784191849.740547:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2387a79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.740566:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827891456:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1784191849.740582:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5600/0xfeec3c2dc5a4a7ff lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a806 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.740592:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5600/0xfeec3c2dc5a4a7ff lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a806 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191849.740616:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007831a79f reply state 00000000e137044f transno 21474836533 ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a7f8 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.740630:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a7f8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.740644:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xa:0x0].0x0 (ffff8af2331f1200) 00010000:00010000:2.0:1784191849.740646:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191849.740650:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191849.740658:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5600/0xfeec3c2dc5a4a7ff lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a806 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.740665:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5600/0xfeec3c2dc5a4a7ff lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a806 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191849.740677:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0xa:0x0] 00000004:00010000:2.0:1784191849.740685:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007831a79f reply state 00000000e137044f transno 21474836533 ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a7f1 lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.740716:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a7f1 lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.740723:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x7:0x0].0x0 (ffff8af2331f1800) 00010000:00010000:2.0:1784191849.740725:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191849.740727:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1784191849.740732:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x7:0x0]: returning size 4096 00000004:00080000:2.0:1784191849.740742:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1784191849.740750:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3e00/0xfeec3c2dc5a4a7d5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a7dc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.740756:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3e00/0xfeec3c2dc5a4a7d5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a7dc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.740763:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3e00/0xfeec3c2dc5a4a7d5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a7dc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.740799:0:161504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1784191849.740808:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1784191849.740813:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4a7e3 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a7ea expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.740819:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4a7e3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a7ea expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.740897:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191849.740905:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3e00/0xfeec3c2dc5a4a7d5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4a7dc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191849.740908:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:122829:x1870858812337024:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 52802us (53338us total) trans 21474836533 rc 0/0 00010000:00010000:1.0:1784191849.740924:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af110db3e00 already unused, calling callback (ffffffffc19a1ed0) 00000100:00100000:2.0:1784191849.740926:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 409 00010000:00010000:1.0:1784191849.740932:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3e00/0xfeec3c2dc5a4a7d5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a7dc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191849.740943:0:158654:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3e00/0xfeec3c2dc5a4a7d5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a7dc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.740974:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3e00/0xfeec3c2dc5a4a7d5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a7dc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.740982:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191849.741024:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3e00/0xfeec3c2dc5a4a7d5 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a7dc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.741032:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3e00/0xfeec3c2dc5a4a7d5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a7dc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.741059:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191849.741060:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191849.741062:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191849.741122:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827891584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191849.741160:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191849.742029:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827891584 00000100:00100000:1.0:1784191849.742038:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827891584 00000100:00100000:1.0:1784191849.742100:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784191849.742110:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+28:106502:x1870858827891584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191849.742126:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191849.742149:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a7dc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a7d5 expref: 28 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.742165:0:160189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:1.0:1784191849.742169:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191849.742329:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+27:106502:x1870858827891584:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.742336:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784191849.742427:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827891584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784191849.778952:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191849.779079:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812337280 00000100:00100000:3.0:1784191849.779092:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812337280 00000100:00100000:3.0:1784191849.779155:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 410 00000100:00100000:3.0:1784191849.779165:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:122829:x1870858812337280:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1784191849.779196:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191849.779221:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2600/0xfeec3c2dc5a4a80d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b68c expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.779289:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4a814 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.779304:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4a814 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.779315:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4a814 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191849.779378:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784191849.779382:0:164531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784191849.779404:0:164531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4a814 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.779461:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2600/0xfeec3c2dc5a4a80d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b68c expref: 7 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.779482:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4a814 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b68c expref: 6 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.779492:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191849.779495:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784191849.779499:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db2200, rc 0) 00000100:00100000:3.0:1784191849.779576:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812337280:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 412us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.779583:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 410 00000100:00100000:3.0:1784191849.804195:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191849.804486:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812337408 00000100:00100000:2.0:1784191849.804497:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812337408 00000100:00100000:2.0:1784191849.804573:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 411 00000100:00100000:2.0:1784191849.804583:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812337408:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1784191849.804607:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191849.804629:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a81b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b693 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804750:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a822 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804776:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804789:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804819:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a829 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804828:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804835:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804878:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a822 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804886:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a822 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804893:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a822 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804899:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a822 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804905:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191849.804909:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a822 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804916:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a822 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804929:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.804932:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.804936:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a822 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804951:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a822 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804966:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804972:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a829 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804978:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804984:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191849.804987:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804992:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a829 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.804999:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9d6f79b8 (ffff8af202c46d00) 00010000:00010000:2.0:1784191849.805002:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.805005:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a829 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.805011:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4a829 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.805052:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a81b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b693 expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.805074:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.805076:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.805080:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a81b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b693 expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.805090:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5600, rc 0) 00000100:00100000:2.0:1784191849.805149:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812337408:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 567us (963us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191849.805156:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 411 00000100:00100000:1.0:1784191849.816282:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191849.816393:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812337664 00000100:00100000:2.0:1784191849.816408:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812337664 00000100:00100000:2.0:1784191849.816477:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 412 00000100:00100000:2.0:1784191849.816489:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:122829:x1870858812337664:12345-192.168.204.16@tcp:36:lfs.0 00000100:00100000:2.0:1784191849.817242:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827891712:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.817356:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.817434:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2206fd000 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.819993:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827891712 00000100:00100000:0.0:1784191849.820037:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827891712 00000100:00100000:1.0:1784191849.820543:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1784191849.820557:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+27:161504:x1870858827891712:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.820734:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+27:161504:x1870858827891712:12345-0@lo:1000:mdt00_003.0 Request processed in 180us (3387us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.820742:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:2.0:1784191849.820960:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827891712:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.821057:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827891840:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.821098:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.821133:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2206fd000 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.821831:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827891840 00000100:00100000:0.0:1784191849.821842:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827891840 00000100:00100000:0.0:1784191849.821908:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1784191849.821918:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+27:161504:x1870858827891840:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.822091:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+27:161504:x1870858827891840:12345-0@lo:1000:mdt00_003.0 Request processed in 174us (991us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784191849.822100:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:2.0:1784191849.822959:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827891840:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1784191849.823067:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.823097:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.823108:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191849.823128:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827891968:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1784191849.823178:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.823210:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2206fd240 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.823674:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827891968 00000100:00100000:1.0:1784191849.823680:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827891968 00000100:00100000:1.0:1784191849.823754:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1784191849.823760:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+27:161504:x1870858827891968:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.823790:0:159636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191849.823804:0:159636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4a837 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a830 expref: -99 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.823829:0:159636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4a814 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b68c expref: 5 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.823837:0:159636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4a837 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a830 expref: 28 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.823857:0:159636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4a814 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b68c expref: 5 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.823867:0:159636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4a814 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b68c expref: 5 pid: 164531 timeout: 5570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.823875:0:159636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310ad80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:159636:1870858827892096:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191849.824231:0:159636:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf07480 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.830736:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191849.830802:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812337792 00000100:00100000:3.0:1784191849.830814:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812337792 00000100:00100000:1.0:1784191849.830890:0:159636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310ad80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:159636:1870858827892096:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191849.830928:0:159636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4a837 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a830 expref: 28 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.830941:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:1.0:1784191849.830944:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191849.830948:0:159636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4a837 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a830 expref: 28 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.830979:0:159636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233127000, rc 0) 00000100:00100000:1.0:1784191849.831042:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+28:161504:x1870858827891968:12345-0@lo:101:mdt00_003.0 Request processed in 7281us (7863us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.831050:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:0.0:1784191849.831141:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827891968:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1784191849.831159:0:161504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a837 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.831170:0:161504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a837 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.831252:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4a814 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b68c expref: 6 pid: 164531 timeout: 5570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191849.831302:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 95 00000100:00100000:2.0:1784191849.831311:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23d2c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812337792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191849.831326:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191849.831333:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4a814 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b68c expref: 6 pid: 164531 timeout: 5570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.831357:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4a814 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b68c expref: 6 pid: 164531 timeout: 5570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.831382:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4a814 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b68c expref: 6 pid: 164531 timeout: 5570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.831395:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.831399:0:158651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4a837 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a830 expref: 27 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.831422:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4a837 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a830 expref: 27 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.831432:0:158651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4a837 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a830 expref: 27 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.831468:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4a837 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a830 expref: 27 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191849.831482:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:158651:1870858827892224:0@lo:105: 00000100:00100000:2.0:1784191849.831523:0:158651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.831562:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2206fd000 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.833895:0:158649:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784191849.833927:0:158649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827892224 00000100:00100000:1.0:1784191849.833936:0:158649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827892224 00000100:00100000:1.0:1784191849.834014:0:158649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784191849.834026:0:158649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cef8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:158651:x1870858827892224:12345-0@lo:105: 00010000:00010000:1.0:1784191849.834045:0:158649:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a837 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.834056:0:158649:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a837 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.834063:0:158649:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a837 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.834069:0:158649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a837 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.834076:0:158649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a837 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.834083:0:158649:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4a837 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.834189:0:158649:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af1019d5600) 00000100:00100000:1.0:1784191849.834267:0:158649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cef8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:158651:x1870858827892224:12345-0@lo:105: Request processed in 243us (2743us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.834273:0:158649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1784191849.834446:0:161504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a837 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.834458:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a837 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191849.834486:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784191849.834532:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a83e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.834540:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a83e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.834564:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a83e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.834584:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827892352:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1784191849.834622:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.834831:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:158651:1870858827892224:0@lo:105: 00010000:00010000:2.0:1784191849.834851:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191849.834937:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23d2c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69109:x1870858812337792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3625us (4209us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.834947:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 95 00000100:00100000:0.0:1784191849.835185:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2387a79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.835539:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827892352 00000100:00100000:1.0:1784191849.835546:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827892352 00000100:00100000:1.0:1784191849.835583:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1784191849.835591:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+28:161504:x1870858827892352:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.835610:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191849.835632:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127a00/0xfeec3c2dc5a4a845 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a83e expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.835658:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127a00/0xfeec3c2dc5a4a845 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a83e expref: 29 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.835670:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127a00/0xfeec3c2dc5a4a845 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a83e expref: 29 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.835676:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9d6f79b8 (ffff8af207498f00) 00010000:00010000:1.0:1784191849.835678:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191849.835680:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233127a00, rc 0) 00000100:00100000:1.0:1784191849.835824:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+29:161504:x1870858827892352:12345-0@lo:101:mdt00_003.0 Request processed in 234us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.835828:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1784191849.835872:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827892352:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1784191849.835885:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a83e lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a845 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.835894:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a83e lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a845 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191849.835908:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1784191849.835945:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827892480:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.835993:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.836054:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2387a7180 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.836095:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827892480 00000100:00100000:1.0:1784191849.836099:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827892480 00000100:00100000:2.0:1784191849.837511:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1784191849.837532:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+29:161504:x1870858827892480:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.837643:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+29:161504:x1870858827892480:12345-0@lo:1000:mdt00_003.0 Request processed in 120us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.837651:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:0.0:1784191849.837743:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827892480:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.837809:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827892608:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.837843:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.837866:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2387a7180 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.837881:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827892608 00000100:00100000:3.0:1784191849.837888:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827892608 00000100:00100000:3.0:1784191849.837969:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:3.0:1784191849.837978:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+29:161504:x1870858827892608:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.838085:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+29:161504:x1870858827892608:12345-0@lo:1000:mdt00_003.0 Request processed in 108us (241us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784191849.838092:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1784191849.838150:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827892608:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.838228:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827892736:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.838253:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.838290:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2387a7180 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.841871:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827892736 00000100:00100000:2.0:1784191849.841888:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827892736 00000100:00100000:2.0:1784191849.841963:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:2.0:1784191849.841987:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+29:161504:x1870858827892736:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.842154:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+29:161504:x1870858827892736:12345-0@lo:1000:mdt00_003.0 Request processed in 169us (3899us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784191849.842162:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1784191849.842484:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827892736:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.842582:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827892864:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.842629:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.842670:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2387a7180 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.842860:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827892864 00000100:00100000:2.0:1784191849.842866:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827892864 00000100:00100000:2.0:1784191849.842911:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:2.0:1784191849.842919:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+29:161504:x1870858827892864:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.842987:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+29:161504:x1870858827892864:12345-0@lo:1000:mdt00_003.0 Request processed in 69us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.842994:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1784191849.843126:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827892864:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.843173:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827892992:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.843197:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.843220:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2387a7180 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.843300:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827892992 00000100:00100000:1.0:1784191849.843305:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827892992 00000100:00100000:1.0:1784191849.843342:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1784191849.843360:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+29:161504:x1870858827892992:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.843423:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+29:161504:x1870858827892992:12345-0@lo:1000:mdt00_003.0 Request processed in 64us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.843429:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1784191849.843567:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827892992:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.843606:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827893120:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.843627:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.843648:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2387a7180 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.843729:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827893120 00000100:00100000:2.0:1784191849.843733:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827893120 00000100:00100000:2.0:1784191849.843751:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1784191849.843756:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+29:161504:x1870858827893120:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.843797:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+29:161504:x1870858827893120:12345-0@lo:1000:mdt00_003.0 Request processed in 41us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.843803:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1784191849.843867:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827893120:0@lo:1000:mdt00_003.0 00080000:00000400:0.0:1784191849.844390:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 259 < left 336, rollback = 2 00080000:00000400:0.0:1784191849.844395:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.844398:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:0.0:1784191849.844400:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.844403:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/1, delete: 0/0/0 00080000:00000400:0.0:1784191849.844405:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191849.844478:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 258 < left 336, rollback = 2 00080000:00000400:0.0:1784191849.844482:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.844484:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:0.0:1784191849.844486:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.844488:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/2, delete: 0/0/0 00080000:00000400:0.0:1784191849.844490:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191849.844646:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 257 < left 336, rollback = 2 00080000:00000400:0.0:1784191849.844656:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.844658:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:0.0:1784191849.844660:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.844662:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:0.0:1784191849.844664:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191849.844686:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 257 < left 336, rollback = 2 00080000:00000400:0.0:1784191849.844744:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.844746:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:0.0:1784191849.844748:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.844750:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:0.0:1784191849.844752:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191849.844764:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 257 < left 336, rollback = 2 00080000:00000400:0.0:1784191849.844766:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.844768:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:0.0:1784191849.844770:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.844772:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:0.0:1784191849.844774:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191849.844803:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 257 < left 336, rollback = 2 00080000:00000400:0.0:1784191849.844806:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/0, destroy: 0/0/0 00080000:00000400:0.0:1784191849.844808:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:0.0:1784191849.844809:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191849.844811:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:0.0:1784191849.844813:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00000040:00080000:0.0:1784191849.844885:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002340:0x1:0x0].14, 2168 off56856 00000040:00080000:0.0:1784191849.844968:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab1:0x1:0x0].14, 2368 off59120 00000004:00080000:0.0:1784191849.844974:0:161504:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af2387a79c0 with version 26 00000004:00080000:2.0:1784191849.845398:0:159400:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af10ef50540 version 26 rpc_version 26 00000020:00100000:2.0:1784191849.845437:0:159400:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784191849.845447:0:159400:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af10db4f480 x1870858827893376/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784191849.845470:0:159400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827893376:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784191849.845550:0:159400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.845588:0:159400:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2206fd840 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.845664:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827893376 00000100:00100000:1.0:1784191849.845672:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827893376 00000100:00100000:1.0:1784191849.845759:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1784191849.845767:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+29:159400:x1870858827893376:12345-0@lo:1000:osp_up0-1.0 00080000:00000400:1.0:1784191849.846055:0:161739:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 292, rollback = 2 00080000:00000400:1.0:1784191849.846059:0:161739:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191849.846061:0:161739:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:1.0:1784191849.846063:0:161739:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/50/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.846065:0:161739:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/0, delete: 0/0/0 00080000:00000400:1.0:1784191849.846067:0:161739:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191849.846174:0:161739:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 258 < left 292, rollback = 2 00080000:00000400:1.0:1784191849.846177:0:161739:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191849.846178:0:161739:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:1.0:1784191849.846180:0:161739:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/50/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.846182:0:161739:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/1, delete: 0/0/0 00080000:00000400:1.0:1784191849.846184:0:161739:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191849.846212:0:161739:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 258 < left 292, rollback = 2 00080000:00000400:1.0:1784191849.846214:0:161739:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191849.846216:0:161739:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:1.0:1784191849.846219:0:161739:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/50/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.846221:0:161739:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/1, delete: 0/0/0 00080000:00000400:1.0:1784191849.846223:0:161739:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00000100:00100000:1.0:1784191849.846995:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+30:159400:x1870858827893376:12345-0@lo:1000:osp_up0-1.0 Request processed in 1223us (1439us total) trans 34359738628 rc 0/0 00000100:00100000:1.0:1784191849.847012:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:2.0:1784191849.856619:0:159400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827893376:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1784191849.863391:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a84c lrc: 3/0,1 mode: --/PW res: [0x240002343:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.863415:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a84c lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.863431:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a84c lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.863475:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4a853 lrc: 3/0,1 mode: --/PW res: [0x240002340:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.863484:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4a853 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.863492:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4a853 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.863533:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e400/0xfeec3c2dc5a4a85a lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.863540:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e400/0xfeec3c2dc5a4a85a lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.863550:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e400/0xfeec3c2dc5a4a85a lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.863584:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827893504:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1784191849.863660:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.863731:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233ca3900 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.864450:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827893504 00000100:00100000:3.0:1784191849.864460:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827893504 00000100:00100000:3.0:1784191849.864521:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1784191849.864531:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+30:161504:x1870858827893504:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1784191849.864568:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191849.864588:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2600/0xfeec3c2dc5a4a861 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a85a expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.864614:0:158671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2600/0xfeec3c2dc5a4a861 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a85a expref: 31 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.864628:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2600/0xfeec3c2dc5a4a861 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a85a expref: 31 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.864638:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff8af215ff6c00) 00010000:00010000:3.0:1784191849.864641:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191849.864645:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db2600, rc 0) 00000100:00100000:3.0:1784191849.864752:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+31:161504:x1870858827893504:12345-0@lo:101:mdt00_003.0 Request processed in 222us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.864758:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:0.0:1784191849.869448:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827893504:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1784191849.869481:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e400/0xfeec3c2dc5a4a85a lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a861 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.869497:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e400/0xfeec3c2dc5a4a85a lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a861 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191849.869527:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000741f09be reply state 00000000a6ed3f46 transno 21474836534 ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4a853 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.869564:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4a853 lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.869571:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xb:0x0].0x0 (ffff8af2331f1600) 00010000:00010000:0.0:1784191849.869575:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191849.869579:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191849.869587:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e400/0xfeec3c2dc5a4a85a lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a861 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.869595:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e400/0xfeec3c2dc5a4a85a lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a861 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191849.869611:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0xb:0x0] 00000004:00010000:0.0:1784191849.869622:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000741f09be reply state 00000000a6ed3f46 transno 21474836534 ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a84c lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.869630:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a84c lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.869635:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x8:0x0].0x0 (ffff8af2331f1c00) 00010000:00010000:0.0:1784191849.869637:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191849.869639:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1784191849.869645:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x8:0x0]: returning size 4096 00000004:00080000:0.0:1784191849.869655:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784191849.869663:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a837 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.869670:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a837 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.869718:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a837 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.869732:0:161504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1784191849.869736:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784191849.869740:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a83e lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a845 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.869745:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a83e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a845 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.869821:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:122829:x1870858812337664:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 53334us (53560us total) trans 21474836534 rc 0/0 00000100:00100000:0.0:1784191849.869828:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 412 00010000:00010000:2.0:1784191849.869989:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191849.869996:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4a837 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.870002:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5600 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:2.0:1784191849.870007:0:158653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a837 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191849.870013:0:158653:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a837 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.870044:0:158653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a837 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.870047:0:158653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191849.870072:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a837 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.870078:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d5600/0xfeec3c2dc5a4a830 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a837 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.870088:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191849.870089:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191849.870090:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191849.870119:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784191849.870132:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827893632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191849.870178:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.870386:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827893632 00000100:00100000:2.0:1784191849.870391:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827893632 00000100:00100000:2.0:1784191849.870431:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784191849.870437:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+31:106500:x1870858827893632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191849.870447:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191849.870467:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4a837 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a830 expref: 31 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.870480:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.870483:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191849.870514:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+30:106500:x1870858827893632:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.870521:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784191849.871317:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827893632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191849.876593:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191849.876665:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812337920 00000100:00100000:2.0:1784191849.876681:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812337920 00000100:00100000:2.0:1784191849.876784:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 413 00000100:00100000:2.0:1784191849.876794:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:122829:x1870858812337920:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1784191849.876816:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191849.876838:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a868 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b69a expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.876893:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a86f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.876905:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a86f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.876917:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a86f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191849.876960:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191849.876964:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191849.876982:0:158667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a86f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.877023:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a868 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b69a expref: 7 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.877042:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a86f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b69a expref: 6 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.877050:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.877053:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191849.877056:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5800, rc 0) 00000100:00100000:2.0:1784191849.877106:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812337920:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 313us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.877112:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 413 00000100:00100000:3.0:1784191849.889845:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191849.890384:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812338048 00000100:00100000:2.0:1784191849.890397:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812338048 00000100:00100000:2.0:1784191849.890473:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 414 00000100:00100000:2.0:1784191849.890483:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812338048:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1784191849.890505:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191849.890526:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a876 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b6a1 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890594:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a87d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890611:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a87d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890622:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a87d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890652:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a884 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890659:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a884 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890666:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a884 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890752:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a87d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890760:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a87d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890766:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a87d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890773:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a87d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890779:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191849.890784:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a87d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890791:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a87d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890802:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.890805:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.890809:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a87d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890823:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a87d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890838:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a884 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890844:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a884 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890850:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a884 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890854:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191849.890857:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a884 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890862:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a884 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890869:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9feaf7a7 (ffff8af202c46d00) 00010000:00010000:2.0:1784191849.890872:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.890874:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a884 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890878:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a884 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890909:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a876 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6a1 expref: 7 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890931:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.890933:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.890937:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4a876 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6a1 expref: 7 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.890947:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4a00, rc 0) 00000100:00100000:2.0:1784191849.891017:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812338048:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 535us (1182us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191849.891024:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 414 00000100:00100000:1.0:1784191849.901880:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191849.902079:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812338304 00000100:00100000:0.0:1784191849.902089:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812338304 00000100:00100000:0.0:1784191849.902155:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 415 00000100:00100000:0.0:1784191849.902165:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:122829:x1870858812338304:12345-192.168.204.16@tcp:36:lfs.0 00000100:00100000:0.0:1784191849.902300:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c78380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827893760:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.902364:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.902402:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2387a7480 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.902515:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827893760 00000100:00100000:1.0:1784191849.902520:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827893760 00000100:00100000:1.0:1784191849.902555:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1784191849.902563:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+30:161504:x1870858827893760:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.902649:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+30:161504:x1870858827893760:12345-0@lo:1000:mdt00_003.0 Request processed in 86us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.902656:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:3.0:1784191849.902826:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c78380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827893760:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.902881:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcff100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827893888:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.902909:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.902939:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.902988:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827893888 00000100:00100000:1.0:1784191849.902992:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827893888 00000100:00100000:1.0:1784191849.903024:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1784191849.903031:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+30:161504:x1870858827893888:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.903106:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+30:161504:x1870858827893888:12345-0@lo:1000:mdt00_003.0 Request processed in 75us (195us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784191849.903113:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:3.0:1784191849.903214:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcff100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827893888:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1784191849.903260:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3c00/0xfeec3c2dc5a4a88b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.903270:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3c00/0xfeec3c2dc5a4a88b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.903312:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3c00/0xfeec3c2dc5a4a88b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.903324:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcff100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827894016:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1784191849.903359:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.903382:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.903487:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827894016 00000100:00100000:1.0:1784191849.903492:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827894016 00000100:00100000:1.0:1784191849.903520:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1784191849.903527:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+30:161504:x1870858827894016:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.903537:0:159636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191849.903558:0:159636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4a892 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a88b expref: -99 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.903583:0:159636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a86f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b69a expref: 5 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.903592:0:159636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4a892 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a88b expref: 31 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.903618:0:159636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a86f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b69a expref: 5 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.903630:0:159636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a86f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b69a expref: 5 pid: 158667 timeout: 5570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.903640:0:159636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdba300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:159636:1870858827894144:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191849.903734:0:159636:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf070c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.915428:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191849.915843:0:159636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdba300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:159636:1870858827894144:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191849.915883:0:159636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4a892 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a88b expref: 31 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.915899:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:1.0:1784191849.915902:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191849.915907:0:159636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4a892 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a88b expref: 31 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.915918:0:159636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233127800, rc 0) 00000100:00100000:1.0:1784191849.916260:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+31:161504:x1870858827894016:12345-0@lo:101:mdt00_003.0 Request processed in 12731us (12897us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.916270:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:3.0:1784191849.917974:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812338432 00000100:00100000:3.0:1784191849.917987:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812338432 00010000:00010000:3.0:1784191849.918035:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a86f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b69a expref: 6 pid: 158667 timeout: 5570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.918091:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 96 00000100:00100000:3.0:1784191849.918109:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812338432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191849.918125:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191849.918132:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a86f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b69a expref: 6 pid: 158667 timeout: 5570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.918157:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a86f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b69a expref: 6 pid: 158667 timeout: 5570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.918183:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4a86f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b69a expref: 6 pid: 158667 timeout: 5570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.918200:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191849.918206:0:158650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4a892 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a88b expref: 30 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.918238:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4a892 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a88b expref: 30 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.918246:0:158650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4a892 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a88b expref: 30 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.918301:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4a892 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a88b expref: 30 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.918329:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:158650:1870858827894272:0@lo:105: 00000100:00100000:3.0:1784191849.918407:0:158650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.918464:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.918623:0:158649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827894272 00000100:00100000:1.0:1784191849.918628:0:158649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827894272 00000100:00100000:1.0:1784191849.918667:0:158649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784191849.918675:0:158649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:158650:x1870858827894272:12345-0@lo:105: 00010000:00010000:1.0:1784191849.918720:0:158649:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3c00/0xfeec3c2dc5a4a88b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a892 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.918731:0:158649:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3c00/0xfeec3c2dc5a4a88b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a892 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.918740:0:158649:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3c00/0xfeec3c2dc5a4a88b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a892 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.918748:0:158649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3c00/0xfeec3c2dc5a4a88b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a892 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.918756:0:158649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3c00/0xfeec3c2dc5a4a88b lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a892 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.918763:0:158649:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3c00/0xfeec3c2dc5a4a88b lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4a892 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.918778:0:158649:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af110db3c00) 00000100:00100000:1.0:1784191849.918821:0:158649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:158650:x1870858827894272:12345-0@lo:105: Request processed in 147us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.918839:0:158649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784191849.918925:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:158650:1870858827894272:0@lo:105: 00010000:00010000:3.0:1784191849.918941:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191849.918987:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812338432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 887us (3579us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.918995:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 96 00000100:00100000:2.0:1784191849.921979:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcff100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827894016:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1784191849.922092:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3c00/0xfeec3c2dc5a4a88b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a892 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191849.922122:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1784191849.922175:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d4a00/0xfeec3c2dc5a4a899 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.922182:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d4a00/0xfeec3c2dc5a4a899 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.922193:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d4a00/0xfeec3c2dc5a4a899 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191849.922215:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827894400:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1784191849.922279:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.922459:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af20388de40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.922507:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827894400 00000100:00100000:1.0:1784191849.922514:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827894400 00000100:00100000:1.0:1784191849.922603:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1784191849.922614:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+31:161504:x1870858827894400:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.922632:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191849.922651:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4a8a0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a899 expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.922676:0:158671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4a8a0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a899 expref: 32 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.925968:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4a8a0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a899 expref: 32 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.925987:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9feaf7a7 (ffff8af20db3d200) 00010000:00010000:1.0:1784191849.925990:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191849.925994:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233126400, rc 0) 00000100:00100000:1.0:1784191849.926144:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+32:161504:x1870858827894400:12345-0@lo:101:mdt00_003.0 Request processed in 3531us (3863us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.926153:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:0.0:1784191849.926612:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827894400:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1784191849.926641:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d4a00/0xfeec3c2dc5a4a899 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a8a0 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.926670:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d4a00/0xfeec3c2dc5a4a899 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a8a0 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191849.926784:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1784191849.926843:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827894528:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.926888:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.926959:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e7386c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.927212:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827894528 00000100:00100000:1.0:1784191849.927220:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827894528 00000100:00100000:1.0:1784191849.927269:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1784191849.927279:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+32:161504:x1870858827894528:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.927457:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+32:161504:x1870858827894528:12345-0@lo:1000:mdt00_003.0 Request processed in 179us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.927476:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1784191849.928808:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827894528:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.928891:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827894656:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.928941:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.928984:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fda80 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.929244:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827894656 00000100:00100000:2.0:1784191849.929261:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827894656 00000100:00100000:2.0:1784191849.929728:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1784191849.929739:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+32:161504:x1870858827894656:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191849.929850:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+32:161504:x1870858827894656:12345-0@lo:1000:mdt00_003.0 Request processed in 113us (908us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784191849.929858:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1784191849.929956:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827894656:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.930051:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827894784:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.930078:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.942081:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fda80 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.944889:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827894784 00000100:00100000:1.0:1784191849.944905:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827894784 00000100:00100000:1.0:1784191849.944985:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:1.0:1784191849.944996:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+32:161504:x1870858827894784:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.945200:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+32:161504:x1870858827894784:12345-0@lo:1000:mdt00_003.0 Request processed in 205us (15120us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784191849.945209:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1784191849.945767:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827894784:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.945857:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827894912:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.945901:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.945929:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fda80 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.946795:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827894912 00000100:00100000:1.0:1784191849.946804:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827894912 00000100:00100000:1.0:1784191849.946843:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1784191849.946851:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+32:161504:x1870858827894912:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.946942:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+32:161504:x1870858827894912:12345-0@lo:1000:mdt00_003.0 Request processed in 91us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.946949:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1784191849.947073:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827894912:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.947305:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827895040:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.947350:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.947382:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fda80 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.947495:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827895040 00000100:00100000:1.0:1784191849.947500:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827895040 00000100:00100000:1.0:1784191849.947542:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:1.0:1784191849.947549:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+32:161504:x1870858827895040:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.947610:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+32:161504:x1870858827895040:12345-0@lo:1000:mdt00_003.0 Request processed in 61us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.947617:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1784191849.949800:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827895040:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.949895:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827895168:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191849.949956:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.949989:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fda80 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.952009:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827895168 00000100:00100000:1.0:1784191849.952022:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827895168 00000100:00100000:1.0:1784191849.952100:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1784191849.952120:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+32:161504:x1870858827895168:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.952447:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+32:161504:x1870858827895168:12345-0@lo:1000:mdt00_003.0 Request processed in 338us (2490us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.952455:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:3.0:1784191849.952909:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827895168:0@lo:1000:mdt00_003.0 00080000:00000400:3.0:1784191849.959907:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 258 < left 336, rollback = 2 00080000:00000400:3.0:1784191849.959917:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:3.0:1784191849.959920:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:3.0:1784191849.959922:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191849.959924:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/1, delete: 0/0/0 00080000:00000400:3.0:1784191849.959926:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191849.960003:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 257 < left 336, rollback = 2 00080000:00000400:3.0:1784191849.960006:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:3.0:1784191849.960008:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:3.0:1784191849.960010:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191849.960013:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/2, delete: 0/0/0 00080000:00000400:3.0:1784191849.960015:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191849.960951:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:3.0:1784191849.960963:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:3.0:1784191849.960965:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:3.0:1784191849.960967:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191849.960969:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:3.0:1784191849.960971:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191849.960999:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:3.0:1784191849.961002:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:3.0:1784191849.961004:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:3.0:1784191849.961005:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191849.961008:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:3.0:1784191849.961009:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191849.961019:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:3.0:1784191849.961022:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:3.0:1784191849.961024:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:3.0:1784191849.961026:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191849.961028:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:3.0:1784191849.961029:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191849.961082:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:3.0:1784191849.961085:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:3.0:1784191849.961087:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:3.0:1784191849.961089:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191849.961090:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:3.0:1784191849.961092:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00000040:00080000:3.0:1784191849.961841:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002340:0x1:0x0].15, 2168 off59024 00000040:00080000:3.0:1784191849.961935:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab1:0x1:0x0].15, 2368 off61488 00000004:00080000:3.0:1784191849.961942:0:161504:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af2127fd0c0 with version 27 00000004:00080000:2.0:1784191849.962017:0:159400:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af10ef50540 version 27 rpc_version 27 00000020:00100000:2.0:1784191849.962072:0:159400:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784191849.962084:0:159400:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af10db4e300 x1870858827895424/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784191849.962122:0:159400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4e300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827895424:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784191849.962212:0:159400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.962255:0:159400:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af20388de40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.962395:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827895424 00000100:00100000:1.0:1784191849.962403:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827895424 00000100:00100000:1.0:1784191849.962464:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:1.0:1784191849.962475:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+32:159400:x1870858827895424:12345-0@lo:1000:osp_up0-1.0 00080000:00000400:1.0:1784191849.962818:0:158671:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 292, rollback = 2 00080000:00000400:1.0:1784191849.962823:0:158671:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191849.962825:0:158671:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:1.0:1784191849.962827:0:158671:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/50/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.962828:0:158671:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/0, delete: 0/0/0 00080000:00000400:1.0:1784191849.962830:0:158671:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191849.962932:0:158671:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 292, rollback = 2 00080000:00000400:1.0:1784191849.962935:0:158671:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191849.962937:0:158671:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:1.0:1784191849.962939:0:158671:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/50/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.962940:0:158671:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/1, delete: 0/0/0 00080000:00000400:1.0:1784191849.962942:0:158671:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191849.962969:0:158671:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 292, rollback = 2 00080000:00000400:1.0:1784191849.962971:0:158671:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191849.962973:0:158671:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 5/292/0 00080000:00000400:1.0:1784191849.962975:0:158671:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/50/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191849.962977:0:158671:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/1, delete: 0/0/0 00080000:00000400:1.0:1784191849.962979:0:158671:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00000100:00100000:1.0:1784191849.963210:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+33:159400:x1870858827895424:12345-0@lo:1000:osp_up0-1.0 Request processed in 736us (997us total) trans 34359738629 rc 0/0 00000100:00100000:1.0:1784191849.963218:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1784191849.963826:0:159400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4e300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827895424:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1784191849.963987:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4a8a7 lrc: 3/0,1 mode: --/PW res: [0x240002343:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.964004:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4a8a7 lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.964015:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4a8a7 lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.964046:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4a8ae lrc: 3/0,1 mode: --/PW res: [0x240002340:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.964054:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4a8ae lrc: 3/0,1 mode: PW/PW res: [0x240002340:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.964061:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4a8ae lrc: 3/0,1 mode: PW/PW res: [0x240002340:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.964092:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4a8b5 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.964098:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4a8b5 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.964133:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4a8b5 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.964161:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827895552:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1784191849.964204:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.964234:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e738000 going to sleep for 11 seconds 00000100:00100000:2.0:1784191849.964398:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827895552 00000100:00100000:2.0:1784191849.964404:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827895552 00000100:00100000:2.0:1784191849.964451:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1784191849.964460:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+33:161504:x1870858827895552:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1784191849.964480:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191849.964498:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a8bc lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a8b5 expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.964531:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a8bc lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a8b5 expref: 34 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.964543:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a8bc lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a8b5 expref: 34 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.964563:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff8af202c46300) 00010000:00010000:2.0:1784191849.964566:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.964569:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5000, rc 0) 00000100:00100000:2.0:1784191849.964621:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+34:161504:x1870858827895552:12345-0@lo:101:mdt00_003.0 Request processed in 161us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.964628:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:1.0:1784191849.965018:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827895552:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191849.965054:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4a8b5 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a8bc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.965065:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4a8b5 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a8bc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191849.965089:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005fd432dd reply state 00000000d361691c transno 21474836535 ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4a8ae lrc: 3/0,1 mode: PW/PW res: [0x240002340:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.965111:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4a8ae lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.965119:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xc:0x0].0x0 (ffff8af210dfe900) 00010000:00010000:1.0:1784191849.965122:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191849.965125:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191849.965131:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4a8b5 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a8bc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.965304:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4a8b5 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a8bc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191849.965319:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0xc:0x0] 00000004:00010000:1.0:1784191849.965328:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005fd432dd reply state 00000000d361691c transno 21474836535 ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4a8a7 lrc: 3/0,1 mode: PW/PW res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.965338:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4a8a7 lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.965354:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x9:0x0].0x0 (ffff8af2331f1100) 00010000:00010000:1.0:1784191849.965357:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191849.965366:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1784191849.965372:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x9:0x0]: returning size 4096 00000004:00080000:1.0:1784191849.965381:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784191849.965391:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3c00/0xfeec3c2dc5a4a88b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a892 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.965398:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3c00/0xfeec3c2dc5a4a88b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a892 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.965406:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3c00/0xfeec3c2dc5a4a88b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a892 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.965434:0:161504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1784191849.965440:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784191849.965444:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d4a00/0xfeec3c2dc5a4a899 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a8a0 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191849.965451:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d4a00/0xfeec3c2dc5a4a899 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a8a0 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191849.965612:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:122829:x1870858812338304:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 63446us (63739us total) trans 21474836535 rc 0/0 00000100:00100000:1.0:1784191849.965621:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 415 00010000:00010000:2.0:1784191849.965793:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191849.965800:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3c00/0xfeec3c2dc5a4a88b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4a892 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.965808:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af110db3c00 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:2.0:1784191849.965814:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3c00/0xfeec3c2dc5a4a88b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a892 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191849.965823:0:160901:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3c00/0xfeec3c2dc5a4a88b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a892 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.965857:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3c00/0xfeec3c2dc5a4a88b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a892 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.965863:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191849.965895:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3c00/0xfeec3c2dc5a4a88b lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a892 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.965904:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3c00/0xfeec3c2dc5a4a88b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a892 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.965930:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191849.965931:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191849.965933:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191849.965978:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784191849.965994:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827895680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191849.966055:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191849.966437:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827895680 00000100:00100000:2.0:1784191849.966444:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827895680 00000100:00100000:2.0:1784191849.966497:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784191849.966505:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+34:106499:x1870858827895680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191849.966587:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191849.966612:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4a892 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a88b expref: 34 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.966630:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.966634:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191849.966673:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+33:106499:x1870858827895680:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.966680:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784191849.966756:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827895680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191849.969805:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191849.970019:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812338560 00000100:00100000:3.0:1784191849.970226:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812338560 00000100:00100000:3.0:1784191849.970283:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 416 00000100:00100000:3.0:1784191849.970292:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:122829:x1870858812338560:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1784191849.970315:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191849.970361:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2a00/0xfeec3c2dc5a4a8c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b6a8 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.970440:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4a8ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.970456:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4a8ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.970470:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4a8ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191849.973280:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784191849.973291:0:158666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784191849.973326:0:158666:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4a8ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.973379:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2a00/0xfeec3c2dc5a4a8c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6a8 expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.973400:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4a8ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6a8 expref: 6 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.973408:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:3.0:1784191849.973411:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784191849.973414:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3800, rc 0) 00000100:00100000:3.0:1784191849.973501:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812338560:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3208us (3705us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191849.973511:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 416 00000100:00100000:3.0:1784191849.979454:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191849.982968:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812338688 00000100:00100000:2.0:1784191849.982982:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812338688 00000100:00100000:2.0:1784191849.983281:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 417 00000100:00100000:2.0:1784191849.983295:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812338688:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1784191849.983325:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191849.983360:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a8d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b6af expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983432:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a8d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983465:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a8d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983479:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a8d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983495:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a8df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983502:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a8df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983509:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a8df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983566:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a8d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983573:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a8d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983580:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a8d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983586:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191849.983591:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a8d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983598:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a8d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983611:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.983620:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.983625:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a8d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983632:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4a8d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983648:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a8df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983653:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a8df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983658:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a8df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983663:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191849.983666:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a8df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983671:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a8df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983679:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdab9809a (ffff8af202c46000) 00010000:00010000:2.0:1784191849.983682:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.983684:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a8df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983748:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4a8df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983781:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a8d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6af expref: 7 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983798:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191849.983801:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191849.983805:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a8d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6af expref: 7 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191849.983813:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5600, rc 0) 00000100:00100000:2.0:1784191849.983889:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:122829:x1870858812338688:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 598us (4445us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191849.983896:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 417 00000100:00100000:1.0:1784191849.988998:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191849.989099:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812338944 00000100:00100000:0.0:1784191849.989119:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812338944 00000100:00100000:0.0:1784191849.989259:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 418 00000100:00100000:0.0:1784191849.989270:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:122829:x1870858812338944:12345-192.168.204.16@tcp:36:lfs.0 00000100:00100000:0.0:1784191849.989569:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827895808:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.989622:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.989655:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e7380c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.990241:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827895808 00000100:00100000:1.0:1784191849.990247:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827895808 00000100:00100000:1.0:1784191849.990291:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:1.0:1784191849.990299:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+33:161504:x1870858827895808:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.990462:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+33:161504:x1870858827895808:12345-0@lo:1000:mdt00_003.0 Request processed in 163us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191849.990484:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:0.0:1784191849.990861:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827895808:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.990918:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827895936:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191849.990957:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.991255:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e7380c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191849.991923:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827895936 00000100:00100000:1.0:1784191849.991931:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827895936 00000100:00100000:1.0:1784191849.991981:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1784191849.991989:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af205711850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+33:161504:x1870858827895936:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191849.992162:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af205711850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+33:161504:x1870858827895936:12345-0@lo:1000:mdt00_003.0 Request processed in 173us (1204us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784191849.992170:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:0.0:1784191849.994400:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827895936:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1784191849.994486:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.994512:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191849.994526:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191849.994547:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827896064:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1784191849.994614:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.994657:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e738cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191849.994960:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827896064 00000100:00100000:3.0:1784191849.994967:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827896064 00000100:00100000:3.0:1784191849.995011:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:3.0:1784191849.995020:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+33:161504:x1870858827896064:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1784191849.995050:0:161739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191849.995068:0:161739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2a00/0xfeec3c2dc5a4a8ed lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a8e6 expref: -99 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.995108:0:161739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4a8ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6a8 expref: 5 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.995119:0:161739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2a00/0xfeec3c2dc5a4a8ed lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a8e6 expref: 34 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.995156:0:161739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4a8ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6a8 expref: 5 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191849.995171:0:161739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4a8ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6a8 expref: 5 pid: 158666 timeout: 5570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191849.995183:0:161739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfc000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827896192:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191849.995263:0:161739:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af104849900 going to sleep for 11 seconds 00000100:00100000:0.0:1784191849.995849:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827896320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191849.995891:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191849.996657:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827896448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784191849.996718:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191849.999460:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827896320 00000100:00100000:0.0:1784191849.999474:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827896320 00000100:00100000:2.0:1784191849.999590:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827896448 00000100:00100000:2.0:1784191849.999595:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827896448 00000100:00100000:2.0:1784191849.999625:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1784191849.999634:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+35:106501:x1870858827896320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784191849.999672:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42557440 avail 36425728 00000100:00100000:2.0:1784191849.999824:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+35:106501:x1870858827896320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 191us (3931us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.999832:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1784191849.999850:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:2.0:1784191849.999856:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827896448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784191849.999871:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42659840 avail 36528128 00000100:00100000:2.0:1784191849.999904:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827896448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (3186us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191849.999909:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:3.0:1784191850.000249:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827896320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784191850.000292:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827896448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784191850.007763:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191850.008158:0:161739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfc000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827896192:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191850.008196:0:161739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2a00/0xfeec3c2dc5a4a8ed lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a8e6 expref: 34 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.008210:0:161739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:1.0:1784191850.008214:0:161739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191850.008218:0:161739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2a00/0xfeec3c2dc5a4a8ed lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a8e6 expref: 34 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.008230:0:161739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db2a00, rc 0) 00000100:00100000:1.0:1784191850.009069:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+34:161504:x1870858827896064:12345-0@lo:101:mdt00_003.0 Request processed in 14044us (14449us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191850.009082:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1784191850.009409:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812339072 00000100:00100000:0.0:1784191850.009419:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812339072 00010000:00010000:0.0:1784191850.009483:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4a8ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6a8 expref: 6 pid: 158666 timeout: 5570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191850.009514:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 97 00000100:00100000:0.0:1784191850.009526:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812339072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191850.009543:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191850.009550:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4a8ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6a8 expref: 6 pid: 158666 timeout: 5570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191850.009564:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4a8ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6a8 expref: 6 pid: 158666 timeout: 5570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191850.009607:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4a8ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6a8 expref: 6 pid: 158666 timeout: 5570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191850.009624:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:0.0:1784191850.009630:0:158650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2a00/0xfeec3c2dc5a4a8ed lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a8e6 expref: 33 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191850.009643:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2a00/0xfeec3c2dc5a4a8ed lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a8e6 expref: 33 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191850.009652:0:158650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2a00/0xfeec3c2dc5a4a8ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a8e6 expref: 33 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191850.009724:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2a00/0xfeec3c2dc5a4a8ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a8e6 expref: 33 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191850.009739:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:158650:1870858827896576:0@lo:105: 00000100:00080000:1.0:1784191850.009751:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784191850.009790:0:158650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191850.009835:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e7380c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191850.009893:0:158649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827896576 00000100:00100000:1.0:1784191850.009897:0:158649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827896576 00000100:00100000:2.0:1784191850.009924:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827896064:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1784191850.009934:0:158649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784191850.009940:0:158649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:158650:x1870858827896576:12345-0@lo:105: 00010000:00010000:2.0:1784191850.009951:0:161504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191850.009960:0:161504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.011480:0:158649:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.011497:0:158649:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.011507:0:158649:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.011589:0:158649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.011598:0:158649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4a8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.011609:0:158649:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4a8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.011632:0:158649:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af10de3e600) 00000100:00100000:1.0:1784191850.011731:0:158649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:158650:x1870858827896576:12345-0@lo:105: Request processed in 1787us (1936us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191850.011739:0:158649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784191850.011779:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:158650:1870858827896576:0@lo:105: 00010000:00010000:0.0:1784191850.011800:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191850.011850:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812339072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2326us (4096us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191850.011857:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 97 00010000:00010000:2.0:1784191850.012991:0:161504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191850.015791:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191850.015837:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784191850.027179:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4a8f4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191850.027222:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4a8f4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191850.027236:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4a8f4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191850.028215:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827896704:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1784191850.028501:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191850.028606:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e7380c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191850.031613:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827896704 00000100:00100000:2.0:1784191850.031631:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827896704 00000100:00100000:3.0:1784191850.031840:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1784191850.031851:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+34:161504:x1870858827896704:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1784191850.031874:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191850.031898:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4a8fb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a8f4 expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191850.031924:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4a8fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a8f4 expref: 35 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191850.031934:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4a8fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a8f4 expref: 35 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191850.031940:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdab9809a (ffff8af215ff6400) 00010000:00010000:3.0:1784191850.031943:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191850.031945:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3600, rc 0) 00000100:00100000:3.0:1784191850.032023:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+35:161504:x1870858827896704:12345-0@lo:101:mdt00_003.0 Request processed in 174us (3523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191850.032029:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1784191850.032477:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827896704:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1784191850.032498:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4a8f4 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a8fb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191850.032510:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4a8f4 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a8fb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191850.032533:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1784191850.032586:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827896832:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191850.032631:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191850.032664:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e738e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191850.032735:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827896832 00000100:00100000:1.0:1784191850.032740:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827896832 00000100:00100000:1.0:1784191850.032784:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1784191850.032793:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+35:161504:x1870858827896832:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191850.032909:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+35:161504:x1870858827896832:12345-0@lo:1000:mdt00_003.0 Request processed in 117us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191850.032932:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:0.0:1784191850.032990:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827896832:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191850.033215:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827896960:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191850.033241:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191850.033486:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e738e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191850.033528:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827896960 00000100:00100000:1.0:1784191850.033533:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827896960 00000100:00100000:1.0:1784191850.033567:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:1.0:1784191850.033575:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+35:161504:x1870858827896960:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191850.033726:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+35:161504:x1870858827896960:12345-0@lo:1000:mdt00_003.0 Request processed in 152us (483us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784191850.033734:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:0.0:1784191850.033833:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827896960:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191850.033907:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827897088:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191850.033938:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191850.034229:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e738e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784191850.034233:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827897088 00000100:00100000:3.0:1784191850.034237:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827897088 00000100:00100000:3.0:1784191850.034280:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1784191850.034289:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+35:161504:x1870858827897088:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191850.034385:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+35:161504:x1870858827897088:12345-0@lo:1000:mdt00_003.0 Request processed in 98us (446us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784191850.034393:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:0.0:1784191850.034613:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827897088:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191850.034665:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827897216:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191850.034770:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191850.034865:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827897216 00000100:00100000:1.0:1784191850.034869:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e738e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784191850.034877:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827897216 00000100:00100000:3.0:1784191850.034904:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:3.0:1784191850.034910:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+35:161504:x1870858827897216:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191850.034977:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+35:161504:x1870858827897216:12345-0@lo:1000:mdt00_003.0 Request processed in 66us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191850.034983:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:1.0:1784191850.035233:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827897216:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191850.037598:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdbb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827897344:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191850.037678:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191850.037743:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf07d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784191850.038405:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827897344 00000100:00100000:0.0:1784191850.038416:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827897344 00000100:00100000:0.0:1784191850.038481:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1784191850.038491:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+35:161504:x1870858827897344:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191850.038615:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+35:161504:x1870858827897344:12345-0@lo:1000:mdt00_003.0 Request processed in 124us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191850.038624:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:1.0:1784191850.038797:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdbb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827897344:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191850.038886:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdbb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827897472:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191850.038920:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191850.038952:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf070c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191850.039015:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827897472 00000100:00100000:0.0:1784191850.039020:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827897472 00000100:00100000:0.0:1784191850.039058:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1784191850.039064:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+35:161504:x1870858827897472:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191850.039368:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+35:161504:x1870858827897472:12345-0@lo:1000:mdt00_003.0 Request processed in 303us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191850.039377:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:1.0:1784191850.039591:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdbb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827897472:0@lo:1000:mdt00_003.0 00080000:00000400:1.0:1784191850.041045:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 258 < left 336, rollback = 2 00080000:00000400:1.0:1784191850.041053:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:1.0:1784191850.041055:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:1.0:1784191850.041058:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191850.041060:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/1, delete: 0/0/0 00080000:00000400:1.0:1784191850.041062:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191850.041172:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 257 < left 336, rollback = 2 00080000:00000400:1.0:1784191850.041180:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:1.0:1784191850.041182:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:1.0:1784191850.041184:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191850.041185:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/2, delete: 0/0/0 00080000:00000400:1.0:1784191850.041187:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191850.041389:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:1.0:1784191850.041392:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:1.0:1784191850.041394:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:1.0:1784191850.041396:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191850.041398:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:1.0:1784191850.041400:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191850.041421:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:1.0:1784191850.041424:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:1.0:1784191850.041426:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:1.0:1784191850.041428:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191850.041430:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:1.0:1784191850.041432:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191850.041442:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:1.0:1784191850.041444:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:1.0:1784191850.041446:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:1.0:1784191850.041448:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191850.041451:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:1.0:1784191850.041453:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191850.041483:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0001: opcode 2: before 256 < left 336, rollback = 2 00080000:00000400:1.0:1784191850.041486:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 3/12/1, destroy: 0/0/0 00080000:00000400:1.0:1784191850.041487:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 7/336/0 00080000:00000400:1.0:1784191850.041489:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/84/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191850.041491:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 10/203/3, delete: 0/0/0 00080000:00000400:1.0:1784191850.041493:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 4/4/0, ref_del: 0/0/0 00000040:00080000:1.0:1784191850.041580:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002340:0x1:0x0].16, 2168 off61192 00000040:00080000:1.0:1784191850.041667:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab1:0x1:0x0].16, 2368 off63856 00000004:00080000:1.0:1784191850.041675:0:161504:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af23cf070c0 with version 28 00000004:00080000:2.0:1784191850.042065:0:159400:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af10ef50540 version 28 rpc_version 28 00000020:00100000:2.0:1784191850.042109:0:159400:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784191850.042119:0:159400:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af10db4df80 x1870858827897728/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784191850.042143:0:159400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827897728:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784191850.042218:0:159400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191850.042255:0:159400:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af21704e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191850.042519:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827897728 00000100:00100000:0.0:1784191850.042529:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827897728 00000100:00100000:0.0:1784191850.042585:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1784191850.042594:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+35:159400:x1870858827897728:12345-0@lo:1000:osp_up0-1.0 00080000:00000400:0.0:1784191850.042949:0:159636:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 306, rollback = 2 00080000:00000400:0.0:1784191850.042953:0:159636:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:0.0:1784191850.042955:0:159636:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:0.0:1784191850.042964:0:159636:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/47/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191850.042966:0:159636:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/0, delete: 0/0/0 00080000:00000400:0.0:1784191850.042968:0:159636:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191850.043092:0:159636:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 258 < left 306, rollback = 2 00080000:00000400:0.0:1784191850.043095:0:159636:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:0.0:1784191850.043097:0:159636:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:0.0:1784191850.043098:0:159636:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/47/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191850.043100:0:159636:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/1, delete: 0/0/0 00080000:00000400:0.0:1784191850.043102:0:159636:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191850.043133:0:159636:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 258 < left 306, rollback = 2 00080000:00000400:0.0:1784191850.043136:0:159636:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:0.0:1784191850.043138:0:159636:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 6/306/0 00080000:00000400:0.0:1784191850.043140:0:159636:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 5/47/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191850.043142:0:159636:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/105/1, delete: 0/0/0 00080000:00000400:0.0:1784191850.043144:0:159636:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191850.043525:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+36:159400:x1870858827897728:12345-0@lo:1000:osp_up0-1.0 Request processed in 930us (1306us total) trans 34359738630 rc 0/0 00000100:00100000:0.0:1784191850.043535:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:2.0:1784191850.043668:0:159400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:159400:1870858827897728:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1784191850.043894:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126600/0xfeec3c2dc5a4a902 lrc: 3/0,1 mode: --/PW res: [0x240002343:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.043910:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126600/0xfeec3c2dc5a4a902 lrc: 3/0,1 mode: PW/PW res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.043936:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126600/0xfeec3c2dc5a4a902 lrc: 3/0,1 mode: PW/PW res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.043958:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4a909 lrc: 3/0,1 mode: --/PW res: [0x240002340:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.043968:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4a909 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.043973:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4a909 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.044009:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127800/0xfeec3c2dc5a4a910 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.044016:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127800/0xfeec3c2dc5a4a910 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.044025:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127800/0xfeec3c2dc5a4a910 lrc: 3/0,1 mode: --/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191850.044044:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdbb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827897856:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1784191850.044084:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191850.044123:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10c77b900 going to sleep for 11 seconds 00000100:00100000:2.0:1784191850.044251:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827897856 00000100:00100000:2.0:1784191850.044257:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827897856 00000100:00100000:2.0:1784191850.044304:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1784191850.044312:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+36:161504:x1870858827897856:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1784191850.044611:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191850.044632:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a917 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a910 expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191850.044655:0:158671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a917 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a910 expref: 37 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191850.044667:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a917 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a910 expref: 37 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191850.044676:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xd:0x0].0x0 (ffff8af202c46000) 00010000:00010000:2.0:1784191850.044679:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191850.044682:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5600, rc 0) 00000100:00100000:2.0:1784191850.044764:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+37:161504:x1870858827897856:12345-0@lo:101:mdt00_003.0 Request processed in 452us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191850.044770:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:1.0:1784191850.044916:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdbb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827897856:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191850.044933:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127800/0xfeec3c2dc5a4a910 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a917 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.044951:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127800/0xfeec3c2dc5a4a910 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a917 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191850.044974:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000255df9ce reply state 000000005f24ca8d transno 21474836536 ns: mdt-lustre-MDT0001_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4a909 lrc: 3/0,1 mode: PW/PW res: [0x240002340:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.044986:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4a909 lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.044992:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xd:0x0].0x0 (ffff8af20db3dc00) 00010000:00010000:1.0:1784191850.044993:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191850.044996:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191850.045002:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127800/0xfeec3c2dc5a4a910 lrc: 4/0,1 mode: PW/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a917 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.045024:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127800/0xfeec3c2dc5a4a910 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a917 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191850.045042:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0xd:0x0] 00000004:00010000:1.0:1784191850.045048:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000255df9ce reply state 000000005f24ca8d transno 21474836536 ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126600/0xfeec3c2dc5a4a902 lrc: 3/0,1 mode: PW/PW res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.045056:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126600/0xfeec3c2dc5a4a902 lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.045061:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0xa:0x0].0x0 (ffff8af20db3d500) 00010000:00010000:1.0:1784191850.045063:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191850.045065:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1784191850.045070:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0xa:0x0]: returning size 4096 00000004:00080000:1.0:1784191850.045086:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784191850.045095:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.045103:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.045109:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4a8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.045133:0:161504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1784191850.045139:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784191850.045143:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4a8f4 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a8fb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191850.045152:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4a8f4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a8fb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191850.045223:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+25:122829:x1870858812338944:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 55953us (56234us total) trans 21474836536 rc 0/0 00000100:00100000:1.0:1784191850.045230:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 418 00010000:00010000:2.0:1784191850.045714:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191850.045722:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4a8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191850.045731:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e600 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:2.0:1784191850.045737:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191850.045746:0:158654:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191850.045781:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191850.045795:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191850.045835:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191850.045842:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4a8e6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191850.045856:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191850.045858:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191850.045859:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191850.045919:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827897984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191850.045968:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191850.046454:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827897984 00000100:00100000:2.0:1784191850.046462:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827897984 00000100:00100000:2.0:1784191850.046521:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784191850.046530:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+37:106499:x1870858827897984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191850.046543:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191850.046564:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2a00/0xfeec3c2dc5a4a8ed lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a8e6 expref: 37 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191850.046579:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:2.0:1784191850.046584:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191850.046623:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+36:106499:x1870858827897984:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191850.046631:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784191850.046763:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827897984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191850.508241:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784191850.508282:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827898112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784191850.508371:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191850.508610:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827898112 00000100:00100000:1.0:1784191850.508618:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827898112 00000100:00100000:1.0:1784191850.508742:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1784191850.508753:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827898112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784191850.508777:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8228544 pending 0 free 71049216 avail 63881216 00000100:00100000:1.0:1784191850.508824:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827898112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191850.508848:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1784191850.509007:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784191850.509075:0:106499:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836540 gen 2 00000004:00080000:3.0:1784191850.509082:0:106499:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af1016bf100, transno 21474836537 00000004:00080000:3.0:1784191850.509106:0:106499:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af1016bdf80, transno 21474836538 00000004:00080000:3.0:1784191850.509109:0:106499:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af1016be300, transno 21474836539 00000004:00080000:3.0:1784191850.509111:0:106499:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af1016bc380, transno 21474836540 00000100:00100000:3.0:1784191850.509122:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827898112:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1784191850.509371:0:158689:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 4 done 00010000:00010000:2.0:1784191850.571939:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191851.602480:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191852.044018:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827898624:0@lo:400:kworker.0 00000100:00100000:1.0:1784191852.044088:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191852.044119:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827899136:0@lo:400:kworker.0 00000100:00100000:1.0:1784191852.044138:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191852.044153:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858827899648:0@lo:400:kworker.0 00000100:00100000:1.0:1784191852.044176:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191852.044201:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784191852.044208:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827898496:0@lo:400:kworker.0 00000100:00100000:1.0:1784191852.044229:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191852.044245:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827899008:0@lo:400:kworker.0 00000100:00100000:1.0:1784191852.044263:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191852.044276:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858827899520:0@lo:400:kworker.0 00000100:00100000:1.0:1784191852.044293:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191852.044333:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827898624 00000100:00100000:1.0:1784191852.044339:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827898624 00000100:00100000:1.0:1784191852.044387:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827899136 00000100:00100000:1.0:1784191852.044389:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827899136 00000100:00100000:1.0:1784191852.044403:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827898496 00000100:00100000:1.0:1784191852.044405:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827898496 00000100:00100000:1.0:1784191852.044419:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827899008 00000100:00100000:1.0:1784191852.044421:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827899008 00000100:00100000:1.0:1784191852.044441:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784191852.044448:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827898624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191852.044497:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827898624:12345-0@lo:400:kworker.0 Request processed in 49us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191852.044519:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784191852.044538:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784191852.044543:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827899136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191852.044572:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827899136:12345-0@lo:400:kworker.0 Request processed in 29us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191852.044578:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784191852.044591:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784191852.044597:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827898496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191852.044641:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827898496:12345-0@lo:400:kworker.0 Request processed in 44us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191852.044647:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784191852.044658:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784191852.044664:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827899008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191852.044718:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827899008:12345-0@lo:400:kworker.0 Request processed in 53us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191852.044724:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784191852.044748:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827899648 00000100:00100000:1.0:1784191852.044752:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827899648 00000100:00100000:1.0:1784191852.044781:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827899520 00000100:00100000:1.0:1784191852.044783:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827899520 00000100:00100000:1.0:1784191852.044804:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1784191852.044809:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858827899648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191852.044841:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858827899648:12345-0@lo:400:kworker.0 Request processed in 31us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191852.044846:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1784191852.044866:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1784191852.044871:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858827899520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191852.044899:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858827899520:12345-0@lo:400:kworker.0 Request processed in 28us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191852.044905:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:1.0:1784191852.044931:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784191852.044935:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784191852.044937:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784191852.044939:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784191852.044983:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827898496:0@lo:400:kworker.0 00000100:00100000:1.0:1784191852.044993:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827899008:0@lo:400:kworker.0 00000100:00100000:1.0:1784191852.045002:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858827899520:0@lo:400:kworker.0 00000100:00100000:1.0:1784191852.045009:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827898624:0@lo:400:kworker.0 00000100:00100000:1.0:1784191852.045017:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827899136:0@lo:400:kworker.0 00000100:00100000:1.0:1784191852.045024:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858827899648:0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.045143:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827898240:0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.045181:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191852.045223:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827898752:0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.045247:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191852.045264:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827899264:0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.045282:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191852.045300:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827899776:0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.045341:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191852.045360:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784191852.045366:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827898368:0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.045391:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191852.045411:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827898880:0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.045431:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191852.045449:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858827899392:0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.045469:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191852.045502:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827898368 00000100:00100000:3.0:1784191852.045506:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827898368 00000100:00100000:3.0:1784191852.045535:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827898880 00000100:00100000:3.0:1784191852.045538:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827898880 00000100:00100000:3.0:1784191852.045558:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1784191852.045565:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827898368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.045604:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827898368:12345-0@lo:400:kworker.0 Request processed in 40us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191852.045610:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1784191852.045624:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:3.0:1784191852.045630:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+36:106501:x1870858827898880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.045657:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+36:106501:x1870858827898880:12345-0@lo:400:kworker.0 Request processed in 27us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191852.045663:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:3.0:1784191852.045685:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827898752 00000100:00100000:3.0:1784191852.045710:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827898752 00000100:00100000:3.0:1784191852.045732:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827899264 00000100:00100000:3.0:1784191852.045735:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827899264 00000100:00100000:3.0:1784191852.045746:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827899776 00000100:00100000:3.0:1784191852.045754:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827899776 00000100:00100000:3.0:1784191852.045778:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827899392 00000100:00100000:3.0:1784191852.045781:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827899392 00000100:00100000:3.0:1784191852.045796:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1784191852.045801:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827898752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.045834:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827898752:12345-0@lo:400:kworker.0 Request processed in 32us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191852.045840:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1784191852.045851:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1784191852.045857:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827899264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.045886:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827899264:12345-0@lo:400:kworker.0 Request processed in 28us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191852.045892:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1784191852.045904:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1784191852.045910:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827899776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.045939:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827899776:12345-0@lo:400:kworker.0 Request processed in 29us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191852.045945:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1784191852.045955:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1784191852.045960:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858827899392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.045985:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858827899392:12345-0@lo:400:kworker.0 Request processed in 25us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191852.045991:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:3.0:1784191852.046010:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784191852.046013:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191852.046036:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827898368:0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.046058:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827898880:0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.046068:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858827899392:0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.046075:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827898752:0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.046084:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827899264:0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.046093:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827899776:0@lo:400:kworker.0 00000100:00100000:1.0:1784191852.046773:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827898240 00000100:00100000:1.0:1784191852.046782:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827898240 00000100:00100000:1.0:1784191852.046868:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1784191852.046877:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827898240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191852.046933:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827898240:12345-0@lo:400:kworker.0 Request processed in 57us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191852.046939:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1784191852.047381:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827899904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784191852.047417:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191852.047463:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827899904 00000100:00100000:2.0:1784191852.047467:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827899904 00000100:00100000:2.0:1784191852.047512:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784191852.047518:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827899904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784191852.047543:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8249024 pending 0 free 71184384 avail 64016384 00000100:00100000:2.0:1784191852.047580:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827899904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191852.047585:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784191852.047636:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827899904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784191852.047774:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827898240:0@lo:400:kworker.0 00000100:00100000:3.0:1784191852.049773:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827900032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191852.049852:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191852.049918:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827900032 00000100:00100000:3.0:1784191852.049926:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827900032 00000100:00100000:3.0:1784191852.049969:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784191852.049978:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827900032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784191852.050002:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8249024 pending 0 free 71184384 avail 64016384 00000100:00100000:3.0:1784191852.050046:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827900032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191852.050053:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784191852.050097:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827900032:0@lo:13:osp-pre-1-0.0 00000020:01000004:1.0:1784191852.459927:0:165077:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1784191852.459987:0:165077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10e24ba00/0xfeec3c2dc5a47562 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a47569 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191852.460014:0:165077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10e24ba00/0xfeec3c2dc5a47562 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a47569 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191852.460020:0:165077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10e24ba00/0xfeec3c2dc5a47562 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a47569 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191852.460028:0:165077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.116@tcp lock: ffff8af10e24ba00/0xfeec3c2dc5a47562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a47569 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191852.460053:0:165077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784191852.460059:0:165077:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784191852.460086:0:165077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784191852.460091:0:165077:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784191852.460097:0:165077:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784191852.460121:0:165077:0:(import.c:65:import_set_state_nolock()) ffff8af23ea14000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1784191852.460182:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191852.460191:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.116@tcp lock: ffff8af10e24ba00/0xfeec3c2dc5a47562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a47569 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.460200:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10e24ba00 already unused, calling callback (ffffffffc1384c20) 10000000:00010000:2.0:1784191852.460204:0:158654:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.116@tcp lock: ffff8af10e24ba00/0xfeec3c2dc5a47562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a47569 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.460213:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af10e24ba00/0xfeec3c2dc5a47562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a47569 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784191852.460220:0:158654:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af10e24ba00/0xfeec3c2dc5a47562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a47569 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784191852.460226:0:158654:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784191852.460229:0:158654:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784191852.460231:0:158654:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784191852.460259:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.116@tcp lock: ffff8af10e24ba00/0xfeec3c2dc5a47562 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a47569 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.460265:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784191852.460325:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784191852.460325:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:106498:1870858827900160:0@lo:39:umount.0 00000100:00100000:0.0:1784191852.460395:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191852.460448:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827900160 00000100:00100000:0.0:1784191852.460455:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827900160 00010000:00010000:2.0:1784191852.460570:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.116@tcp lock: ffff8af10e24ba00/0xfeec3c2dc5a47562 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a47569 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.460578:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af10e24ba00/0xfeec3c2dc5a47562 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a47569 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.460590:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191852.460592:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191852.460594:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191852.461029:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1784191852.461039:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:106498:x1870858827900160:12345-0@lo:39:umount.0 00000020:00000080:0.0:1784191852.461066:0:164531:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4757e 00000100:00080000:0.0:1784191852.461073:0:164531:0:(import.c:65:import_set_state_nolock()) ffff8af105946000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1784191852.461125:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191852.461149:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+1:106498:x1870858827900160:12345-0@lo:39:umount.0 Request processed in 111us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191852.461167:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00080000:3.0:1784191852.461175:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23ea14000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:0.0:1784191852.461176:0:164531:0:(genops.c:906:class_export_put()) final put ffff8af23ea15800/lustre-MDT0000-lwp-MDT0001_UUID 00000100:00100000:3.0:1784191852.461194:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:106498:1870858827900160:0@lo:39:umount.0 00000020:00000080:0.0:1784191852.461201:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23ea15800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00080000:2.0:1784191852.461242:0:165077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784191852.461245:0:165077:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784191852.461248:0:165077:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784191852.461324:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af105946000 for lustre-MDT0000 00010000:00010000:2.0:1784191852.462206:0:165077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af23dd69a00/0xfeec3c2dc5a474c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a474c8 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.462219:0:165077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af23dd69a00/0xfeec3c2dc5a474c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a474c8 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.462226:0:165077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af23dd69a00/0xfeec3c2dc5a474c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a474c8 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.462232:0:165077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.116@tcp lock: ffff8af23dd69a00/0xfeec3c2dc5a474c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a474c8 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.462255:0:165077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191852.462262:0:165077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10e24a600/0xfeec3c2dc5a478db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a478e2 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.462269:0:165077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10e24a600/0xfeec3c2dc5a478db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a478e2 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.462288:0:165077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10e24a600/0xfeec3c2dc5a478db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a478e2 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.462304:0:165077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.116@tcp lock: ffff8af10e24a600/0xfeec3c2dc5a478db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a478e2 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.462326:0:165077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784191852.462335:0:165077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d533c00/0xfeec3c2dc5a47b5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a47b66 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.462342:0:165077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d533c00/0xfeec3c2dc5a47b5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a47b66 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.462349:0:165077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d533c00/0xfeec3c2dc5a47b5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a47b66 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.462356:0:165077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.116@tcp lock: ffff8af10d533c00/0xfeec3c2dc5a47b5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a47b66 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.462369:0:165077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784191852.462383:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784191852.462388:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.116@tcp lock: ffff8af23dd69a00/0xfeec3c2dc5a474c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a474c8 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.462395:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd69a00 already unused, calling callback (ffffffffc1384c20) 00010000:00010000:3.0:1784191852.462501:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784191852.462506:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.116@tcp lock: ffff8af10e24a600/0xfeec3c2dc5a478db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a478e2 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191852.462523:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10e24a600 already unused, calling callback (ffffffffc1384c20) 10000000:00010000:3.0:1784191852.462527:0:160901:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.116@tcp lock: ffff8af10e24a600/0xfeec3c2dc5a478db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a478e2 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191852.462536:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af10e24a600/0xfeec3c2dc5a478db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a478e2 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784191852.462544:0:160901:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af10e24a600/0xfeec3c2dc5a478db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a478e2 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784191852.462550:0:160901:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1784191852.462552:0:160901:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1784191852.462556:0:160901:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1784191852.462586:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.116@tcp lock: ffff8af10e24a600/0xfeec3c2dc5a478db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a478e2 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191852.462593:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784191852.462615:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.116@tcp lock: ffff8af10e24a600/0xfeec3c2dc5a478db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a478e2 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191852.462622:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af10e24a600/0xfeec3c2dc5a478db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a478e2 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191852.462634:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784191852.462638:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.116@tcp lock: ffff8af10d533c00/0xfeec3c2dc5a47b5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a47b66 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191852.462643:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533c00 already unused, calling callback (ffffffffc1384c20) 10000000:00010000:3.0:1784191852.462646:0:160901:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.116@tcp lock: ffff8af10d533c00/0xfeec3c2dc5a47b5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a47b66 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191852.462659:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af10d533c00/0xfeec3c2dc5a47b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a47b66 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784191852.462666:0:160901:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af10d533c00/0xfeec3c2dc5a47b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a47b66 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784191852.462671:0:160901:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784191852.462673:0:160901:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784191852.462675:0:160901:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784191852.462705:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.116@tcp lock: ffff8af10d533c00/0xfeec3c2dc5a47b5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a47b66 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191852.462711:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784191852.462718:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.116@tcp lock: ffff8af10d533c00/0xfeec3c2dc5a47b5f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a47b66 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191852.462724:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af10d533c00/0xfeec3c2dc5a47b5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a47b66 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191852.462733:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191852.462734:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191852.462736:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191852.462753:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827900416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191852.462814:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191852.462865:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784191852.462873:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827900544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191852.462897:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191852.462926:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827900416 00000100:00100000:3.0:1784191852.462932:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827900416 00000100:00100000:3.0:1784191852.462976:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827900544 00000100:00100000:3.0:1784191852.462980:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827900544 00000100:00100000:3.0:1784191852.462999:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784191852.463006:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+25:106501:x1870858827900416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784191852.463020:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191852.463037:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af10d532200/0xfeec3c2dc5a478e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a478db expref: 25 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191852.463049:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191852.463080:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827900416:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191852.463087:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784191852.463102:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784191852.463108:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23d2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:106501:x1870858827900544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784191852.463117:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191852.463126:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af242073800/0xfeec3c2dc5a47b66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a47b5f expref: 23 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191852.463135:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191852.463155:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23d2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:106501:x1870858827900544:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191852.463161:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784191852.463230:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827900544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191852.463239:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827900416:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1784191852.463322:0:158653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.116@tcp lock: ffff8af23dd69a00/0xfeec3c2dc5a474c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a474c8 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.463343:0:158653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af23dd69a00/0xfeec3c2dc5a474c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a474c8 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784191852.463350:0:158653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af23dd69a00/0xfeec3c2dc5a474c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a474c8 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784191852.463355:0:158653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784191852.463358:0:158653:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1784191852.463372:0:158653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.116@tcp lock: ffff8af23dd69a00/0xfeec3c2dc5a474c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a474c8 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.463379:0:158653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784191852.463437:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191852.463460:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827900672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191852.463494:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191852.463524:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827900288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191852.463544:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191852.463570:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827900672 00000100:00100000:1.0:1784191852.463574:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827900672 00000100:00100000:1.0:1784191852.463598:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827900288 00000100:00100000:1.0:1784191852.463601:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827900288 00000100:00100000:1.0:1784191852.463619:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784191852.463625:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:106499:x1870858827900672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191852.463633:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191852.463648:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af20341b000/0xfeec3c2dc5a474c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a474c1 expref: 23 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191852.463658:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191852.463707:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:106499:x1870858827900672:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191852.463715:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784191852.463728:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784191852.463734:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:106499:x1870858827900288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191852.463742:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191852.463751:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af233127e00/0xfeec3c2dc5a47569 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a47562 expref: 21 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191852.463761:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191852.463782:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+20:106499:x1870858827900288:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191852.463788:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784191852.463810:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827900672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191852.463817:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827900288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191852.464932:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.116@tcp lock: ffff8af23dd69a00/0xfeec3c2dc5a474c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a474c8 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.464945:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af23dd69a00/0xfeec3c2dc5a474c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a474c8 expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.464957:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191852.464959:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191852.464961:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191852.465741:0:165077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af23dd68600/0xfeec3c2dc5a474b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a474ba expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191852.465770:0:165077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af23dd68600/0xfeec3c2dc5a474b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a474ba expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191852.465778:0:165077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af23dd68600/0xfeec3c2dc5a474b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a474ba expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191852.465784:0:165077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.116@tcp lock: ffff8af23dd68600/0xfeec3c2dc5a474b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a474ba expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191852.465810:0:165077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784191852.465816:0:165077:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1784191852.465822:0:165077:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1784191852.465868:0:165077:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1784191852.465873:0:165077:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='FA') 00000020:00000080:3.0:1784191852.465877:0:165077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1784191852.465882:0:165077:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0001 00010000:00010000:0.0:1784191852.466514:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191852.466522:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.116@tcp lock: ffff8af23dd68600/0xfeec3c2dc5a474b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a474ba expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.466531:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68600 already unused, calling callback (ffffffffc1384c20) 10000000:00010000:0.0:1784191852.466535:0:160901:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.116@tcp lock: ffff8af23dd68600/0xfeec3c2dc5a474b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a474ba expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.466543:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af23dd68600/0xfeec3c2dc5a474b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a474ba expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784191852.466552:0:160901:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af23dd68600/0xfeec3c2dc5a474b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a474ba expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784191852.466558:0:160901:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1784191852.466561:0:160901:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1784191852.466562:0:160901:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1784191852.466599:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.116@tcp lock: ffff8af23dd68600/0xfeec3c2dc5a474b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a474ba expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.466606:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784191852.466626:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.116@tcp lock: ffff8af23dd68600/0xfeec3c2dc5a474b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a474ba expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.466634:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af23dd68600/0xfeec3c2dc5a474b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a474ba expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.466654:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191852.466655:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191852.466657:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191852.466674:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827900800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191852.466765:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191852.466833:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827900800 00000100:00100000:0.0:1784191852.466839:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827900800 00000100:00100000:0.0:1784191852.466901:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784191852.466909:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+20:106500:x1870858827900800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784191852.466923:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191852.466937:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af20341b400/0xfeec3c2dc5a474ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a474b3 expref: 20 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.466948:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191852.466980:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+19:106500:x1870858827900800:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191852.466988:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784191852.467026:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827900800:0@lo:103:ldlm_bl.0 00000004:00000080:3.0:1784191852.470080:0:165077:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0001: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00010000:00010000:1.0:1784191852.476652:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4a8f4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a8fb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191852.476672:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4a8f4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a8fb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476785:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a5cf lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476794:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a5cf lrc: 2/0,0 mode: TXN/TXN res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476800:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a5cf lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476806:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.476824:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a5cf lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476832:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a5cf lrc: 4/0,0 mode: TXN/TXN res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476847:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x1:0x0].0x0 (ffff8af207498800) 00010000:00010000:2.0:1784191852.476850:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.476854:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a5cf lrc: 2/0,0 mode: --/TXN res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476860:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4a5cf lrc: 0/0,0 mode: --/TXN res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476884:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a5d6 lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476890:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a5d6 lrc: 2/0,0 mode: TXN/TXN res: [0x240002340:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476896:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a5d6 lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476901:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.476904:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a5d6 lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476909:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a5d6 lrc: 4/0,0 mode: TXN/TXN res: [0x240002340:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476916:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x4:0x0].0x0 (ffff8af207498d00) 00010000:00010000:2.0:1784191852.476918:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.476927:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a5d6 lrc: 2/0,0 mode: --/TXN res: [0x240002340:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476933:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4a5d6 lrc: 0/0,0 mode: --/TXN res: [0x240002340:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476953:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a62a lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476959:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a62a lrc: 2/0,0 mode: TXN/TXN res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476966:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a62a lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476971:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.476974:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a62a lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476979:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a62a lrc: 4/0,0 mode: TXN/TXN res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476987:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x2:0x0].0x0 (ffff8af2331f1a00) 00010000:00010000:2.0:1784191852.476989:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.476992:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a62a lrc: 2/0,0 mode: --/TXN res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.476998:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4a62a lrc: 0/0,0 mode: --/TXN res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477010:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4a631 lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477015:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4a631 lrc: 2/0,0 mode: TXN/TXN res: [0x240002340:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477027:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4a631 lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477033:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.477036:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4a631 lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477042:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4a631 lrc: 4/0,0 mode: TXN/TXN res: [0x240002340:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477049:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x5:0x0].0x0 (ffff8af2331f1b00) 00010000:00010000:2.0:1784191852.477052:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.477054:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4a631 lrc: 2/0,0 mode: --/TXN res: [0x240002340:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477059:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4a631 lrc: 0/0,0 mode: --/TXN res: [0x240002340:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477075:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a685 lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477081:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a685 lrc: 2/0,0 mode: TXN/TXN res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477087:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a685 lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477091:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7d600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.477095:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a685 lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477110:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a685 lrc: 4/0,0 mode: TXN/TXN res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477119:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x3:0x0].0x0 (ffff8af216636400) 00010000:00010000:2.0:1784191852.477121:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.477124:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a685 lrc: 2/0,0 mode: --/TXN res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477129:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4a685 lrc: 0/0,0 mode: --/TXN res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477145:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4a68c lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477151:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4a68c lrc: 2/0,0 mode: TXN/TXN res: [0x240002340:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477156:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4a68c lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477162:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7d200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.477164:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4a68c lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477170:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4a68c lrc: 4/0,0 mode: TXN/TXN res: [0x240002340:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477176:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x6:0x0].0x0 (ffff8af216636500) 00010000:00010000:2.0:1784191852.477179:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.477181:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4a68c lrc: 2/0,0 mode: --/TXN res: [0x240002340:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477197:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4a68c lrc: 0/0,0 mode: --/TXN res: [0x240002340:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477214:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4a6e0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477220:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4a6e0 lrc: 2/0,0 mode: TXN/TXN res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477226:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4a6e0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477231:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7c800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.477234:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4a6e0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477240:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4a6e0 lrc: 4/0,0 mode: TXN/TXN res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477248:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x4:0x0].0x0 (ffff8af216636900) 00010000:00010000:2.0:1784191852.477250:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.477254:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4a6e0 lrc: 2/0,0 mode: --/TXN res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477260:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4a6e0 lrc: 0/0,0 mode: --/TXN res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477274:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4a6e7 lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477281:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4a6e7 lrc: 2/0,0 mode: TXN/TXN res: [0x240002340:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477293:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4a6e7 lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477308:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7cc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.477312:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4a6e7 lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477318:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4a6e7 lrc: 4/0,0 mode: TXN/TXN res: [0x240002340:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477326:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x7:0x0].0x0 (ffff8af215ff6900) 00010000:00010000:2.0:1784191852.477329:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.477332:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4a6e7 lrc: 2/0,0 mode: --/TXN res: [0x240002340:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477338:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4a6e7 lrc: 0/0,0 mode: --/TXN res: [0x240002340:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477355:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a73b lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477361:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a73b lrc: 2/0,0 mode: TXN/TXN res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477367:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a73b lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477371:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ec00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.477374:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a73b lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477390:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a73b lrc: 4/0,0 mode: TXN/TXN res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477411:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x5:0x0].0x0 (ffff8af207498600) 00010000:00010000:2.0:1784191852.477413:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.477417:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a73b lrc: 2/0,0 mode: --/TXN res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477422:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4a73b lrc: 0/0,0 mode: --/TXN res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477435:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126800/0xfeec3c2dc5a4a742 lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477442:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126800/0xfeec3c2dc5a4a742 lrc: 2/0,0 mode: TXN/TXN res: [0x240002340:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477448:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126800/0xfeec3c2dc5a4a742 lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477453:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233126800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.477456:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126800/0xfeec3c2dc5a4a742 lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477463:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126800/0xfeec3c2dc5a4a742 lrc: 4/0,0 mode: TXN/TXN res: [0x240002340:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477470:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x8:0x0].0x0 (ffff8af207498e00) 00010000:00010000:2.0:1784191852.477472:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.477475:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126800/0xfeec3c2dc5a4a742 lrc: 2/0,0 mode: --/TXN res: [0x240002340:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477491:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126800/0xfeec3c2dc5a4a742 lrc: 0/0,0 mode: --/TXN res: [0x240002340:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477505:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a796 lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477512:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a796 lrc: 2/0,0 mode: TXN/TXN res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477518:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a796 lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477524:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7c400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.477527:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a796 lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477532:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a796 lrc: 4/0,0 mode: TXN/TXN res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477540:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x6:0x0].0x0 (ffff8af215ff6500) 00010000:00010000:2.0:1784191852.477542:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.477544:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a796 lrc: 2/0,0 mode: --/TXN res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477550:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4a796 lrc: 0/0,0 mode: --/TXN res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477562:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a79d lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477567:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a79d lrc: 2/0,0 mode: TXN/TXN res: [0x240002340:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477579:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a79d lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477584:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7c200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.477587:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a79d lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477593:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a79d lrc: 4/0,0 mode: TXN/TXN res: [0x240002340:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477601:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x9:0x0].0x0 (ffff8af215ff6f00) 00010000:00010000:2.0:1784191852.477603:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.477606:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a79d lrc: 2/0,0 mode: --/TXN res: [0x240002340:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477612:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4a79d lrc: 0/0,0 mode: --/TXN res: [0x240002340:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477627:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a7f1 lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477633:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a7f1 lrc: 2/0,0 mode: TXN/TXN res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477638:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a7f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477644:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.477646:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a7f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477662:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a7f1 lrc: 4/0,0 mode: TXN/TXN res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477671:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x7:0x0].0x0 (ffff8af2331f1800) 00010000:00010000:2.0:1784191852.477673:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.477675:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a7f1 lrc: 2/0,0 mode: --/TXN res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477680:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4a7f1 lrc: 0/0,0 mode: --/TXN res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477731:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a7f8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477738:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a7f8 lrc: 2/0,0 mode: TXN/TXN res: [0x240002340:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477744:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a7f8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477749:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.477751:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a7f8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477758:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a7f8 lrc: 4/0,0 mode: TXN/TXN res: [0x240002340:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477766:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xa:0x0].0x0 (ffff8af2331f1200) 00010000:00010000:2.0:1784191852.477769:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.477771:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a7f8 lrc: 2/0,0 mode: --/TXN res: [0x240002340:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477786:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4a7f8 lrc: 0/0,0 mode: --/TXN res: [0x240002340:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477802:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a84c lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477808:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a84c lrc: 2/0,0 mode: TXN/TXN res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477814:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a84c lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477819:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.477822:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a84c lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477828:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a84c lrc: 4/0,0 mode: TXN/TXN res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477835:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x8:0x0].0x0 (ffff8af2331f1c00) 00010000:00010000:2.0:1784191852.477838:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.477841:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a84c lrc: 2/0,0 mode: --/TXN res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477847:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4a84c lrc: 0/0,0 mode: --/TXN res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477858:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4a853 lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477863:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4a853 lrc: 2/0,0 mode: TXN/TXN res: [0x240002340:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477874:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4a853 lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477879:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3f600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.477881:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4a853 lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477888:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4a853 lrc: 4/0,0 mode: TXN/TXN res: [0x240002340:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477895:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xb:0x0].0x0 (ffff8af2331f1600) 00010000:00010000:2.0:1784191852.477897:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.477899:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4a853 lrc: 2/0,0 mode: --/TXN res: [0x240002340:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477905:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4a853 lrc: 0/0,0 mode: --/TXN res: [0x240002340:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477918:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4a8a7 lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477923:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4a8a7 lrc: 2/0,0 mode: TXN/TXN res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477929:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4a8a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477933:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.477936:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4a8a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477951:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4a8a7 lrc: 4/0,0 mode: TXN/TXN res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477961:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x9:0x0].0x0 (ffff8af2331f1100) 00010000:00010000:2.0:1784191852.477963:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.477966:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4a8a7 lrc: 2/0,0 mode: --/TXN res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477971:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4a8a7 lrc: 0/0,0 mode: --/TXN res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477982:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4a8ae lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477987:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4a8ae lrc: 2/0,0 mode: TXN/TXN res: [0x240002340:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477993:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4a8ae lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.477999:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3f400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.478002:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4a8ae lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.478008:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4a8ae lrc: 4/0,0 mode: TXN/TXN res: [0x240002340:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.478015:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xc:0x0].0x0 (ffff8af210dfe900) 00010000:00010000:2.0:1784191852.478017:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.478020:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4a8ae lrc: 2/0,0 mode: --/TXN res: [0x240002340:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.478035:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4a8ae lrc: 0/0,0 mode: --/TXN res: [0x240002340:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.478049:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126600/0xfeec3c2dc5a4a902 lrc: 3/0,1 mode: TXN/TXN res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.478055:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126600/0xfeec3c2dc5a4a902 lrc: 2/0,0 mode: TXN/TXN res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.478061:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126600/0xfeec3c2dc5a4a902 lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.478066:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233126600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.478068:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126600/0xfeec3c2dc5a4a902 lrc: 3/0,0 mode: TXN/TXN res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.478074:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126600/0xfeec3c2dc5a4a902 lrc: 4/0,0 mode: TXN/TXN res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.478081:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0xa:0x0].0x0 (ffff8af20db3d500) 00010000:00010000:2.0:1784191852.478083:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.478085:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126600/0xfeec3c2dc5a4a902 lrc: 2/0,0 mode: --/TXN res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.478090:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af233126600/0xfeec3c2dc5a4a902 lrc: 0/0,0 mode: --/TXN res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.478101:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4a909 lrc: 3/0,1 mode: TXN/TXN res: [0x240002340:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.478107:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4a909 lrc: 2/0,0 mode: TXN/TXN res: [0x240002340:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.478118:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4a909 lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.478124:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191852.478127:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4a909 lrc: 3/0,0 mode: TXN/TXN res: [0x240002340:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.478133:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4a909 lrc: 4/0,0 mode: TXN/TXN res: [0x240002340:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.478141:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xd:0x0].0x0 (ffff8af20db3dc00) 00010000:00010000:2.0:1784191852.478143:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191852.478146:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4a909 lrc: 2/0,0 mode: --/TXN res: [0x240002340:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.478151:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4a909 lrc: 0/0,0 mode: --/TXN res: [0x240002340:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191852.478552:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4a8f4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a8fb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191852.478573:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191852.478609:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4a8f4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a8fb expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191852.478626:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127800/0xfeec3c2dc5a4a910 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a917 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191852.478634:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127800/0xfeec3c2dc5a4a910 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a917 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191852.478654:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127800/0xfeec3c2dc5a4a910 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a917 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191852.478661:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191852.478667:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127800/0xfeec3c2dc5a4a910 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a917 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191852.478679:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d4a00/0xfeec3c2dc5a4a899 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a8a0 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191852.478759:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d4a00/0xfeec3c2dc5a4a899 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a8a0 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191852.478782:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d4a00/0xfeec3c2dc5a4a899 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a8a0 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191852.478787:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784191852.478850:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827901184:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1784191852.478919:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784191852.478976:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1019d4a00/0xfeec3c2dc5a4a899 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a8a0 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191852.478998:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4a8b5 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a8bc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191852.479005:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4a8b5 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a8bc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191852.479023:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4a8b5 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a8bc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191852.479029:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784191852.479081:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827901056:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1784191852.479111:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191852.479136:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784191852.479142:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827900928:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1784191852.479162:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191852.480664:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784191852.480682:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827901312:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1784191852.480766:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191852.480818:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827901184 00000100:00100000:0.0:1784191852.480825:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827901184 00000100:00100000:0.0:1784191852.480879:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827901056 00000100:00100000:0.0:1784191852.480883:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827901056 00000100:00100000:0.0:1784191852.480893:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827900928 00000100:00100000:0.0:1784191852.480895:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827900928 00000100:00100000:0.0:1784191852.480904:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827901312 00000100:00100000:0.0:1784191852.480906:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827901312 00000100:00100000:0.0:1784191852.480919:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784191852.480927:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+39:106499:x1870858827901184:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1784191852.480941:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191852.480965:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4a8a0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a899 expref: 39 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.480984:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9feaf7a7 (ffff8af20db3d200) 00010000:00010000:0.0:1784191852.480994:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191852.481027:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+38:106499:x1870858827901184:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 101us (2108us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191852.481035:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784191852.481050:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784191852.481056:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+37:106502:x1870858827901056:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1784191852.481064:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191852.481075:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4a917 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a910 expref: 37 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.481085:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xd:0x0].0x0 (ffff8af202c46000) 00010000:00010000:0.0:1784191852.481092:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191852.481121:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+36:106502:x1870858827901056:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 65us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191852.481127:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784191852.481146:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784191852.481151:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+35:106502:x1870858827900928:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1784191852.481160:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191852.481171:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4a8fb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a8f4 expref: 35 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.481182:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdab9809a (ffff8af215ff6400) 00010000:00010000:0.0:1784191852.481188:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191852.481209:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+34:106502:x1870858827900928:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 58us (2046us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191852.481216:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784191852.481226:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784191852.481232:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23d2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+33:106499:x1870858827901312:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1784191852.481240:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191852.481250:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4a8bc lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a8b5 expref: 33 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.481259:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff8af202c46300) 00010000:00010000:0.0:1784191852.481265:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191852.481285:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23d2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+32:106499:x1870858827901312:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 53us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191852.481291:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784191852.481373:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827900928:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1784191852.481383:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827901056:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191852.481531:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827901312:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191852.481541:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827901184:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1784191852.482934:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4a8b5 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a8bc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191852.482967:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a83e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a845 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191852.482976:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a83e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a845 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483117:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a83e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a845 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483125:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191852.483154:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5800/0xfeec3c2dc5a4a83e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a845 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483192:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e400/0xfeec3c2dc5a4a85a lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a861 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191852.483199:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e400/0xfeec3c2dc5a4a85a lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a861 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483218:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e400/0xfeec3c2dc5a4a85a lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a861 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483225:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191852.483231:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e400/0xfeec3c2dc5a4a85a lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a861 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483244:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4a7e3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a7ea expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191852.483250:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4a7e3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a7ea expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483264:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4a7e3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a7ea expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483270:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191852.483292:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4a7e3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a7ea expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483315:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5600/0xfeec3c2dc5a4a7ff lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a806 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191852.483331:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5600/0xfeec3c2dc5a4a7ff lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a806 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483349:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5600/0xfeec3c2dc5a4a7ff lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a806 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483354:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191852.483360:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5600/0xfeec3c2dc5a4a7ff lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a806 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483372:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5000/0xfeec3c2dc5a4a788 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a78f expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191852.483379:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5000/0xfeec3c2dc5a4a788 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a78f expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483394:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5000/0xfeec3c2dc5a4a788 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a78f expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483412:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191852.483417:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e5000/0xfeec3c2dc5a4a788 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a78f expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483430:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7c600/0xfeec3c2dc5a4a7a4 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a7ab expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191852.483438:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7c600/0xfeec3c2dc5a4a7a4 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a7ab expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483469:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7c600/0xfeec3c2dc5a4a7a4 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a7ab expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483475:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191852.483479:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7c600/0xfeec3c2dc5a4a7a4 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a7ab expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483496:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a72d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a734 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191852.483503:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a72d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a734 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483516:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a72d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a734 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483522:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191852.483527:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4a72d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a734 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483541:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127400/0xfeec3c2dc5a4a749 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a750 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191852.483548:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127400/0xfeec3c2dc5a4a749 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a750 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483566:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127400/0xfeec3c2dc5a4a749 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a750 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483582:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191852.483588:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af233127400/0xfeec3c2dc5a4a749 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a750 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483603:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f800/0xfeec3c2dc5a4a6d2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a6d9 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191852.483612:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f800/0xfeec3c2dc5a4a6d2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a6d9 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483628:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f800/0xfeec3c2dc5a4a6d2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a6d9 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483634:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191852.483639:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f800/0xfeec3c2dc5a4a6d2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a6d9 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483651:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7d800/0xfeec3c2dc5a4a6ee lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a6f5 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191852.483658:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7d800/0xfeec3c2dc5a4a6ee lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a6f5 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483673:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7d800/0xfeec3c2dc5a4a6ee lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a6f5 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483679:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191852.483684:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7d800/0xfeec3c2dc5a4a6ee lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a6f5 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483743:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4800/0xfeec3c2dc5a4a677 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a67e expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191852.483752:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4800/0xfeec3c2dc5a4a677 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a67e expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483769:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4800/0xfeec3c2dc5a4a677 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a67e expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483775:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191852.483781:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4800/0xfeec3c2dc5a4a677 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a67e expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483794:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7ca00/0xfeec3c2dc5a4a693 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a69a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191852.483801:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7ca00/0xfeec3c2dc5a4a693 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a69a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483816:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7ca00/0xfeec3c2dc5a4a693 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a69a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483821:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191852.483825:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af223b7ca00/0xfeec3c2dc5a4a693 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a69a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483839:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4a61c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a623 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191852.483856:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4a61c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a623 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483873:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4a61c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a623 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483879:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191852.483884:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4a61c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a623 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483897:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a638 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a63f expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191852.483904:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a638 lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a63f expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483917:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a638 lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a63f expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483923:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191852.483927:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10b5e4e00/0xfeec3c2dc5a4a638 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a63f expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483939:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a5c1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a5c8 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191852.483945:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a5c1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a5c8 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483973:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a5c1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a5c8 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483979:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191852.483985:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4a5c1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a5c8 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.483997:0:159395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e400/0xfeec3c2dc5a4a5dd lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4a5e4 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191852.484004:0:159395:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e400/0xfeec3c2dc5a4a5dd lrc: 3/0,0 mode: PW/PW res: [0x200003ab1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4a5e4 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.484017:0:159395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e400/0xfeec3c2dc5a4a5dd lrc: 2/0,0 mode: --/PW res: [0x200003ab1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a5e4 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191852.484023:0:159395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191852.484027:0:159395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e400/0xfeec3c2dc5a4a5dd lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4a5e4 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784191852.484038:0:159395:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 21474836536 is committed 00000100:00100000:3.0:1784191852.484239:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827901440:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191852.484317:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191852.484362:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827901952:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191852.484383:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191852.484408:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827902464:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191852.484428:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191852.484442:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827902976:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191852.484468:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191852.484488:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1784191852.484494:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827901568:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191852.484513:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191852.484523:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827902080:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191852.484540:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191852.484549:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827902592:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191852.484569:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191852.484578:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827903104:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191852.484596:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1784191852.484667:0:165077:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 4/9 00000020:00080000:3.0:1784191852.484675:0:165077:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff8af109053800 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 192.168.204.16@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 21474836536 stale:0 00000020:00080000:3.0:1784191852.484681:0:165077:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff8af10f0bc000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784191852.484685:0:165077:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff8af10783c000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784191852.484717:0:165077:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff8af206526000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 21474836522 stale:0 00000020:00080000:3.0:1784191852.484722:0:165077:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff8af20d7d99c0) has exports, disconnecting them 00000020:00080000:3.0:1784191852.484726:0:165077:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 192.168.204.16@tcp (ffff8af109053800), last request at 1784191849 00000020:00000080:3.0:1784191852.484733:0:165077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4a55f 00000100:00080000:3.0:1784191852.484744:0:165077:0:(import.c:65:import_set_state_nolock()) ffff8af109053000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784191852.484764:0:165077:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.16@tcp (ffff8af109053800): rc 0 00000020:00000080:3.0:1784191852.484767:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af109053800/62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000020:00080000:3.0:1784191852.484777:0:165077:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8af10f0bc000), last request at 1784191852 00000020:00000080:3.0:1784191852.484780:0:165077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a478cd 00000100:00080000:3.0:1784191852.484783:0:165077:0:(import.c:65:import_set_state_nolock()) ffff8af10f0b8800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784191852.484799:0:165077:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af10f0bc000): rc 0 00000020:00000080:3.0:1784191852.484801:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af10f0bc000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1784191852.484805:0:165077:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8af10783c000), last request at 1784191852 00000020:00000080:3.0:1784191852.484809:0:165077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a47642 00000100:00080000:3.0:1784191852.484820:0:165077:0:(import.c:65:import_set_state_nolock()) ffff8af107839800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784191852.484853:0:165077:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af10783c000): rc 0 00000020:00000080:3.0:1784191852.484856:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af10783c000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00080000:3.0:1784191852.484860:0:165077:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8af206526000), last request at 1784191640 00000020:00000080:3.0:1784191852.484863:0:165077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a475a8 00000100:00080000:3.0:1784191852.484866:0:165077:0:(import.c:65:import_set_state_nolock()) ffff8af206523800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784191852.484871:0:165077:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af206526000): rc 0 00000020:00000080:3.0:1784191852.484873:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af206526000/lustre-MDT0000-mdtlov_UUID 00000004:00000080:3.0:1784191852.484879:0:165077:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb46d0152fae0 00000100:00080000:3.0:1784191852.484897:0:165077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784191852.484905:0:165077:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8af10db4d880 x1870858827901440/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784191868 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'jbd2/dm-1-8.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784191852.484918:0:165077:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8af10db4d180 x1870858827901952/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784191868 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'jbd2/dm-1-8.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784191852.484925:0:165077:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8af10db4f100 x1870858827902464/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784191868 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'jbd2/dm-1-8.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784191852.484932:0:165077:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8af10d29f480 x1870858827902976/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784191868 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'jbd2/dm-1-8.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784191852.484938:0:165077:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8af10db4ce00 x1870858827901568/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784191868 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'jbd2/dm-1-8.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784191852.484946:0:165077:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8af10db4fb80 x1870858827902080/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784191868 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'jbd2/dm-1-8.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784191852.484953:0:165077:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8af10db4c700 x1870858827902592/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784191868 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'jbd2/dm-1-8.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784191852.484972:0:165077:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8af10d29c380 x1870858827903104/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784191868 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'jbd2/dm-1-8.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784191852.484978:0:165077:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 34359738570 gen 3 00000100:00100000:3.0:1784191852.484983:0:165077:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8af10db45880 x1870858827878784/t34359738621(34359738621) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1784191865 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1784191852.484991:0:165077:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738621 committed transno 34359738570 00000020:00080000:3.0:1784191852.484996:0:165077:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af23cfe9180 refcount 2 committed 0 result 1 batchid 17179869213 00000020:00080000:3.0:1784191852.485000:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af20d677500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af2199ec480 00000020:00080000:3.0:1784191852.485003:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].7 00000020:00080000:3.0:1784191852.485005:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af20d677700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af10e146c00 00000020:00080000:3.0:1784191852.485008:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].7 00000100:00100000:3.0:1784191852.485039:0:165077:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8af233154000 x1870858827880832/t34359738622(34359738622) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1784191865 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1784191852.485045:0:165077:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738622 committed transno 34359738570 00000020:00080000:3.0:1784191852.485048:0:165077:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af20dbf6e40 refcount 2 committed 0 result 1 batchid 17179869214 00000020:00080000:3.0:1784191852.485051:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af20d677400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af201442900 00000020:00080000:3.0:1784191852.485053:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].8 00000020:00080000:3.0:1784191852.485055:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af20d677f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af111baf200 00000020:00080000:3.0:1784191852.485057:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].8 00000100:00100000:3.0:1784191852.485088:0:165077:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8af233155500 x1870858827882880/t34359738623(34359738623) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1784191865 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1784191852.485094:0:165077:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738623 committed transno 34359738570 00000020:00080000:3.0:1784191852.485097:0:165077:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af104f1ef00 refcount 2 committed 0 result 1 batchid 17179869215 00000020:00080000:3.0:1784191852.485100:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af20d677e00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af1119a9c00 00000020:00080000:3.0:1784191852.485107:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].9 00000020:00080000:3.0:1784191852.485109:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af20d677000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af111baf600 00000020:00080000:3.0:1784191852.485112:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].9 00000100:00100000:3.0:1784191852.485131:0:165077:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8af233157480 x1870858827884928/t34359738624(34359738624) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1784191865 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1784191852.485137:0:165077:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738624 committed transno 34359738570 00000020:00080000:3.0:1784191852.485140:0:165077:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af227a6a180 refcount 2 committed 0 result 1 batchid 17179869216 00000020:00080000:3.0:1784191852.485143:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af110f52400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af227a6a540 00000020:00080000:3.0:1784191852.485145:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].10 00000020:00080000:3.0:1784191852.485147:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af110f52d00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af20d434800 00000020:00080000:3.0:1784191852.485149:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].10 00000100:00100000:3.0:1784191852.485165:0:165077:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8af227e61880 x1870858827887232/t34359738625(34359738625) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1784191865 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1784191852.485171:0:165077:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738625 committed transno 34359738570 00000020:00080000:3.0:1784191852.485174:0:165077:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af2035a1c00 refcount 2 committed 0 result 1 batchid 17179869217 00000020:00080000:3.0:1784191852.485176:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23dd56000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af2035a1e40 00000020:00080000:3.0:1784191852.485179:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].11 00000020:00080000:3.0:1784191852.485181:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23dd56d00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af10e146400 00000020:00080000:3.0:1784191852.485184:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].11 00000100:00100000:3.0:1784191852.485215:0:165077:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8af227e62a00 x1870858827889280/t34359738626(34359738626) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1784191865 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1784191852.485222:0:165077:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738626 committed transno 34359738570 00000020:00080000:3.0:1784191852.485225:0:165077:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af105047780 refcount 2 committed 0 result 1 batchid 17179869218 00000020:00080000:3.0:1784191852.485227:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23dd56300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af105047a80 00000020:00080000:3.0:1784191852.485236:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].12 00000020:00080000:3.0:1784191852.485238:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23dd56f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af105a85000 00000020:00080000:3.0:1784191852.485241:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].12 00000100:00100000:3.0:1784191852.485260:0:165077:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8af107905880 x1870858827891328/t34359738627(34359738627) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1784191865 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1784191852.485266:0:165077:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738627 committed transno 34359738570 00000020:00080000:3.0:1784191852.485269:0:165077:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af2387a7540 refcount 2 committed 0 result 1 batchid 17179869219 00000020:00080000:3.0:1784191852.485271:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af110f52000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af2387a7cc0 00000020:00080000:3.0:1784191852.485275:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].13 00000020:00080000:3.0:1784191852.485277:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af110f52c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af23d573a00 00000020:00080000:3.0:1784191852.485279:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].13 00000100:00100000:3.0:1784191852.485307:0:165077:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8af10db4f480 x1870858827893376/t34359738628(34359738628) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1784191865 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1784191852.485314:0:165077:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738628 committed transno 34359738570 00000020:00080000:3.0:1784191852.485316:0:165077:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af2387a7180 refcount 2 committed 0 result 1 batchid 17179869220 00000020:00080000:3.0:1784191852.485319:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af110f52700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af2387a79c0 00000020:00080000:3.0:1784191852.485322:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].14 00000020:00080000:3.0:1784191852.485324:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af110f52900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af10b605200 00000020:00080000:3.0:1784191852.485326:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].14 00000100:00100000:3.0:1784191852.485343:0:165077:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8af10db4e300 x1870858827895424/t34359738629(34359738629) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1784191865 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1784191852.485349:0:165077:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738629 committed transno 34359738570 00000020:00080000:3.0:1784191852.485351:0:165077:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af2127fda80 refcount 2 committed 0 result 1 batchid 17179869221 00000020:00080000:3.0:1784191852.485353:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23cac3300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af2127fd0c0 00000020:00080000:3.0:1784191852.485363:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].15 00000020:00080000:3.0:1784191852.485365:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23cac3700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af2239f9600 00000020:00080000:3.0:1784191852.485368:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].15 00000100:00100000:3.0:1784191852.485383:0:165077:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8af10db4df80 x1870858827897728/t34359738630(34359738630) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1784191866 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1784191852.485389:0:165077:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738630 committed transno 34359738570 00000020:00080000:3.0:1784191852.485392:0:165077:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af23cf07d80 refcount 2 committed 0 result 1 batchid 17179869222 00000020:00080000:3.0:1784191852.485395:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23dd56800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af23cf070c0 00000020:00080000:3.0:1784191852.485397:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].16 00000020:00080000:3.0:1784191852.485399:0:165077:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23dd56900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af104a19000 00000020:00080000:3.0:1784191852.485401:0:165077:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].16 00010000:00010000:3.0:1784191852.485525:0:165077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ea00/0xfeec3c2dc5a49d78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110e400000000 nid: local remote: 0xfeec3c2dc5a49d7f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191852.485536:0:165077:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ea00/0xfeec3c2dc5a49d78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110f400000000 nid: local remote: 0xfeec3c2dc5a49d7f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191852.485566:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827901568:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191852.485573:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827902080:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191852.485578:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827902592:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191852.485584:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827903104:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191852.485589:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827901440:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191852.485595:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827901952:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191852.485612:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827902464:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191852.485618:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827902976:0@lo:103:jbd2/dm-1-8.0 00000004:00080000:3.0:1784191852.485716:0:165077:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1784191852.485739:0:165077:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784191852.485751:0:165077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ea00/0xfeec3c2dc5a49d78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x590f400000000 nid: local remote: 0xfeec3c2dc5a49d7f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784191852.486429:0:165077:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784191852.486455:0:165077:0:(import.c:65:import_set_state_nolock()) ffff8af204c79000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1784191852.486497:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858827903488:0@lo:39:umount.0 00000100:00100000:3.0:1784191852.486556:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191852.486610:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827903488 00000100:00100000:3.0:1784191852.486617:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827903488 00000100:00100000:3.0:1784191852.486661:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1784191852.486670:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+32:106498:x1870858827903488:12345-0@lo:39:umount.0 00000020:00000080:3.0:1784191852.486720:0:158670:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a47523 00000020:00010000:3.0:1784191852.486726:0:158670:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8af101783000: total 4 00000100:00080000:3.0:1784191852.486730:0:158670:0:(import.c:65:import_set_state_nolock()) ffff8af23ea17800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784191852.486744:0:158670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 8, last_transno is 34359738630 00000100:00100000:3.0:1784191852.486882:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+31:106498:x1870858827903488:12345-0@lo:39:umount.0 Request processed in 212us (325us total) trans 34359738631 rc 0/0 00000100:00100000:3.0:1784191852.486889:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00080000:3.0:1784191852.486931:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af204c79000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784191852.486938:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858827903488:0@lo:39:umount.0 00000020:00080000:2.0:1784191852.487122:0:159415:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179869212 00000020:00080000:2.0:1784191852.487126:0:159415:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179869212 00000100:00100000:2.0:1784191852.487213:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827901440 00000100:00100000:2.0:1784191852.487218:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827901440 00000100:00100000:2.0:1784191852.487238:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827901952 00000100:00100000:2.0:1784191852.487241:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827901952 00000100:00100000:2.0:1784191852.487249:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827902464 00000100:00100000:2.0:1784191852.487261:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827902464 00000100:00100000:2.0:1784191852.487272:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827902976 00000100:00100000:2.0:1784191852.487274:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827902976 00000100:00100000:2.0:1784191852.487282:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827901568 00000100:00100000:2.0:1784191852.487284:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827901568 00000100:00100000:2.0:1784191852.487292:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827902080 00000100:00100000:2.0:1784191852.487304:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827902080 00000100:00100000:2.0:1784191852.487314:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827902592 00000100:00100000:2.0:1784191852.487317:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827902592 00000100:00100000:2.0:1784191852.487325:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827903104 00000100:00100000:2.0:1784191852.487328:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827903104 00000100:00100000:2.0:1784191852.487338:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784191852.487343:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:106501:x1870858827901440:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00020000:2.0:1784191852.487349:0:160189:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784191852 with bad export cookie 18369123147424494883 00000100:00020000:1.0:1784191852.487525:0:106499:0:(client.c:1381:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff8af10db4ca80 x1870858827901696/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl Rpc:QU/200/ffffffff rc 0/-1 job:'jbd2/dm-1-8.0' uid:0 gid:0 projid:4294967295 00000020:00000080:0.0:1784191852.487879:0:123300:0:(genops.c:865:class_export_destroy()) destroying export ffff8af109053800/62ac9b09-d016-4ae6-b1b1-fe120a3abe0a for lustre-MDT0001 00000020:00000080:0.0:1784191852.487936:0:123300:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10f0bc000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1784191852.487968:0:123300:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10783c000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1784191852.487986:0:123300:0:(genops.c:865:class_export_destroy()) destroying export ffff8af206526000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1784191852.488014:0:123300:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af109053000 for lustre-MDT0001 00000020:00000080:0.0:1784191852.488019:0:123300:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af10f0b8800 for lustre-MDT0001 00000020:00000080:0.0:1784191852.488023:0:123300:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af107839800 for lustre-MDT0001 00000020:00000080:0.0:1784191852.488026:0:123300:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af206523800 for lustre-MDT0001 00000020:00010000:0.0:1784191852.488038:0:158654:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8af101783000: total 0 00010000:00010000:0.0:1784191852.488083:0:158654:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8af101783000, canceled 0 locks, left on hash table 17. 00010000:00010000:0.0:1784191852.488114:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af202c46c00) 00010000:00010000:0.0:1784191852.488118:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784191852.488124:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4600/0xfeec3c2dc5a49d7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a49d78 expref: 30 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.488146:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff8af215ff6c00) 00010000:00010000:0.0:1784191852.488149:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191852.488153:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2600/0xfeec3c2dc5a4a861 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a85a expref: 29 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.488169:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x4:0x0].0x0 (ffff8af202c46900) 00010000:00010000:0.0:1784191852.488171:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191852.488175:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4a5e4 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a5dd expref: 28 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.488188:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x8:0x0].0x0 (ffff8af2331f1d00) 00010000:00010000:0.0:1784191852.488190:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191852.488193:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4a750 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a749 expref: 27 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.488207:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x30d22c80 (ffff8af2331f1f00) 00010000:00010000:0.0:1784191852.488215:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191852.488220:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4a623 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a61c expref: 26 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.488238:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a253ddb (ffff8af215ff6e00) 00010000:00010000:0.0:1784191852.488240:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191852.488243:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4a78f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a788 expref: 25 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.488262:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff8af202c46600) 00010000:00010000:0.0:1784191852.488264:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191852.488268:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4a63f lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a638 expref: 24 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.488282:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x9:0x0].0x0 (ffff8af202c46e00) 00010000:00010000:0.0:1784191852.488284:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191852.488287:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4a7ab lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a7a4 expref: 23 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.488312:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc86efa78 (ffff8af207498c00) 00010000:00010000:0.0:1784191852.488315:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191852.488319:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4a67e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a677 expref: 22 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.488337:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x6:0x0].0x0 (ffff8af207498300) 00010000:00010000:0.0:1784191852.488340:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191852.488343:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4a69a lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a693 expref: 21 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.488372:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4c99ad (ffff8af216636000) 00010000:00010000:0.0:1784191852.488374:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191852.488378:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4a6d9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a6d2 expref: 20 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.488393:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcaaa8ec3 (ffff8af2331f1700) 00010000:00010000:0.0:1784191852.488395:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191852.488410:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4a7ea lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a7e3 expref: 19 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.488427:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x7:0x0].0x0 (ffff8af207498200) 00010000:00010000:0.0:1784191852.488429:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191852.488433:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4a6f5 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a6ee expref: 18 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.488446:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed36d805 (ffff8af207498500) 00010000:00010000:0.0:1784191852.488449:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191852.488453:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4a5c8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a5c1 expref: 17 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.488465:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x96709776 (ffff8af207498900) 00010000:00010000:0.0:1784191852.488468:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191852.488471:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4a734 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a72d expref: 16 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.488484:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff8af202c46200) 00010000:00010000:0.0:1784191852.488487:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191852.488497:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4000/0xfeec3c2dc5a4a806 lrc: 0/0,0 mode: --/PW res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a7ff expref: 15 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.488513:0:158654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9d6f79b8 (ffff8af207498f00) 00010000:00010000:0.0:1784191852.488516:0:158654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191852.488519:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127a00/0xfeec3c2dc5a4a845 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a83e expref: 14 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191852.488533:0:158654:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8af101783000, canceled 17 locks, left on hash table 0. 00010000:00010000:0.0:1784191852.488551:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191852.488553:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191852.488554:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784191852.488957:0:165077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784191852.488968:0:165077:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836529 gen 3 00000004:00080000:3.0:1784191852.488982:0:165077:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784191852.489051:0:165077:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1784191852.489071:0:165077:0:(import.c:65:import_set_state_nolock()) ffff8af10de04800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1784191852.489085:0:165077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784191852.489088:0:165077:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869192 gen 3 00000004:00080000:3.0:1784191852.489097:0:165077:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784191852.489166:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858827903616:0@lo:9:umount.0 00000100:00100000:3.0:1784191852.489226:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784191852.489267:0:165077:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1784191852.489277:0:165077:0:(import.c:65:import_set_state_nolock()) ffff8af10f0d0800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1784191852.489292:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858827903744:0@lo:9:umount.0 00000100:00100000:3.0:1784191852.492623:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1784191852.492772:0:165077:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff8af20d7d99c0) has no exports 00010000:00010000:3.0:1784191852.493783:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191852.493811:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784191852.493822:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:106501:x1870858827901952:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00020000:3.0:1784191852.493830:0:158650:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784191852 with bad export cookie 18369123147424494883 00000400:00000100:3.0:1784191852.493877:0:158650:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1870858827901952 offset 224 length 224: 4 00000100:00100000:3.0:1784191852.493897:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:106501:x1870858827901952:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 76us (9513us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784191852.493906:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784191852.493930:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784191852.493935:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:106501:x1870858827902464:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00020000:3.0:1784191852.493940:0:158650:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784191852 with bad export cookie 18369123147424494883 00000400:00000100:3.0:1784191852.493956:0:158650:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1870858827902464 offset 224 length 224: 4 00000100:00100000:3.0:1784191852.493982:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:106501:x1870858827902464:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 46us (9553us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784191852.493988:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784191852.494001:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784191852.494005:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:106501:x1870858827902976:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00020000:3.0:1784191852.494010:0:158650:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784191852 with bad export cookie 18369123147424494883 00000400:00000100:3.0:1784191852.494025:0:158650:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1870858827902976 offset 224 length 224: 4 00000100:00100000:3.0:1784191852.494034:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:106501:x1870858827902976:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 28us (9566us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784191852.494040:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784191852.494050:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784191852.494055:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:106501:x1870858827901568:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00020000:3.0:1784191852.494059:0:158650:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784191852 with bad export cookie 18369123147424494883 00000400:00000100:3.0:1784191852.494072:0:158650:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1870858827901568 offset 224 length 224: 4 00000100:00100000:3.0:1784191852.494081:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:106501:x1870858827901568:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 25us (9569us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784191852.494087:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784191852.494099:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784191852.494103:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:106501:x1870858827902080:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00020000:3.0:1784191852.494108:0:158650:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784191852 with bad export cookie 18369123147424494883 00000400:00000100:3.0:1784191852.494121:0:158650:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1870858827902080 offset 224 length 224: 4 00000100:00100000:3.0:1784191852.494129:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:106501:x1870858827902080:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 25us (9589us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784191852.494135:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784191852.494145:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784191852.494150:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23d2c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:106501:x1870858827902592:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00020000:3.0:1784191852.494160:0:158650:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784191852 with bad export cookie 18369123147424494883 00000400:00000100:3.0:1784191852.494177:0:158650:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1870858827902592 offset 224 length 224: 4 00000100:00100000:3.0:1784191852.494186:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23d2c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:106501:x1870858827902592:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 36us (9618us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784191852.494192:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784191852.494205:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784191852.494210:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:106501:x1870858827903104:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00020000:3.0:1784191852.494214:0:158650:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784191852 with bad export cookie 18369123147424494883 00000400:00000100:3.0:1784191852.494227:0:158650:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1870858827903104 offset 224 length 224: 4 00000100:00100000:3.0:1784191852.494236:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:106501:x1870858827903104:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 25us (9640us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784191852.494241:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784191852.498633:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827903616 00000100:00100000:2.0:1784191852.498644:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827903616 00000100:00100000:2.0:1784191852.498728:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827903744 00000100:00100000:2.0:1784191852.498733:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827903744 00000100:00100000:2.0:1784191852.498757:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1784191852.498766:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:106498:x1870858827903616:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784191852.498794:0:162392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4766c 00000100:00080000:2.0:1784191852.498803:0:162392:0:(import.c:65:import_set_state_nolock()) ffff8af1079c3000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784191852.498850:0:162392:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836540 00000100:00100000:2.0:1784191852.499038:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+2:106498:x1870858827903616:12345-0@lo:9:umount.0 Request processed in 272us (9811us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191852.499046:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1784191852.499061:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1784191852.499067:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:106498:x1870858827903744:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784191852.499079:0:162392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a478fe 00000100:00080000:2.0:1784191852.499084:0:162392:0:(import.c:65:import_set_state_nolock()) ffff8af23d0cf000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784191852.499120:0:162392:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869231 00000100:00100000:2.0:1784191852.499205:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+2:106498:x1870858827903744:12345-0@lo:9:umount.0 Request processed in 137us (6586us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191852.499211:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000020:00080000:2.0:1784191852.499244:0:159415:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af23cfe9180 refcount 1 committed 1 result 1 batchid 17179869213 00000020:00080000:2.0:1784191852.499248:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af20d677500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af2199ec480 00000020:00080000:2.0:1784191852.499252:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].7 00000020:00080000:2.0:1784191852.499254:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af20d677700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af10e146c00 00000020:00080000:2.0:1784191852.499258:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].7 00000020:00080000:2.0:1784191852.499265:0:159415:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af20dbf6e40 refcount 1 committed 1 result 1 batchid 17179869214 00000020:00080000:2.0:1784191852.499268:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af20d677400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af201442900 00000020:00080000:2.0:1784191852.499270:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].8 00000020:00080000:2.0:1784191852.499273:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af20d677f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af111baf200 00000020:00080000:2.0:1784191852.499275:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].8 00000020:00080000:2.0:1784191852.499279:0:159415:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af104f1ef00 refcount 1 committed 1 result 1 batchid 17179869215 00000020:00080000:2.0:1784191852.499281:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af20d677e00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af1119a9c00 00000020:00080000:2.0:1784191852.499284:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].9 00000020:00080000:2.0:1784191852.499286:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af20d677000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af111baf600 00000020:00080000:2.0:1784191852.499288:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].9 00000020:00080000:2.0:1784191852.499292:0:159415:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af227a6a180 refcount 1 committed 1 result 1 batchid 17179869216 00000100:00080000:3.0:1784191852.500551:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10f0d0800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784191852.500569:0:106498:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784191852.500571:0:106498:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784191852.500576:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858827903744:0@lo:9:umount.0 00000100:00080000:3.0:1784191852.500590:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10de04800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784191852.500599:0:106498:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784191852.500600:0:106498:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784191852.500603:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858827903616:0@lo:9:umount.0 00000400:00000100:3.0:1784191852.500676:0:160189:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1870858827901440 offset 224 length 224: 4 00000100:00100000:3.0:1784191852.500712:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:106501:x1870858827901440:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 13369us (16396us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784191852.500721:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000020:00080000:2.0:1784191852.501826:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af110f52400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af227a6a540 00000020:00080000:2.0:1784191852.501831:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].10 00000020:00080000:2.0:1784191852.501834:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af110f52d00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af20d434800 00000020:00080000:2.0:1784191852.501837:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].10 00000020:00080000:2.0:1784191852.501846:0:159415:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af2035a1c00 refcount 1 committed 1 result 1 batchid 17179869217 00000020:00080000:2.0:1784191852.501865:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23dd56000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af2035a1e40 00000020:00080000:2.0:1784191852.501867:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].11 00000020:00080000:2.0:1784191852.501869:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23dd56d00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af10e146400 00000020:00080000:2.0:1784191852.501872:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].11 00000020:00080000:2.0:1784191852.501878:0:159415:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af105047780 refcount 1 committed 1 result 1 batchid 17179869218 00000020:00080000:2.0:1784191852.501881:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23dd56300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af105047a80 00000020:00080000:2.0:1784191852.501883:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].12 00000020:00080000:2.0:1784191852.501885:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23dd56f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af105a85000 00000020:00080000:2.0:1784191852.501888:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].12 00000020:00080000:2.0:1784191852.501891:0:159415:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af2387a7540 refcount 1 committed 1 result 1 batchid 17179869219 00000020:00080000:2.0:1784191852.501894:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af110f52000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af2387a7cc0 00000020:00080000:2.0:1784191852.501896:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].13 00000020:00080000:2.0:1784191852.501899:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af110f52c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af23d573a00 00000020:00080000:2.0:1784191852.501901:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].13 00000020:00080000:2.0:1784191852.501906:0:159415:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af2387a7180 refcount 1 committed 1 result 1 batchid 17179869220 00000020:00080000:2.0:1784191852.501909:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af110f52700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af2387a79c0 00000020:00080000:2.0:1784191852.501912:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].14 00000020:00080000:2.0:1784191852.501914:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af110f52900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af10b605200 00000020:00080000:2.0:1784191852.501916:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].14 00000020:00080000:2.0:1784191852.501920:0:159415:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af2127fda80 refcount 1 committed 1 result 1 batchid 17179869221 00000020:00080000:2.0:1784191852.501923:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23cac3300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af2127fd0c0 00000020:00080000:2.0:1784191852.501925:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].15 00000020:00080000:2.0:1784191852.501927:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23cac3700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af2239f9600 00000020:00080000:2.0:1784191852.501930:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].15 00000020:00080000:2.0:1784191852.501940:0:159415:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af23cf07d80 refcount 1 committed 1 result 1 batchid 17179869222 00000020:00080000:2.0:1784191852.501943:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23dd56800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff8af23cf070c0 00000020:00080000:2.0:1784191852.501946:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab1:0x1:0x0].16 00000020:00080000:2.0:1784191852.501948:0:159415:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23dd56900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af104a19000 00000020:00080000:2.0:1784191852.501950:0:159415:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002340:0x1:0x0].16 00010000:00010000:2.0:1784191852.502136:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784191852.502366:0:165077:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 6, last_idx 8 00000020:00080000:3.0:1784191852.502780:0:165077:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff8af20d7d99c0) has no exports 00010000:00010000:2.0:1784191852.506815:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191852.543895:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:0:1870858827901696:0@lo:103:jbd2/dm-1-8.0 00000100:00020000:0.0:1784191852.546238:0:106500:0:(client.c:1381:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff8af10db4f800 x1870858827901824/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl Rpc:QU/200/ffffffff rc 0/-1 job:'jbd2/dm-1-8.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784191852.546255:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:0:1870858827901824:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1784191852.549830:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00020000:0.0:1784191852.549852:0:106500:0:(client.c:1381:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff8af10db4ed80 x1870858827902336/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl Rpc:QU/200/ffffffff rc 0/-1 job:'jbd2/dm-1-8.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784191852.549867:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:0:1870858827902336:0@lo:103:jbd2/dm-1-8.0 00000100:00020000:0.0:1784191852.549876:0:106500:0:(client.c:1381:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff8af101685f80 x1870858827902848/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl Rpc:QU/200/ffffffff rc 0/-1 job:'jbd2/dm-1-8.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784191852.549883:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:0:1870858827902848:0@lo:103:jbd2/dm-1-8.0 00000100:00020000:0.0:1784191852.549889:0:106500:0:(client.c:1381:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff8af10d29e680 x1870858827903360/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl Rpc:QU/200/ffffffff rc 0/-1 job:'jbd2/dm-1-8.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784191852.549894:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:0:1870858827903360:0@lo:103:jbd2/dm-1-8.0 00000100:00020000:2.0:1784191852.554497:0:106499:0:(client.c:1381:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff8af10db4c000 x1870858827902208/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl Rpc:QU/200/ffffffff rc 0/-1 job:'jbd2/dm-1-8.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784191852.554514:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:0:1870858827902208:0@lo:103:jbd2/dm-1-8.0 00000100:00020000:2.0:1784191852.554521:0:106499:0:(client.c:1381:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff8af10db4ea00 x1870858827902720/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl Rpc:QU/200/ffffffff rc 0/-1 job:'jbd2/dm-1-8.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784191852.554528:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:0:1870858827902720:0@lo:103:jbd2/dm-1-8.0 00000100:00020000:2.0:1784191852.554535:0:106499:0:(client.c:1381:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff8af10d29ce00 x1870858827903232/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl Rpc:QU/200/ffffffff rc 0/-1 job:'jbd2/dm-1-8.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784191852.554542:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:0:1870858827903232:0@lo:103:jbd2/dm-1-8.0 00000020:01000000:2.0:1784191852.560642:0:165077:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8af10ff2cf60 - data ffff8af103f1fd80/ffff8af110fd4c00 00000020:01000000:2.0:1784191852.560822:0:165077:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8af2236fcd20 - data ffff8af22463c360/ffff8af22e884000 00000100:00080000:0.0:1784191852.623831:0:165077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784191852.623853:0:165077:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 34359738570 gen 4 00000100:00100000:0.0:1784191852.623868:0:165077:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8af10fb62a00 x1870858827903488/t34359738631(34359738631) o39->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784191862 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784191852.623894:0:165077:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1784191852.625564:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784191852.634578:0:165077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784191852.634588:0:165077:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836529 gen 4 00000004:00080000:1.0:1784191852.634615:0:165077:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784191852.634618:0:165077:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784191852.635013:0:159403:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784191852.635019:0:159403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 1 count 1 00000040:00080000:2.0:1784191852.635029:0:159403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 5 count 2 00000100:00080000:1.0:1784191852.635999:0:165077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784191852.636015:0:165077:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869192 gen 4 00000004:00080000:1.0:1784191852.636038:0:165077:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784191852.636040:0:165077:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784191852.636284:0:159405:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784191852.636288:0:159405:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x16:0x0] index 1 count 1 00000040:00080000:0.0:1784191852.636305:0:159405:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 5 count 2 00000020:00000080:1.0:1784191852.642976:0:165077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a474d6 00000020:00000080:1.0:1784191852.642991:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af20c678800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1784191852.643860:0:165077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a474eb 00000020:00000080:1.0:1784191852.643867:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af23f63b800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1784191852.643873:0:165077:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1784191852.643878:0:165077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784191852.643889:0:165077:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784191852.643893:0:165077:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff8af20d7db380) has no exports 00000004:01000000:1.0:1784191852.644080:0:165077:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1784191852.644089:0:165077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4753f 00000020:00000080:1.0:1784191852.644094:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af10b7ba800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1784191852.644098:0:165077:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1784191852.644101:0:165077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784191852.644107:0:165077:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784191852.644109:0:165077:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff8af110eab380) has no exports 00000020:00000080:1.0:1784191852.644115:0:165077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a47538 00000020:00000080:1.0:1784191852.644118:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af10f0d2000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1784191852.644475:0:165077:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1784191852.644481:0:165077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784191852.644485:0:165077:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869192 gen 5 00000004:00080000:1.0:1784191852.644491:0:165077:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784191852.644493:0:165077:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784191852.644525:0:165077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784191852.644532:0:165077:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784191852.644537:0:165077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4752a 00000020:00000080:1.0:1784191852.644541:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af1017cd000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1784191852.644545:0:165077:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1784191852.644548:0:165077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784191852.644552:0:165077:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784191852.644554:0:165077:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff8af109008000) has no exports 00000020:00000080:1.0:1784191852.644568:0:165077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4751c 00000020:00000080:1.0:1784191852.644571:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af10de02000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1784191852.644904:0:165077:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1784191852.644907:0:165077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784191852.644910:0:165077:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836529 gen 5 00000004:00080000:1.0:1784191852.644913:0:165077:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784191852.644915:0:165077:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784191852.644937:0:165077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784191852.644942:0:165077:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1784191852.644952:0:165077:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1784191852.644956:0:165077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4750e 00000020:00000080:1.0:1784191852.644961:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af10de05000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1784191852.644964:0:165077:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='') 00000020:00000080:1.0:1784191852.644968:0:165077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784191852.644971:0:165077:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784191852.644974:0:165077:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff8af10900cd40) has no exports 00000020:00000080:1.0:1784191852.644978:0:165077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a47507 00000020:00000080:1.0:1784191852.644981:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af204c7c800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1784191852.645794:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af20c678800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1784191852.645810:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23f63b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:2.0:1784191852.645816:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10b7ba800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1784191852.645821:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10f0d2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1784191852.645836:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af10f0d0800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1784191852.645842:0:70119:0:(genops.c:906:class_export_put()) final put ffff8af1017ce800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784191852.645844:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af1017ce800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1784191852.645849:0:70119:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784191852.645944:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af1017cd000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1784191852.645951:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10de02000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1784191852.645955:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af10de04800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1784191852.645959:0:70119:0:(genops.c:906:class_export_put()) final put ffff8af10de03000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784191852.645961:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10de03000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1784191852.645965:0:70119:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784191852.646003:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10de05000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1784191852.646008:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af204c7c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1784191852.689798:0:165077:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1784191852.689808:0:165077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784191852.689814:0:165077:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 34359738570 gen 5 00000100:00100000:0.0:1784191852.689823:0:165077:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784191852.689872:0:165077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784191852.689887:0:165077:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784191852.689913:0:165077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784191852.689917:0:165077:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784191852.689924:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af10c3ab800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784191852.689928:0:165077:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10c3ab800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1784191852.689940:0:165077:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784191852.690045:0:165077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a474f2 00000020:00000080:0.0:1784191852.690051:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af23f63b000/lustre-MDD0001_UUID 00000020:01000000:0.0:1784191852.690056:0:165077:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1784191852.690060:0:165077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784191852.690066:0:165077:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784191852.690069:0:165077:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8af20d7dcd40) has no exports 00000020:00000080:0.0:1784191852.690090:0:165077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784191852.690094:0:165077:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1784191852.690097:0:165077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a474f9 00000020:00000080:0.0:1784191852.690101:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af23f63a800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1784191852.690109:0:165077:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af109024000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1784191852.690113:0:165077:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af109024000 2 00000020:01000004:0.0:1784191852.690126:0:165077:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8af109024000 from lustre-MDT0001 00000020:00000080:0.0:1784191852.690143:0:165077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784191852.690147:0:165077:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1784191852.690150:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af10c3a9800/lustre-MDT0001_UUID 00000020:00000080:0.0:1784191852.690153:0:165077:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10c3a9800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1784191852.690159:0:165077:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1784191852.690191:0:165077:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:0.0:1784191852.690195:0:165077:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1784191852.690197:0:165077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784191852.690201:0:165077:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784191852.690209:0:165077:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8af23ea17000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784191852.690214:0:165077:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff8af23e6899c0) has exports, disconnecting them 00000020:00080000:0.0:1784191852.690218:0:165077:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8af23ea17000), last request at 1784191635 00000020:00000080:0.0:1784191852.690222:0:165077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a47577 00000020:00080000:0.0:1784191852.690234:0:165077:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af23ea17000): rc 0 00000020:00000080:0.0:1784191852.690238:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af23ea17000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1784191852.691071:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af204c79000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1784191852.691082:0:70119:0:(genops.c:906:class_export_put()) final put ffff8af23f638800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784191852.691084:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23f638800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1784191852.691094:0:70119:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784191852.691173:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23f63b000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1784191852.691178:0:70119:0:(genops.c:906:class_export_put()) final put ffff8af23f638000/lustre-MDD0001_UUID 00000020:00000080:2.0:1784191852.691180:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23f638000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1784191852.691183:0:70119:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1784191852.691214:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23f63a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1784191852.691219:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23ea17000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1784191852.724799:0:165077:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1784191852.724809:0:165077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784191852.724813:0:165077:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784191852.724820:0:165077:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784191852.724856:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af23ea14000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1784191852.725024:0:165077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784191852.725035:0:165077:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1784191852.725041:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af23ea16800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1784191852.725045:0:165077:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23ea16800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1784191852.725051:0:165077:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1784191852.725148:0:165077:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af109024000 1 00000020:00000080:2.0:1784191852.725154:0:165077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4749e 00000020:00000080:2.0:1784191852.725160:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af10545d000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1784191852.725168:0:165077:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1784191852.725176:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10545d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1784191852.725186:0:165077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784191852.725193:0:165077:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784191852.725197:0:165077:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff8af23e68cd40) has no exports 00000020:00000080:2.0:1784191853.150369:0:165077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784191853.150387:0:165077:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1784191853.150393:0:165077:0:(genops.c:906:class_export_put()) final put ffff8af109023000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1784191853.150398:0:165077:0:(genops.c:865:class_export_destroy()) destroying export ffff8af109023000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1784191853.150412:0:165077:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1784191853.150906:0:165077:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8af109022800 00000020:02000400:2.0:1784191853.151394:0:165077:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00000100:00100000:3.0:1784191853.404068:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191853.404150:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191853.404187:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812339584 00000100:00100000:3.0:1784191853.404195:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812339584 00000100:00100000:3.0:1784191853.404385:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 159 00000100:00100000:3.0:1784191853.404395:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69112:x1870858812339584:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191853.404475:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69112:x1870858812339584:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 81us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191853.404483:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 159 00000100:00080000:3.0:1784191853.404508:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784191853.409090:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812339328 00000100:00100000:1.0:1784191853.409105:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812339328 00000100:00100000:1.0:1784191853.409196:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 308 00000100:00100000:1.0:1784191853.409217:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812339328:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191853.409312:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812339328:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 97us (5252us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191853.409320:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 308 00000100:00080000:1.0:1784191853.409347:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784191853.418662:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191853.420549:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191853.420639:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191853.420674:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812339200 00000100:00100000:0.0:1784191853.420684:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812339200 00000100:00100000:0.0:1784191853.420751:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 249 00000100:00100000:0.0:1784191853.420760:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812339200:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191853.420833:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812339200:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 73us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191853.420842:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 249 00000100:00100000:0.0:1784191853.420879:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812339712 00000100:00100000:0.0:1784191853.420883:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812339712 00000100:00100000:0.0:1784191853.420931:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 160 00000100:00100000:0.0:1784191853.420938:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69109:x1870858812339712:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191853.420983:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69109:x1870858812339712:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 45us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191853.420989:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 160 00000100:00080000:0.0:1784191853.421079:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784191853.424498:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812339456 00000100:00100000:3.0:1784191853.424518:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812339456 00000100:00100000:3.0:1784191853.424572:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 420 00000100:00100000:3.0:1784191853.424581:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:69111:x1870858812339456:12345-192.168.204.16@tcp:400:kworker.0 00000020:00080000:3.0:1784191853.424591:0:161504:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.16@tcp 00000100:00100000:3.0:1784191853.424664:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:69111:x1870858812339456:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 83us (6012us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784191853.424673:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 420 00000100:00100000:3.0:1784191853.486484:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191853.507245:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812339840 00000100:00100000:3.0:1784191853.507262:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812339840 00000100:00100000:3.0:1784191853.507338:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 421 00000100:00100000:3.0:1784191853.507347:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:69108:x1870858812339840:12345-192.168.204.16@tcp:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1784191853.507463:0:164531:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784191853.507635:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:69108:x1870858812339840:12345-192.168.204.16@tcp:38:ptlrpcd_00_02.0 Request processed in 285us (21160us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784191853.507659:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 421 00010000:00010000:1.0:1784191853.645658:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784191854.625761:0:158645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1784191854.625780:0:158645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738631 is committed 00000020:00000080:0.0:1784191854.625809:0:158645:0:(genops.c:906:class_export_put()) final put ffff8af101783000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784191854.625836:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af101783000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1784191854.625908:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af23ea17800 for lustre-MDT0000 00010000:00010000:0.0:1784191854.668844:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191855.119037:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827903872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784191855.128169:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191855.128331:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827903872 00000100:00100000:3.0:1784191855.128340:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827903872 00000100:00100000:3.0:1784191855.128384:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1784191855.128393:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:106501:x1870858827903872:12345-0@lo:41:osp-pre-1-0.0 00000020:00080000:3.0:1784191855.128403:0:161739:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784191855.128465:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:106501:x1870858827903872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (304us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784191855.128472:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:02020000:3.0:1784191855.128513:0:106501:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1784191855.150546:0:106501:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-osp-MDT0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784191855.150553:0:106501:0:(import.c:65:import_set_state_nolock()) ffff8af10f422800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784191855.150557:0:106501:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784191855.176824:0:106501:0:(import.c:65:import_set_state_nolock()) ffff8af10f422800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784191855.176841:0:106501:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 5260 00000100:00080000:3.0:1784191855.176851:0:106501:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8af10f422800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:3.0:1784191855.177070:0:106501:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af10db4f480 x1870858827904000/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191855.178319:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827904000:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1784191855.178396:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191855.178469:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827904000 00000100:00100000:3.0:1784191855.178477:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827904000 00000100:00100000:3.0:1784191855.178522:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:3.0:1784191855.178529:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:106498:x1870858827904000:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1784191855.178568:0:158670:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784191855.178616:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:106498:x1870858827904000:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 86us (219us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784191855.178624:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00080000:3.0:1784191855.178668:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10f422800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784191855.178672:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784191855.178676:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827904000:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1784191855.630819:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827904128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784191855.630907:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191855.631595:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827904128 00000100:00100000:1.0:1784191855.631606:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827904128 00000100:00100000:1.0:1784191855.631710:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784191855.631721:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827904128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784191855.631765:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8228544 pending 0 free 71049216 avail 63881216 00000100:00100000:1.0:1784191855.631821:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827904128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191855.631828:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784191855.631899:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827904128:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784191855.631977:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784191855.692394:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191856.717111:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191857.164004:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784191857.164031:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827904256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784191857.164106:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191857.164258:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827904256 00000100:00100000:3.0:1784191857.164268:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827904256 00000100:00100000:3.0:1784191857.164348:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784191857.164359:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827904256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784191857.164394:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8249024 pending 0 free 71184384 avail 64016384 00000100:00100000:3.0:1784191857.164456:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827904256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191857.164464:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784191857.164516:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827904256:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784191857.164609:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784191857.171413:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784191857.171420:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784191857.171424:0:36:0:(import.c:65:import_set_state_nolock()) ffff8af10f422800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784191857.171435:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 5475 00000100:00080000:3.0:1784191857.171442:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784191857.171449:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8af10f422800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:3.0:1784191857.171489:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af10db4c000 x1870858827904512/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191857.171597:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827904512:0@lo:38:kworker.0 00000100:00100000:3.0:1784191857.171682:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191857.171781:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827904640:0@lo:400:kworker.0 00000100:00100000:3.0:1784191857.171813:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191857.171843:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858827905152:0@lo:400:kworker.0 00000100:00100000:3.0:1784191857.171874:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191857.171900:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784191857.171906:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827904768:0@lo:400:kworker.0 00000100:00100000:3.0:1784191857.171944:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191857.171964:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827905280:0@lo:400:kworker.0 00000100:00100000:3.0:1784191857.171986:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191857.172034:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827904512 00000100:00100000:3.0:1784191857.172042:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827904512 00000100:00100000:3.0:1784191857.172080:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1784191857.172087:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:106498:x1870858827904512:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784191857.172111:0:161739:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784191857.172154:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:106498:x1870858827904512:12345-0@lo:38:kworker.0 Request processed in 66us (473us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784191857.172163:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1784191857.172189:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827904640 00000100:00100000:3.0:1784191857.172193:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827904640 00000100:00100000:3.0:1784191857.172252:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784191857.172261:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827904640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191857.172310:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827904640:12345-0@lo:400:kworker.0 Request processed in 51us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191857.172323:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784191857.172345:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827905152 00000100:00100000:3.0:1784191857.172349:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827905152 00000100:00100000:3.0:1784191857.172379:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827904768 00000100:00100000:3.0:1784191857.172383:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827904768 00000100:00100000:3.0:1784191857.172402:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827905280 00000100:00100000:3.0:1784191857.172405:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827905280 00000100:00100000:3.0:1784191857.172418:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1784191857.172425:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858827905152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191857.172463:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858827905152:12345-0@lo:400:kworker.0 Request processed in 39us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191857.172470:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1784191857.172484:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1784191857.172490:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827904768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191857.172523:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827904768:12345-0@lo:400:kworker.0 Request processed in 33us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191857.172529:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1784191857.172542:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1784191857.172546:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:106501:x1870858827905280:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784191857.172553:0:158666:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784191857.172582:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:106501:x1870858827905280:12345-0@lo:400:kworker.0 Request processed in 34us (594us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784191857.172588:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00080000:3.0:1784191857.172625:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784191857.172630:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784191857.172654:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10f422800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784191857.172930:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784191857.172944:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827904512:0@lo:38:kworker.0 00000100:00100000:3.0:1784191857.172984:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827904768:0@lo:400:kworker.0 00000100:00080000:3.0:1784191857.172994:0:106501:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784191857.172998:0:106501:0:(import.c:65:import_set_state_nolock()) ffff8af23f2db000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784191857.173001:0:106501:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784191857.173006:0:106501:0:(import.c:65:import_set_state_nolock()) ffff8af23f2db000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784191857.173010:0:106501:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 5288 00000100:00080000:3.0:1784191857.173016:0:106501:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8af23f2db000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:3.0:1784191857.173087:0:106501:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af22dcfc000 x1870858827905408/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191857.173109:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827905280:0@lo:400:kworker.0 00000100:00100000:3.0:1784191857.173123:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827904640:0@lo:400:kworker.0 00000100:00100000:3.0:1784191857.173134:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858827905152:0@lo:400:kworker.0 00000100:00100000:3.0:1784191857.173162:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:106498:1870858827905408:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1784191857.173192:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191857.173235:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827905408 00000100:00100000:3.0:1784191857.173239:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827905408 00000100:00100000:3.0:1784191857.173261:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1784191857.173266:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:106498:x1870858827905408:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1784191857.173281:0:158666:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784191857.173318:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:106498:x1870858827905408:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 50us (125us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784191857.173335:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00080000:3.0:1784191857.173364:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23f2db000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784191857.173368:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784191857.173371:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:106498:1870858827905408:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1784191857.173958:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858827904896:0@lo:400:kworker.0 00000100:00100000:2.0:1784191857.173996:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191857.174019:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784191857.174025:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827904384:0@lo:400:kworker.0 00000100:00100000:2.0:1784191857.174049:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191857.174070:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858827905024:0@lo:400:kworker.0 00000100:00100000:2.0:1784191857.174097:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191857.174118:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827904896 00000100:00100000:2.0:1784191857.174122:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827904896 00000100:00100000:2.0:1784191857.174155:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827905024 00000100:00100000:2.0:1784191857.174157:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827905024 00000100:00100000:2.0:1784191857.174170:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1784191857.174176:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858827904896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191857.174230:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858827904896:12345-0@lo:400:kworker.0 Request processed in 53us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191857.174237:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1784191857.174252:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1784191857.174256:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:106499:x1870858827905024:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784191857.174261:0:158665:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784191857.174286:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:106499:x1870858827905024:12345-0@lo:400:kworker.0 Request processed in 28us (188us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784191857.174292:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00080000:2.0:1784191857.174313:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784191857.174332:0:106499:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784191857.174336:0:106499:0:(import.c:65:import_set_state_nolock()) ffff8af10c3ad800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784191857.174340:0:106499:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784191857.174344:0:106499:0:(import.c:65:import_set_state_nolock()) ffff8af10c3ad800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784191857.174349:0:106499:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 5271 00000100:00080000:2.0:1784191857.174355:0:106499:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8af10c3ad800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:2.0:1784191857.174375:0:106499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af10d29f100 x1870858827905536/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784191857.174395:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858827905024:0@lo:400:kworker.0 00000100:00100000:2.0:1784191857.174419:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858827904896:0@lo:400:kworker.0 00000100:00100000:2.0:1784191857.174440:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:106498:1870858827905536:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1784191857.174461:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191857.174490:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827905536 00000100:00100000:2.0:1784191857.174493:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827905536 00000100:00100000:2.0:1784191857.174509:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:2.0:1784191857.174513:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:106498:x1870858827905536:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1784191857.174527:0:158666:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784191857.174552:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:106498:x1870858827905536:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 38us (90us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784191857.174559:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00080000:2.0:1784191857.174580:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10c3ad800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784191857.174583:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784191857.174587:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:106498:1870858827905536:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1784191857.179103:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827904384 00000100:00100000:1.0:1784191857.179120:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827904384 00000100:00100000:1.0:1784191857.179183:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1784191857.179195:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af206b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+19:106499:x1870858827904384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191857.179310:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af206b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+19:106499:x1870858827904384:12345-0@lo:400:kworker.0 Request processed in 117us (5258us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191857.179318:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1784191857.179382:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827904384:0@lo:400:kworker.0 00000001:00100000:3.0:1784191857.678499:0:160977:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784191857.678509:0:160977:0:(genops.c:906:class_export_put()) final put ffff8af23d0c9000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784191857.680062:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23d0c9000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784191857.680280:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af23d0cf000 for lustre-OST0001 00000001:00100000:1.0:1784191857.683491:0:160160:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784191857.683502:0:160160:0:(genops.c:906:class_export_put()) final put ffff8af1079c7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784191857.683800:0:123300:0:(genops.c:865:class_export_destroy()) destroying export ffff8af1079c7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1784191857.683863:0:123300:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af1079c3000 for lustre-OST0000 00010000:00010000:3.0:1784191857.748126:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191858.517826:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191858.517867:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191858.517891:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191858.517911:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191858.517938:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191858.517969:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812339968 00000100:00100000:1.0:1784191858.517979:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812339968 00000100:00100000:1.0:1784191858.518033:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 251 00000100:00100000:1.0:1784191858.518044:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af206b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812339968:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191858.518806:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af206b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812339968:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 761us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191858.518817:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 251 00000100:00100000:1.0:1784191858.518862:0:162390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812340480 00000100:00100000:1.0:1784191858.518867:0:162390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812340480 00000100:00100000:1.0:1784191858.518910:0:162390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812340352 00000100:00100000:1.0:1784191858.518913:0:162390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812340352 00000100:00100000:1.0:1784191858.518936:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 162 00000100:00100000:1.0:1784191858.518944:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812340480:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191858.518980:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812340480:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 37us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191858.518987:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 162 00000100:00100000:1.0:1784191858.518999:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 163 00000100:00100000:1.0:1784191858.519006:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812340352:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191858.519029:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812340352:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 24us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191858.519035:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 163 00000100:00100000:1.0:1784191858.519054:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812340224 00000100:00100000:1.0:1784191858.519058:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812340224 00000100:00100000:1.0:1784191858.519076:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812340096 00000100:00100000:1.0:1784191858.519079:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812340096 00000100:00100000:1.0:1784191858.519604:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 312 00000100:00100000:1.0:1784191858.519614:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812340096:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191858.519949:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812340096:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 337us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191858.519973:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 312 00000100:00100000:1.0:1784191858.519990:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 426 00000100:00100000:1.0:1784191858.519995:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:69108:x1870858812340224:12345-192.168.204.16@tcp:38:kworker.0 00010000:00020000:1.0:1784191858.520018:0:158667:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784191858.520047:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:69108:x1870858812340224:12345-192.168.204.16@tcp:38:kworker.0 Request processed in 51us (2231us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784191858.520054:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 426 00000100:00080000:1.0:1784191858.521643:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784191858.521654:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784191858.521656:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784191858.763842:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191859.793365:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191860.748486:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827905664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784191860.748559:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191860.748861:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827905664 00000100:00100000:3.0:1784191860.748869:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827905664 00000100:00100000:3.0:1784191860.748931:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784191860.748941:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827905664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784191860.748972:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8228544 pending 0 free 71049216 avail 63881216 00000100:00100000:3.0:1784191860.749945:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827905664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1002us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191860.749957:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1784191860.750001:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784191860.750801:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827905664:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784191860.813911:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191861.837842:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784191862.011037:0:165480:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784191862.011042:0:165480:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1784191862.011043:0:165480:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1784191862.011178:0:165480:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8af22dcd8000 00000020:01000004:1.0:1784191862.011197:0:165480:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1784191862.011217:0:165480:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1784191862.011234:0:165480:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8af2236b19c0) 00000020:00000080:1.0:1784191862.011261:0:165480:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1784191862.126662:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1784191862.126958:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1784191862.138419:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1784191862.138627:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x46:0x0] (16/1) registered 00100000:10000000:0.0:1784191862.138827:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1784191862.139256:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1784191862.144601:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5a:0x0] (16/1) registered 00100000:10000000:0.0:1784191862.146453:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1784191862.147269:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x47:0x0] (16/1) registered 00100000:10000000:0.0:1784191862.147718:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5c:0x0] (16/1) registered 00100000:10000000:0.0:1784191862.147978:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1784191862.150206:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1784191862.151015:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1784191862.153808:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4b:0x0] (16/1) registered 00100000:10000000:0.0:1784191862.154556:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1784191862.155658:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5f:0x0] (16/1) registered 00100000:10000000:3.0:1784191862.163873:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1784191862.164799:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x48:0x0] (16/1) registered 00100000:10000000:3.0:1784191862.165152:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x58:0x0] (16/1) registered 00100000:10000000:3.0:1784191862.165614:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1784191862.165900:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1784191862.166194:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1784191862.168163:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1784191862.168869:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3e:0x0] (16/1) registered 00100000:10000000:3.0:1784191862.169174:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1784191862.169614:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1784191862.169847:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1784191862.170208:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x66:0x0] (16/1) registered 00100000:10000000:3.0:1784191862.170646:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1784191862.170867:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1784191862.171130:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1784191862.171474:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1784191862.171781:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1784191862.172058:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x56:0x0] (16/1) registered 00100000:10000000:3.0:1784191862.172910:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1784191862.173248:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1784191862.173640:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1784191862.173905:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1784191862.174308:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1784191862.174559:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1784191862.174828:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1784191862.175140:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1784191862.175354:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1784191862.175544:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1784191862.175836:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1784191862.176369:0:165480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1784191862.177219:0:165480:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784191862.177583:0:165480:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1784191862.177599:0:165480:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784191862.177624:0:165480:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfeec3c2dc5a4a925 00000020:01000004:3.0:1784191862.177636:0:165480:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1784191862.177668:0:165480:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.116@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784191862.177672:0:165480:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784191862.177684:0:165480:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1784191862.177769:0:165480:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1784191862.177775:0:165480:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.116@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1784191862.191366:0:165480:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.116@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784191862.191430:0:165480:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.116@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1784191862.191435:0:165480:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784191862.191436:0:165480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784191862.191438:0:165480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784191862.191439:0:165480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784191862.191441:0:165480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784191862.191442:0:165480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784191862.191444:0:165480:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784191862.191445:0:165480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784191862.191447:0:165480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784191862.191451:0:165480:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1784191862.191453:0:165480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784191862.191455:0:165480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784191862.191456:0:165480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784191862.191457:0:165480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784191862.191458:0:165480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784191862.191459:0:165480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784191862.191460:0:165480:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784191862.191461:0:165480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784191862.191462:0:165480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784191862.191493:0:165480:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1784191862.191516:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827905792:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784191862.191600:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.191673:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10c77b900 going to sleep for 11 seconds 00000100:00100000:0.0:1784191862.191831:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827905792 00000100:00100000:0.0:1784191862.191839:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827905792 00000100:00100000:0.0:1784191862.191904:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1784191862.191915:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af206b31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+19:165480:x1870858827905792:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784191862.191948:0:158658:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1784191862.191951:0:158658:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1784191862.191958:0:158658:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1784191862.192301:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af206b31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+19:165480:x1870858827905792:12345-0@lo:253:mount.lustre.0 Request processed in 387us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191862.192309:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1784191862.192438:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827905792:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784191862.192450:0:165480:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1784191862.192461:0:165480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784191862.192462:0:165480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784191862.192464:0:165480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784191862.192465:0:165480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784191862.192466:0:165480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784191862.192467:0:165480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784191862.192468:0:165480:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784191862.192470:0:165480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784191862.192471:0:165480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784191862.192493:0:165480:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8af22dcd8000 from lustre-MDT0001 10000000:01000000:3.0:1784191862.192534:0:165480:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1784191862.192537:0:165480:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1784191862.192546:0:165480:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8af107b719c0 local copy 00010000:00010000:3.0:1784191862.192556:0:165480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af23dd69000/0xfeec3c2dc5a47394 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4739b expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191862.192648:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827905920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784191862.192682:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.192750:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af202d61240 going to sleep for 11 seconds 00000100:00100000:1.0:1784191862.192824:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827905920 00000100:00100000:1.0:1784191862.192829:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827905920 00000100:00100000:1.0:1784191862.192869:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1784191862.192877:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af206b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+19:165480:x1870858827905920:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784191862.192959:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af206b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+19:165480:x1870858827905920:12345-0@lo:501:mount.lustre.0 Request processed in 82us (276us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784191862.192966:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1784191862.193847:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827905920:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784191862.193869:0:165480:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784191862.193897:0:165480:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784191862.193905:0:165480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af23dd69000/0xfeec3c2dc5a47394 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4739b expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.193915:0:165480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af23dd69000/0xfeec3c2dc5a47394 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4739b expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784191862.193961:0:165480:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8af22dcd8000 10000000:01000000:3.0:1784191862.193967:0:165480:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784191862.193973:0:165480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8af22dcd8000 10000000:01000000:3.0:1784191862.193984:0:165480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1784191862.193989:0:165480:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8af22dcd8000 from 1 10000000:01000000:3.0:1784191862.193992:0:165480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784191862.194020:0:165480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af110db3200/0xfeec3c2dc5a4a92c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.194028:0:165480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af110db3200/0xfeec3c2dc5a4a92c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.194037:0:165480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af110db3200/0xfeec3c2dc5a4a92c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191862.194053:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827906048:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784191862.194096:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.194148:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af202d61240 going to sleep for 11 seconds 00000100:00100000:1.0:1784191862.194379:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827906048 00000100:00100000:1.0:1784191862.194385:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827906048 00000100:00100000:1.0:1784191862.194429:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1784191862.194437:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af206b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+19:165480:x1870858827906048:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784191862.194450:0:158660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191862.194464:0:158660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af233127400/0xfeec3c2dc5a4a933 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a92c expref: -99 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.194484:0:158660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af233127400/0xfeec3c2dc5a4a933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a92c expref: 20 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.194494:0:158660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af233127400/0xfeec3c2dc5a4a933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a92c expref: 20 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.194503:0:158660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233127400, rc 0) 00000100:00100000:1.0:1784191862.194549:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af206b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+20:165480:x1870858827906048:12345-0@lo:101:mount.lustre.0 Request processed in 112us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191862.194555:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1784191862.194641:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827906048:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784191862.194657:0:165480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af110db3200/0xfeec3c2dc5a4a92c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a933 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.194666:0:165480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af110db3200/0xfeec3c2dc5a4a92c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a933 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784191862.194679:0:165480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784191862.194718:0:165480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af110db3200/0xfeec3c2dc5a4a92c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a933 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.194734:0:165480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af110db3200/0xfeec3c2dc5a4a92c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a933 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784191862.194741:0:165480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1784191862.194746:0:165480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784191862.194751:0:165480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8af22dcd8000 10000000:01000000:2.0:1784191862.194755:0:165480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784191862.194758:0:165480:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1784191862.194760:0:165480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1784191862.194778:0:165480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1019d5c00/0xfeec3c2dc5a4a93a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.194785:0:165480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af1019d5c00/0xfeec3c2dc5a4a93a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.194792:0:165480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af1019d5c00/0xfeec3c2dc5a4a93a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191862.194804:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827906176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784191862.194833:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191862.194846:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107afff00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191862.194917:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827906176 00000100:00100000:3.0:1784191862.194921:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827906176 00000100:00100000:3.0:1784191862.194956:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1784191862.194964:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af206b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+20:165480:x1870858827906176:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784191862.194971:0:158658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191862.194981:0:158658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af110db2400/0xfeec3c2dc5a4a941 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a93a expref: -99 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.194995:0:158658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af110db2400/0xfeec3c2dc5a4a941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a93a expref: 21 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.195003:0:158658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af110db2400/0xfeec3c2dc5a4a941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a93a expref: 21 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.195009:0:158658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db2400, rc 0) 00000100:00100000:3.0:1784191862.195048:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af206b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:165480:x1870858827906176:12345-0@lo:101:mount.lustre.0 Request processed in 85us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.195055:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1784191862.195441:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827906176:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784191862.195454:0:165480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af1019d5c00/0xfeec3c2dc5a4a93a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a941 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.195462:0:165480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af1019d5c00/0xfeec3c2dc5a4a93a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a941 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784191862.196780:0:165480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 46 count 46 00000040:00080000:2.0:1784191862.197786:0:165480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784191862.200679:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].1, 224 off8416 00000040:00080000:2.0:1784191862.200781:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].2, 136 off8552 00000040:00080000:2.0:1784191862.200798:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].3, 176 off8728 00000040:00080000:2.0:1784191862.200812:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].4, 224 off8952 00000040:00080000:2.0:1784191862.200826:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].5, 224 off9176 00000040:00080000:2.0:1784191862.200839:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].6, 120 off9296 00000040:00080000:2.0:1784191862.200852:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].7, 112 off9408 00000040:00080000:2.0:1784191862.200866:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].8, 160 off9568 00000040:00080000:2.0:1784191862.200880:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].9, 224 off9792 00000040:00080000:2.0:1784191862.200898:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].10, 224 off10016 00000040:00080000:2.0:1784191862.200911:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].11, 88 off10104 00000040:00080000:2.0:1784191862.200923:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].12, 144 off10248 00000040:00080000:2.0:1784191862.200937:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].13, 152 off10400 00000040:00080000:2.0:1784191862.200953:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].14, 168 off10568 00000040:00080000:2.0:1784191862.200968:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].15, 224 off10792 00000040:00080000:2.0:1784191862.200983:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].16, 224 off11016 00000040:00080000:2.0:1784191862.200996:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].17, 80 off11096 00000040:00080000:2.0:1784191862.201008:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].18, 224 off11320 00000040:00080000:2.0:1784191862.201019:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].19, 224 off11544 00000040:00080000:2.0:1784191862.201032:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].20, 160 off11704 00000040:00080000:2.0:1784191862.201045:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].21, 224 off11928 00000040:00080000:2.0:1784191862.201060:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].22, 224 off12152 00000040:00080000:2.0:1784191862.201072:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].23, 80 off12232 00000040:00080000:2.0:1784191862.201086:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].24, 224 off12456 00000040:00080000:2.0:1784191862.201098:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].25, 224 off12680 00000040:00080000:2.0:1784191862.201109:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].26, 88 off12768 00000040:00080000:2.0:1784191862.201140:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].27, 144 off12912 00000040:00080000:2.0:1784191862.201157:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].28, 152 off13064 00000040:00080000:2.0:1784191862.201185:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].29, 136 off13200 00000040:00080000:2.0:1784191862.201197:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].30, 224 off13424 00000040:00080000:2.0:1784191862.201209:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].31, 224 off13648 00000040:00080000:2.0:1784191862.201221:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].32, 80 off13728 00000040:00080000:2.0:1784191862.201234:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].33, 224 off13952 00000040:00080000:2.0:1784191862.201247:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].34, 224 off14176 00000040:00080000:2.0:1784191862.201258:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].35, 88 off14264 00000040:00080000:2.0:1784191862.201272:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].36, 144 off14408 00000040:00080000:1.0:1784191862.202386:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].37, 152 off14560 00000040:00080000:1.0:1784191862.202432:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].38, 136 off14696 00000040:00080000:1.0:1784191862.202447:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].39, 224 off14920 00000040:00080000:1.0:1784191862.202459:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].40, 224 off15144 00000040:00080000:1.0:1784191862.202471:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].41, 80 off15224 00000040:00080000:1.0:1784191862.202483:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].42, 224 off15448 00000040:00080000:1.0:1784191862.202495:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].43, 224 off15672 00000040:00080000:1.0:1784191862.202507:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].44, 120 off15792 00000040:00080000:1.0:1784191862.202549:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].45, 224 off16016 00000040:00080000:1.0:1784191862.202555:0:165480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 45 count 46 00000100:00100000:1.0:1784191862.202783:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827906304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784191862.202867:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191862.202909:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e2780 going to sleep for 11 seconds 00000100:00100000:3.0:1784191862.203031:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827906304 00000100:00100000:3.0:1784191862.203039:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827906304 00000100:00100000:3.0:1784191862.203099:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1784191862.203120:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:165480:x1870858827906304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784191862.203304:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:165480:x1870858827906304:12345-0@lo:501:mount.lustre.0 Request processed in 195us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.203313:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1784191862.203526:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827906304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784191862.203567:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827906432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784191862.203613:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191862.203639:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e2780 going to sleep for 11 seconds 00000100:00100000:2.0:1784191862.204394:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827906432 00000100:00100000:2.0:1784191862.204402:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827906432 00000100:00100000:2.0:1784191862.204450:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1784191862.204458:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:165480:x1870858827906432:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784191862.204580:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:165480:x1870858827906432:12345-0@lo:503:mount.lustre.0 Request processed in 122us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191862.204587:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1784191862.204881:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827906432:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784191862.205736:0:165480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784191862.205831:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827906560:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784191862.205896:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191862.205932:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e2780 going to sleep for 11 seconds 00000100:00100000:2.0:1784191862.208054:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827906560 00000100:00100000:2.0:1784191862.208071:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827906560 00000100:00100000:2.0:1784191862.208148:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1784191862.208157:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:165480:x1870858827906560:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784191862.208350:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:165480:x1870858827906560:12345-0@lo:502:mount.lustre.0 Request processed in 193us (2453us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191862.208358:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1784191862.210199:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827906560:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784191862.211317:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:0.0:1784191862.211370:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 136 off8552 00000040:00080000:0.0:1784191862.211387:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 176 off8728 00000040:00080000:0.0:1784191862.211399:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8952 00000040:00080000:0.0:1784191862.211412:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 224 off9176 00000040:00080000:0.0:1784191862.211426:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 120 off9296 00000040:00080000:0.0:1784191862.211437:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].7, 112 off9408 00000040:00080000:0.0:1784191862.211449:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].8, 160 off9568 00000040:00080000:0.0:1784191862.211462:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].9, 224 off9792 00000040:00080000:0.0:1784191862.211474:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].10, 224 off10016 00000040:00080000:0.0:1784191862.211486:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].11, 88 off10104 00000040:00080000:0.0:1784191862.211510:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].12, 144 off10248 00000040:00080000:0.0:1784191862.211522:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].13, 152 off10400 00000040:00080000:0.0:1784191862.211536:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].14, 168 off10568 00000040:00080000:0.0:1784191862.211548:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].15, 224 off10792 00000040:00080000:0.0:1784191862.211642:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].16, 224 off11016 00000040:00080000:0.0:1784191862.212155:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].17, 80 off11096 00000040:00080000:0.0:1784191862.212172:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].18, 224 off11320 00000040:00080000:0.0:1784191862.212186:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].19, 224 off11544 00000040:00080000:0.0:1784191862.212199:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].20, 160 off11704 00000040:00080000:0.0:1784191862.212212:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].21, 224 off11928 00000040:00080000:0.0:1784191862.212227:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].22, 224 off12152 00000040:00080000:0.0:1784191862.212241:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].23, 80 off12232 00000040:00080000:0.0:1784191862.212255:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].24, 224 off12456 00000040:00080000:0.0:1784191862.212269:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].25, 224 off12680 00000040:00080000:0.0:1784191862.212282:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].26, 88 off12768 00000040:00080000:0.0:1784191862.212295:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].27, 144 off12912 00000040:00080000:0.0:1784191862.212309:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].28, 152 off13064 00000040:00080000:0.0:1784191862.212324:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].29, 136 off13200 00000040:00080000:0.0:1784191862.212337:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].30, 224 off13424 00000040:00080000:0.0:1784191862.212349:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].31, 224 off13648 00000040:00080000:0.0:1784191862.212360:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].32, 80 off13728 00000040:00080000:0.0:1784191862.212373:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].33, 224 off13952 00000040:00080000:0.0:1784191862.212388:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].34, 224 off14176 00000040:00080000:0.0:1784191862.212401:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].35, 88 off14264 00000040:00080000:0.0:1784191862.212413:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].36, 144 off14408 00000040:00080000:0.0:1784191862.212426:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].37, 152 off14560 00000040:00080000:0.0:1784191862.212438:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].38, 136 off14696 00000040:00080000:0.0:1784191862.212452:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].39, 224 off14920 00000040:00080000:0.0:1784191862.212465:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].40, 224 off15144 00000040:00080000:0.0:1784191862.212479:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].41, 80 off15224 00000040:00080000:0.0:1784191862.212492:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].42, 224 off15448 00000040:00080000:0.0:1784191862.212504:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].43, 224 off15672 00000040:00080000:0.0:1784191862.212521:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].44, 120 off15792 00000100:00100000:0.0:1784191862.212594:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827906688:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784191862.215061:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.215410:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827906688 00000100:00100000:3.0:1784191862.215421:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827906688 00000100:00100000:3.0:1784191862.215510:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1784191862.215521:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:165480:x1870858827906688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784191862.216035:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:165480:x1870858827906688:12345-0@lo:502:mount.lustre.0 Request processed in 514us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.216044:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1784191862.216468:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2337b8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784191862.216508:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827906688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784191862.216618:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].45, 224 off16016 00000040:00080000:1.0:1784191862.216635:0:165480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1784191862.219380:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784191862.219395:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784191862.219398:0:165484:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1784191862.219405:0:165484:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1784191862.219408:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784191862.219424:0:165484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8af110eab380) 00000020:00000080:3.0:1784191862.219450:0:165484:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1784191862.219456:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1784191862.219538:0:165484:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784191862.219547:0:165484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfeec3c2dc5a4a94f 00000020:00000080:0.0:1784191862.224873:0:165484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1784191862.224889:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784191862.224901:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784191862.224904:0:165484:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1784191862.224909:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784191862.224915:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784191862.224917:0:165484:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1784191862.224922:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784191862.224938:0:165484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8af1077a4d40) 00000020:00000080:0.0:1784191862.225092:0:165484:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1784191862.225100:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784191862.225102:0:165484:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1784191862.225105:0:165484:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1784191862.225124:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784191862.225214:0:165484:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af22dcd8000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1784191862.225229:0:165484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8af20d7dcd40) 00000020:00000080:0.0:1784191862.225240:0:165484:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1784191862.225315:0:165484:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784191862.225322:0:165484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeec3c2dc5a4a964 00000020:00000080:0.0:1784191862.226137:0:165484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1784191862.226149:0:165484:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784191862.226157:0:165484:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xfeec3c2dc5a4a96b 00080000:01000000:0.0:1784191862.226167:0:165484:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784191862.226173:0:165484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfeec3c2dc5a4a972 00000100:00100000:3.0:1784191862.284189:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784191862.284220:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827906816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191862.284495:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191862.284605:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827906816 00000100:00100000:1.0:1784191862.284615:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827906816 00000100:00100000:1.0:1784191862.284725:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784191862.284738:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827906816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784191862.284772:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8249024 pending 0 free 71184384 avail 64016384 00000100:00100000:1.0:1784191862.284823:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827906816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191862.284831:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:3.0:1784191862.285404:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784191862.285452:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827906816:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784191862.286567:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784191862.286575:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1784191862.286579:0:36:0:(import.c:65:import_set_state_nolock()) ffff8af10f422800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784191862.286586:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 5477 00000100:00080000:2.0:1784191862.286591:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784191862.286599:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8af10f422800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:2.0:1784191862.286658:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af10d29f100 x1870858827906944/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191862.286762:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827906944:0@lo:38:kworker.0 00000100:00080000:2.0:1784191862.286768:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784191862.286771:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1784191862.286773:0:36:0:(import.c:65:import_set_state_nolock()) ffff8af10c3ad800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784191862.286777:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 5477 00000100:00080000:2.0:1784191862.286779:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784191862.286783:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8af10c3ad800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:2.0:1784191862.286794:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af10d29f800 x1870858827907456/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784191862.286810:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784191862.286813:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1784191862.286815:0:36:0:(import.c:65:import_set_state_nolock()) ffff8af23f2db000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784191862.286818:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 5477 00000100:00080000:2.0:1784191862.286820:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784191862.286823:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8af23f2db000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:3.0:1784191862.286832:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191862.286834:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af10d29dc00 x1870858827907712/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784191862.286863:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858827907584:0@lo:400:kworker.0 00000100:00100000:3.0:1784191862.286875:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:106498:1870858827907456:0@lo:38:kworker.0 00000100:00100000:3.0:1784191862.286897:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191862.286914:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858827907200:0@lo:400:kworker.0 00000100:00100000:2.0:1784191862.286938:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858827907328:0@lo:400:kworker.0 00000100:00100000:1.0:1784191862.286939:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827907072:0@lo:400:kworker.0 00000100:00100000:1.0:1784191862.287453:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191862.287510:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827907072 00000100:00100000:1.0:1784191862.287519:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827907072 00000100:00100000:2.0:1784191862.291786:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827906944 00000100:00100000:2.0:1784191862.291801:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827906944 00000100:00100000:2.0:1784191862.291875:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:2.0:1784191862.291884:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:106498:x1870858827906944:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1784191862.292396:0:158671:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (not set up) 00000100:00100000:3.0:1784191862.294601:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:106498:1870858827907712:0@lo:38:kworker.0 00000100:00100000:3.0:1784191862.294671:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.294726:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827907456 00000100:00100000:3.0:1784191862.294746:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827907456 00000100:00100000:3.0:1784191862.294789:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827907712 00000100:00100000:3.0:1784191862.294792:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827907712 00000100:00100000:3.0:1784191862.294810:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1784191862.294817:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:106498:x1870858827907456:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1784191862.294838:0:158665:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (not set up) 00000100:00100000:3.0:1784191862.294893:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:106498:x1870858827907456:12345-0@lo:38:kworker.0 Request processed in 75us (7994us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784191862.294900:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1784191862.294916:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1784191862.294919:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:106498:x1870858827907712:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1784191862.294927:0:158665:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (not set up) 00000100:00100000:3.0:1784191862.295169:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:106498:x1870858827907712:12345-0@lo:38:kworker.0 Request processed in 29us (280us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784191862.295178:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1784191862.295224:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.295268:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827907200 00000100:00100000:3.0:1784191862.295273:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827907200 00000100:00100000:3.0:1784191862.295307:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1784191862.295313:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858827907200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191862.295362:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858827907200:12345-0@lo:400:kworker.0 Request processed in 49us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.295368:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1784191862.295410:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858827907200:0@lo:400:kworker.0 00000100:00100000:3.0:1784191862.295442:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.295473:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827907584 00000100:00100000:3.0:1784191862.295477:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827907584 00000100:00100000:1.0:1784191862.295582:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1784191862.295592:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827907072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191862.295638:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827907072:12345-0@lo:400:kworker.0 Request processed in 49us (8672us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191862.295644:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1784191862.295678:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827907072:0@lo:400:kworker.0 00000100:00100000:3.0:1784191862.296754:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1784191862.296768:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858827907584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191862.296845:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858827907584:12345-0@lo:400:kworker.0 Request processed in 82us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.296852:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00080000:3.0:1784191862.297025:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784191862.297031:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784191862.297062:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858827907584:0@lo:400:kworker.0 00000100:00100000:3.0:1784191862.297094:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.297143:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827907328 00000100:00100000:3.0:1784191862.297150:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827907328 00000100:00100000:3.0:1784191862.297182:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1784191862.297188:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858827907328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191862.297227:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858827907328:12345-0@lo:400:kworker.0 Request processed in 38us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.297250:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00080000:3.0:1784191862.297270:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784191862.297287:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858827907328:0@lo:400:kworker.0 00000100:00080000:3.0:1784191862.297315:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23f2db000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784191862.297320:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784191862.297323:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:106498:1870858827907712:0@lo:38:kworker.0 00000100:00080000:3.0:1784191862.297343:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10c3ad800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784191862.297346:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784191862.297349:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:106498:1870858827907456:0@lo:38:kworker.0 00000100:00100000:3.0:1784191862.306085:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:106498:x1870858827906944:12345-0@lo:38:kworker.0 Request processed in 14190us (19241us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784191862.306101:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00080000:2.0:1784191862.307143:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10f422800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784191862.307152:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784191862.307157:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827906944:0@lo:38:kworker.0 00010000:00010000:3.0:1784191862.344199:0:165484:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-4 is initialized 00000001:00080000:3.0:1784191862.344992:0:165484:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 0 srv lr: 21474836525 lx: 0 gen 1 00000001:00080000:3.0:1784191862.345051:0:165484:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a idx: 1 lr: 0 srv lr: 21474836525 lx: 0 gen 4 00000001:00000004:3.0:1784191862.345076:0:165484:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 21474836525 00000001:00080000:3.0:1784191862.345796:0:165484:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1784191862.345862:0:165484:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff8af227a6a0c0: xid 1870858827835648, transno 21474836522, client gen 1, slot idx 0 00000001:00080000:3.0:1784191862.345874:0:165484:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff8af227a6aa80: xid 1870858812338304, transno 21474836535, client gen 4, slot idx 1 00000001:00080000:3.0:1784191862.345879:0:165484:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff8af227a6a540: xid 1870858812338944, transno 21474836536, client gen 4, slot idx 2 00000020:00000080:1.0:1784191862.347060:0:165484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1784191862.347074:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784191862.347080:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191862.347083:0:165484:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1784191862.347086:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784191862.347091:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191862.347093:0:165484:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1784191862.347096:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784191862.347101:0:165484:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.116@tcp to nid 0x20000c0a8cc74 (192.168.204.116@tcp) 00000020:00000080:1.0:1784191862.347141:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784191862.347155:0:165484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8af2236b4d40) 00000020:00000080:1.0:1784191862.347180:0:165484:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1784191862.347185:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784191862.347260:0:165484:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1784191862.347267:0:165484:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1784191862.347274:0:165484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfeec3c2dc5a4a98e 00010000:00080000:1.0:1784191862.347322:0:165484:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af1093a8800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.116@tcp at head 00010000:00010000:1.0:1784191862.348990:0:165484:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-9 is initialized 00000020:00000080:1.0:1784191862.353833:0:165484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784191862.353860:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1784191862.353912:0:165484:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784191862.353940:0:165484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeec3c2dc5a4a995 00000100:00080000:1.0:1784191862.353952:0:165484:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784191862.353960:0:165484:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8af1093a8800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191862.354099:0:165484:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af20cf26680 x1870858827907840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784191862.354137:0:165484:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1784191862.354201:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784191862.354206:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191862.354208:0:165484:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1784191862.354211:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784191862.354214:0:165484:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1784191862.354216:0:165484:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784191862.354217:0:165484:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784191862.354219:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784191862.354222:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191862.354223:0:165484:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784191862.354226:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784191862.354230:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191862.354231:0:165484:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1784191862.354236:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1784191862.354271:0:165484:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1784191862.354449:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858827907840:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784191862.354536:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191862.354607:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827907840 00000100:00100000:2.0:1784191862.354616:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827907840 00000100:00100000:2.0:1784191862.354653:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:2.0:1784191862.354660:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:106498:x1870858827907840:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1784191862.354708:0:159636:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 5482 last 0 00000020:00000080:2.0:1784191862.354747:0:159636:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeec3c2dc5a4a99c 00000004:00100000:2.0:1784191862.354762:0:159636:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784191862.354865:0:159636:0:(import.c:65:import_set_state_nolock()) ffff8af1017cb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784191862.354919:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106498:x1870858827907840:12345-0@lo:38:llog_process_th.0 Request processed in 256us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191862.354926:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:2.0:1784191862.354983:0:106498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784191862.354993:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 8 00000100:00080000:2.0:1784191862.355002:0:106498:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1784191862.355008:0:106498:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784191862.355010:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af1093a8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784191862.355018:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858827907840:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784191862.355121:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827907968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191862.355147:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191862.355185:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827907968 00000100:00100000:2.0:1784191862.355189:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827907968 00000100:00100000:2.0:1784191862.355227:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:2.0:1784191862.355235:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827907968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784191862.355264:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42549248 avail 36417536 00000100:00100000:2.0:1784191862.355312:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827907968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191862.355318:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:2.0:1784191862.355346:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827907968:0@lo:41:osp-pre-0-1.0 00000020:01000000:1.0:1784191862.356426:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784191862.356436:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191862.356438:0:165484:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1784191862.356442:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784191862.356444:0:165484:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1784191862.356446:0:165484:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784191862.356447:0:165484:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784191862.356449:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784191862.356451:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191862.356458:0:165484:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784191862.356461:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784191862.356466:0:165484:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1784191862.356469:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191862.356470:0:165484:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784191862.356473:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784191862.356477:0:165484:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.116@tcp to nid 0x20000c0a8cc74 (192.168.204.116@tcp) 00000020:01000000:1.0:1784191862.356502:0:165484:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1784191862.356505:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784191862.356523:0:165484:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8af2236b0000) 00000020:00000080:1.0:1784191862.356547:0:165484:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1784191862.356552:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784191862.356629:0:165484:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1784191862.356636:0:165484:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1784191862.356643:0:165484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfeec3c2dc5a4a9aa 00010000:00080000:1.0:1784191862.356674:0:165484:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af23f2d8800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.116@tcp at head 00010000:00010000:1.0:1784191862.356903:0:165484:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-10 is initialized 00000040:01000000:1.0:1784191862.361558:0:165484:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784191862.362541:0:165484:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1784191862.365803:0:165484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784191862.366139:0:165484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].6, 64 off8576 00000040:00080000:1.0:1784191862.367331:0:165484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].1, 64 off8256 00000040:00080000:3.0:1784191862.368784:0:165489:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1784191862.368790:0:165489:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x18:0x0] at index 6 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1784191862.369456:0:165484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784191862.369468:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784191862.369506:0:165484:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784191862.369526:0:165484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeec3c2dc5a4a9b1 00000100:00080000:1.0:1784191862.369538:0:165484:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784191862.369543:0:165484:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8af23f2d8800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191862.369579:0:165484:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af20cf25500 x1870858827908096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784191862.369611:0:165484:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1784191862.369670:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784191862.369674:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191862.369676:0:165484:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1784191862.369679:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784191862.369682:0:165484:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1784191862.369684:0:165484:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784191862.369685:0:165484:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784191862.369727:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784191862.369730:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191862.369732:0:165484:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784191862.369735:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784191862.369739:0:165484:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1784191862.369742:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191862.369744:0:165484:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1784191862.369747:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784191862.369751:0:165484:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.116@tcp to nid 0x20000c0a8cc74 (192.168.204.116@tcp) 00000020:01000000:1.0:1784191862.369778:0:165484:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1784191862.369781:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784191862.369806:0:165484:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8af10ca00000) 00000020:00000080:1.0:1784191862.369823:0:165484:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1784191862.369829:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784191862.369890:0:165484:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1784191862.369897:0:165484:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784191862.369903:0:165484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfeec3c2dc5a4a9bf 00010000:00080000:1.0:1784191862.369933:0:165484:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af22dcda000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.116@tcp at head 00010000:00010000:1.0:1784191862.370128:0:165484:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1784191862.370190:0:165484:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784191862.370205:0:165484:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1784191862.370587:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858827908096:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1784191862.370673:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191862.370833:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827908096 00000100:00100000:0.0:1784191862.370841:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827908096 00000100:00100000:0.0:1784191862.370884:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1784191862.370892:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:106498:x1870858827908096:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1784191862.370922:0:162392:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 5482 last 0 00000020:00000080:0.0:1784191862.370955:0:162392:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeec3c2dc5a4a9c6 00002000:00100000:0.0:1784191862.370968:0:162392:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8af101783000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1784191862.370972:0:162392:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1784191862.370976:0:162392:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784191862.371045:0:162392:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1784191862.371066:0:162392:0:(import.c:65:import_set_state_nolock()) ffff8af1086f5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784191862.371132:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+6:106498:x1870858827908096:12345-0@lo:8:llog_process_th.0 Request processed in 239us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191862.371139:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1784191862.371574:0:106498:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784191862.371584:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 5 00000100:00080000:1.0:1784191862.371591:0:106498:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784191862.371596:0:106498:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784191862.371606:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784191862.371658:0:106498:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784191862.371665:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858827908096:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1784191862.373734:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784191862.373753:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827908224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784191862.373829:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191862.374238:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827908224 00000100:00100000:2.0:1784191862.374247:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827908224 00000100:00080000:0.0:1784191862.374399:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784191862.374839:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784191862.374850:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827908224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784191862.374877:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8228544 pending 0 free 71049216 avail 63881216 00000100:00100000:2.0:1784191862.374932:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827908224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191862.374939:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784191862.375005:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827908224:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1784191862.376479:0:165489:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784191862.376538:0:165489:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 5482555848224ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784191862.376546:0:165489:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000040:00080000:1.0:1784191862.379131:0:165484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784191862.379494:0:165484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].6, 64 off8576 00000040:00080000:1.0:1784191862.379612:0:165484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].1, 64 off8256 00000004:00080000:3.0:1784191862.379782:0:165481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000040:00080000:1.0:1784191862.381164:0:165491:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1784191862.381170:0:165491:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 6 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1784191862.382170:0:165484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784191862.382183:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784191862.382227:0:165484:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784191862.382250:0:165484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeec3c2dc5a4a9cd 00000100:00080000:1.0:1784191862.382261:0:165484:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784191862.382268:0:165484:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8af22dcda000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191862.382444:0:165484:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af20cf25500 x1870858827908352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191862.382523:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858827908352:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1784191862.382604:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784191862.382683:0:165484:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1784191862.382769:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784191862.382774:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191862.382776:0:165484:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1784191862.382779:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784191862.382783:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191862.382785:0:165484:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784191862.382788:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784191862.382790:0:165484:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784191862.382792:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784191862.382794:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191862.382795:0:165484:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1784191862.382798:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784191862.382800:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191862.382813:0:165484:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784191862.382818:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1784191862.382851:0:165484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784191862.382854:0:165484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191862.382855:0:165484:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784191862.382859:0:165484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 46 count 46 00000020:01000000:1.0:1784191862.382935:0:165480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1784191862.382983:0:165480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1784191862.383001:0:165480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1019d5c00/0xfeec3c2dc5a4a93a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a941 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.383012:0:165480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af1019d5c00/0xfeec3c2dc5a4a93a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a941 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191862.383020:0:165480:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8af22dcd8000 from 1 10000000:01000000:1.0:1784191862.383023:0:165480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784191862.383051:0:165480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af233127800/0xfeec3c2dc5a4a9d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.383059:0:165480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af233127800/0xfeec3c2dc5a4a9d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.383069:0:165480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af233127800/0xfeec3c2dc5a4a9d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191862.383084:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827908480:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784191862.383128:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191862.383148:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1053eed80 going to sleep for 11 seconds 00000100:00100000:1.0:1784191862.383170:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827908480 00000100:00100000:1.0:1784191862.383178:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827908480 00000100:00100000:1.0:1784191862.383222:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1784191862.383237:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:165480:x1870858827908480:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784191862.383253:0:158660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191862.383266:0:158660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af233127e00/0xfeec3c2dc5a4a9db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a9d4 expref: -99 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191862.383483:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827908352 00000100:00100000:2.0:1784191862.383488:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827908352 00000100:00100000:2.0:1784191862.383516:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1784191862.383523:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:106498:x1870858827908352:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1784191862.383552:0:161232:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 5482 last 0 00000020:00000080:2.0:1784191862.383600:0:161232:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfeec3c2dc5a4a9e2 00002000:00100000:2.0:1784191862.383615:0:161232:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8af1017ca000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1784191862.383619:0:161232:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1784191862.383622:0:161232:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784191862.383719:0:161232:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1784191862.383743:0:161232:0:(import.c:65:import_set_state_nolock()) ffff8af1017c8000 : changing import state from RECOVER to FULL 00010000:00010000:1.0:1784191862.383831:0:158660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af233127e00/0xfeec3c2dc5a4a9db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a9d4 expref: 22 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.383844:0:158660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af233127e00/0xfeec3c2dc5a4a9db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a9d4 expref: 22 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.383854:0:158660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233127e00, rc 0) 00000100:00100000:1.0:1784191862.383888:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:165480:x1870858827908480:12345-0@lo:101:mount.lustre.0 Request processed in 652us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191862.383895:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1784191862.383951:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827908480:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784191862.383967:0:165480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af233127800/0xfeec3c2dc5a4a9d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a9db expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.383977:0:165480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af233127800/0xfeec3c2dc5a4a9d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a9db expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191862.384680:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827908608:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784191862.384753:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191862.384784:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10487c300 going to sleep for 11 seconds 00000100:00100000:2.0:1784191862.385484:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:106498:x1870858827908352:12345-0@lo:8:llog_process_th.0 Request processed in 1958us (2877us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191862.385497:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1784191862.385579:0:106498:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784191862.385588:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 4 00000100:00080000:3.0:1784191862.385596:0:106498:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784191862.385601:0:106498:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1784191862.385605:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af22dcda000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784191862.385672:0:106498:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784191862.385680:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858827908352:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1784191862.385728:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827908608 00000100:00100000:3.0:1784191862.385733:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827908608 00000100:00100000:3.0:1784191862.385827:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1784191862.385836:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af11066ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:165480:x1870858827908608:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1784191862.385858:0:158658:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784191862.385895:0:158658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784191862.385899:0:158658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784191862.385903:0:158658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784191862.385907:0:158658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1784191862.385909:0:158658:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 36 00000100:00100000:3.0:1784191862.386158:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af11066ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:165480:x1870858827908608:12345-0@lo:256:mount.lustre.0 Request processed in 323us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.386165:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000004:00080000:1.0:1784191862.386241:0:165491:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784191862.386328:0:165491:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 5482565638458ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784191862.386334:0:165491:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1784191862.386574:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827908736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191862.386611:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191862.386684:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827908736 00000100:00100000:0.0:1784191862.386707:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827908736 00000100:00100000:0.0:1784191862.386750:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784191862.386758:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827908736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784191862.386776:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8249024 pending 0 free 71184384 avail 64016384 00000100:00100000:0.0:1784191862.386817:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858827908736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191862.386823:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784191862.386877:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827908736:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784191862.386950:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784191862.387268:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827908608:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1784191862.388895:0:165480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784191862.388919:0:165480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af233127800/0xfeec3c2dc5a4a9d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a9db expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191862.388942:0:165480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af233127800/0xfeec3c2dc5a4a9d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a9db expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784191862.388951:0:165480:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af22dcd8000 from 1 10000000:01000000:0.0:1784191862.388953:0:165480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784191862.389506:0:165480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10de3f200/0xfeec3c2dc5a4a9e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191862.389516:0:165480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af10de3f200/0xfeec3c2dc5a4a9e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191862.389526:0:165480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af10de3f200/0xfeec3c2dc5a4a9e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191862.389547:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827908864:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784191862.389606:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191862.389678:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10673f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191862.389863:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827908864 00000100:00100000:3.0:1784191862.389871:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827908864 00000100:00100000:3.0:1784191862.389923:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1784191862.389933:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:165480:x1870858827908864:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784191862.389948:0:158658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191862.389961:0:158658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af110db2000/0xfeec3c2dc5a4a9f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a9e9 expref: -99 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.389994:0:158658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af110db2000/0xfeec3c2dc5a4a9f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a9e9 expref: 23 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.390005:0:158658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af110db2000/0xfeec3c2dc5a4a9f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a9e9 expref: 23 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.390014:0:158658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db2000, rc 0) 00000100:00100000:3.0:1784191862.390060:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:165480:x1870858827908864:12345-0@lo:101:mount.lustre.0 Request processed in 129us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.390067:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1784191862.390121:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827908864:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784191862.390134:0:165480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af10de3f200/0xfeec3c2dc5a4a9e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a9f0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.390144:0:165480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af10de3f200/0xfeec3c2dc5a4a9e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a9f0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784191862.391263:0:165480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 7 count 7 00000040:00080000:3.0:1784191862.391681:0:165480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784191862.391873:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:3.0:1784191862.391899:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 112 off8528 00000040:00080000:3.0:1784191862.391925:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 224 off8752 00000040:00080000:3.0:1784191862.391940:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8976 00000040:00080000:3.0:1784191862.391956:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 112 off9088 00000040:00080000:2.0:1784191862.392742:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 224 off9312 00000040:00080000:2.0:1784191862.392754:0:165480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 6 count 7 00000100:00100000:2.0:1784191862.392840:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827908992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784191862.392905:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191862.392951:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107aff9c0 going to sleep for 11 seconds 00000004:00080000:1.0:1784191862.393152:0:165481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1784191862.393241:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827908992 00000100:00100000:3.0:1784191862.393248:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827908992 00000100:00100000:3.0:1784191862.393381:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1784191862.393390:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:165480:x1870858827908992:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784191862.393522:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:165480:x1870858827908992:12345-0@lo:501:mount.lustre.0 Request processed in 133us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.393530:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1784191862.393595:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827908992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784191862.393627:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827909120:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784191862.393667:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191862.393915:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10487c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191862.393974:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827909120 00000100:00100000:2.0:1784191862.393979:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827909120 00000100:00100000:2.0:1784191862.394003:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1784191862.394009:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:165480:x1870858827909120:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784191862.394137:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:165480:x1870858827909120:12345-0@lo:503:mount.lustre.0 Request processed in 126us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191862.394144:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1784191862.394275:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827909120:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784191862.394965:0:165480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784191862.395046:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827909248:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784191862.395100:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191862.395183:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10487c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191862.395228:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827909248 00000100:00100000:2.0:1784191862.395235:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827909248 00000100:00100000:2.0:1784191862.395468:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1784191862.395478:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af11066b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:165480:x1870858827909248:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784191862.395607:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af11066b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:165480:x1870858827909248:12345-0@lo:502:mount.lustre.0 Request processed in 130us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191862.395623:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1784191862.395731:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827909248:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784191862.395936:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:1.0:1784191862.395965:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 112 off8528 00000040:00080000:1.0:1784191862.395983:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 224 off8752 00000040:00080000:1.0:1784191862.395997:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8976 00000040:00080000:1.0:1784191862.396012:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 112 off9088 00000100:00100000:1.0:1784191862.396040:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827909376:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784191862.396082:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191862.396623:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10487c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191862.396756:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827909376 00000100:00100000:3.0:1784191862.396762:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827909376 00000100:00100000:3.0:1784191862.396793:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1784191862.396802:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:165480:x1870858827909376:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784191862.396947:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:165480:x1870858827909376:12345-0@lo:502:mount.lustre.0 Request processed in 145us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.396954:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1784191862.397148:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827909376:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784191862.397203:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 224 off9312 00000040:00080000:1.0:1784191862.397212:0:165480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:3.0:1784191862.398136:0:165493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784191862.398146:0:165493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784191862.398148:0:165493:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784191862.398156:0:165493:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8af22dcd8000 00000020:00000080:3.0:1784191862.398158:0:165493:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784191862.398166:0:165493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784191862.398169:0:165493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784191862.398170:0:165493:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784191862.398172:0:165493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784191862.398174:0:165493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784191862.398176:0:165493:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784191862.398179:0:165493:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8af22dcd8000 00000020:00000080:3.0:1784191862.398181:0:165493:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784191862.398285:0:165493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784191862.398289:0:165493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784191862.398290:0:165493:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784191862.398293:0:165493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 7 count 7 00000020:01000000:2.0:1784191862.398519:0:165480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1784191862.398545:0:165480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784191862.398568:0:165480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10de3f200/0xfeec3c2dc5a4a9e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a9f0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.398579:0:165480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af10de3f200/0xfeec3c2dc5a4a9e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a9f0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784191862.398626:0:165480:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784191862.398629:0:165480:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8af22dcd8000 10000000:01000000:2.0:1784191862.398632:0:165480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8af22dcd8000 10000000:01000000:2.0:1784191862.398635:0:165480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784191862.398641:0:165480:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8af22dcd8000 from 1 10000000:01000000:2.0:1784191862.398644:0:165480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784191862.398673:0:165480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1019d4000/0xfeec3c2dc5a4a9f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.398681:0:165480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af1019d4000/0xfeec3c2dc5a4a9f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.398713:0:165480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af1019d4000/0xfeec3c2dc5a4a9f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191862.398734:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827909504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784191862.398788:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191862.398831:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af202d61f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191862.398885:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827909504 00000100:00100000:0.0:1784191862.398891:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827909504 00000100:00100000:0.0:1784191862.398932:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1784191862.398940:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af11066b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:165480:x1870858827909504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784191862.398952:0:158658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191862.398964:0:158658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af10de3f800/0xfeec3c2dc5a4a9fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4a9f7 expref: -99 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191862.398984:0:158658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af10de3f800/0xfeec3c2dc5a4a9fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a9f7 expref: 24 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191862.399006:0:158658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af10de3f800/0xfeec3c2dc5a4a9fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a9f7 expref: 24 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191862.399015:0:158658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3f800, rc 0) 00000100:00100000:0.0:1784191862.399051:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af11066b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:165480:x1870858827909504:12345-0@lo:101:mount.lustre.0 Request processed in 112us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191862.399056:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1784191862.399209:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827909504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784191862.399231:0:165480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af1019d4000/0xfeec3c2dc5a4a9f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a9fe expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.399239:0:165480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af1019d4000/0xfeec3c2dc5a4a9f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4a9fe expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784191862.400847:0:165480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 52 count 51 00000040:00080000:2.0:1784191862.401136:0:165480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784191862.401579:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].1, 224 off8416 00000040:00080000:2.0:1784191862.401604:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].2, 120 off8536 00000040:00080000:2.0:1784191862.401615:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].3, 168 off8704 00000040:00080000:2.0:1784191862.401624:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].4, 224 off8928 00000040:00080000:2.0:1784191862.401634:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].5, 224 off9152 00000040:00080000:2.0:1784191862.401643:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].6, 120 off9272 00000040:00080000:2.0:1784191862.401652:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].7, 168 off9440 00000040:00080000:2.0:1784191862.401661:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].8, 224 off9664 00000040:00080000:2.0:1784191862.401671:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].9, 224 off9888 00000040:00080000:2.0:1784191862.401685:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].10, 120 off10008 00000040:00080000:2.0:1784191862.401730:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].11, 224 off10232 00000040:00080000:2.0:1784191862.401745:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].12, 224 off10456 00000040:00080000:2.0:1784191862.401757:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].13, 88 off10544 00000040:00080000:2.0:1784191862.401769:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].14, 128 off10672 00000040:00080000:2.0:1784191862.401782:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].15, 144 off10816 00000040:00080000:2.0:1784191862.401796:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].16, 160 off10976 00000040:00080000:2.0:1784191862.401808:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].17, 224 off11200 00000040:00080000:2.0:1784191862.401822:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].18, 224 off11424 00000040:00080000:2.0:1784191862.401835:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].19, 80 off11504 00000040:00080000:2.0:1784191862.401846:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].20, 224 off11728 00000040:00080000:2.0:1784191862.401859:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].21, 224 off11952 00000040:00080000:2.0:1784191862.401872:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].22, 88 off12040 00000040:00080000:2.0:1784191862.401883:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].23, 128 off12168 00000040:00080000:2.0:1784191862.401912:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].24, 144 off12312 00000040:00080000:2.0:1784191862.401926:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].25, 160 off12472 00000040:00080000:2.0:1784191862.401940:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].26, 224 off12696 00000040:00080000:2.0:1784191862.401952:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].27, 224 off12920 00000040:00080000:2.0:1784191862.401964:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].28, 80 off13000 00000040:00080000:2.0:1784191862.401976:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].29, 224 off13224 00000040:00080000:2.0:1784191862.401988:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].30, 224 off13448 00000040:00080000:2.0:1784191862.402003:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].31, 88 off13536 00000040:00080000:2.0:1784191862.402017:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].32, 128 off13664 00000040:00080000:2.0:1784191862.402031:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].33, 144 off13808 00000040:00080000:2.0:1784191862.402046:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].34, 128 off13936 00000040:00080000:2.0:1784191862.402061:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].35, 224 off14160 00000040:00080000:2.0:1784191862.402073:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].36, 224 off14384 00000040:00080000:2.0:1784191862.402087:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].37, 80 off14464 00000040:00080000:2.0:1784191862.402101:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].38, 224 off14688 00000040:00080000:2.0:1784191862.402128:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].39, 224 off14912 00000040:00080000:2.0:1784191862.402142:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].40, 88 off15000 00000040:00080000:2.0:1784191862.402155:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].41, 128 off15128 00000040:00080000:2.0:1784191862.402167:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].42, 144 off15272 00000040:00080000:2.0:1784191862.402180:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].43, 128 off15400 00000040:00080000:2.0:1784191862.402192:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].44, 224 off15624 00000040:00080000:2.0:1784191862.402204:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].45, 224 off15848 00000040:00080000:2.0:1784191862.402216:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].46, 80 off15928 00000040:00080000:2.0:1784191862.402231:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].47, 224 off16152 00000040:00080000:2.0:1784191862.402245:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].48, 232 off16384 00000040:00080000:2.0:1784191862.402533:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].49, 224 off16608 00000040:00080000:2.0:1784191862.402553:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].50, 120 off16728 00000040:00080000:2.0:1784191862.402570:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].51, 224 off16952 00000040:00080000:2.0:1784191862.402575:0:165480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 51 count 51 00000100:00100000:2.0:1784191862.402674:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827909632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784191862.402772:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191862.402813:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6a900 going to sleep for 11 seconds 00000100:00100000:1.0:1784191862.403009:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827909632 00000100:00100000:1.0:1784191862.403018:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827909632 00000100:00100000:1.0:1784191862.403070:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1784191862.403079:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:165480:x1870858827909632:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784191862.403217:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:165480:x1870858827909632:12345-0@lo:501:mount.lustre.0 Request processed in 139us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191862.403226:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1784191862.403342:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827909632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784191862.403460:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827909760:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784191862.403504:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191862.403568:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6a900 going to sleep for 11 seconds 00000100:00100000:1.0:1784191862.405827:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827909760 00000100:00100000:1.0:1784191862.405841:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827909760 00000100:00100000:1.0:1784191862.406474:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1784191862.406487:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:165480:x1870858827909760:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784191862.406671:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:165480:x1870858827909760:12345-0@lo:503:mount.lustre.0 Request processed in 186us (3166us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191862.406679:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1784191862.409668:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827909760:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784191862.410256:0:165480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784191862.410507:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827909888:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784191862.410585:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191862.410907:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2278f9840 going to sleep for 11 seconds 00000100:00100000:2.0:1784191862.410975:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827909888 00000100:00100000:2.0:1784191862.410982:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827909888 00000100:00100000:2.0:1784191862.411026:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1784191862.411035:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af11066bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:165480:x1870858827909888:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784191862.413432:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af11066bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:165480:x1870858827909888:12345-0@lo:502:mount.lustre.0 Request processed in 2388us (2836us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191862.413448:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1784191862.418462:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827909888:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784191862.418823:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].1, 224 off8416 00000040:00080000:0.0:1784191862.418859:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].2, 120 off8536 00000040:00080000:0.0:1784191862.418875:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].3, 168 off8704 00000040:00080000:0.0:1784191862.418885:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].4, 224 off8928 00000040:00080000:0.0:1784191862.418897:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].5, 224 off9152 00000040:00080000:0.0:1784191862.418910:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].6, 120 off9272 00000040:00080000:0.0:1784191862.418925:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].7, 168 off9440 00000040:00080000:0.0:1784191862.418936:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].8, 224 off9664 00000040:00080000:0.0:1784191862.418947:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].9, 224 off9888 00000040:00080000:0.0:1784191862.418957:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].10, 120 off10008 00000040:00080000:0.0:1784191862.418967:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].11, 224 off10232 00000040:00080000:0.0:1784191862.418981:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].12, 224 off10456 00000040:00080000:0.0:1784191862.418995:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].13, 88 off10544 00000040:00080000:0.0:1784191862.419009:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].14, 128 off10672 00000040:00080000:0.0:1784191862.419034:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].15, 144 off10816 00000040:00080000:0.0:1784191862.419047:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].16, 160 off10976 00000040:00080000:0.0:1784191862.419059:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].17, 224 off11200 00000040:00080000:0.0:1784191862.419068:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].18, 224 off11424 00000040:00080000:0.0:1784191862.419077:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].19, 80 off11504 00000040:00080000:0.0:1784191862.419086:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].20, 224 off11728 00000040:00080000:0.0:1784191862.419096:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].21, 224 off11952 00000040:00080000:0.0:1784191862.419117:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].22, 88 off12040 00000040:00080000:0.0:1784191862.419132:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].23, 128 off12168 00000040:00080000:0.0:1784191862.419144:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].24, 144 off12312 00000040:00080000:0.0:1784191862.419153:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].25, 160 off12472 00000040:00080000:0.0:1784191862.419163:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].26, 224 off12696 00000040:00080000:0.0:1784191862.419175:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].27, 224 off12920 00000040:00080000:0.0:1784191862.419187:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].28, 80 off13000 00000040:00080000:0.0:1784191862.419197:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].29, 224 off13224 00000040:00080000:0.0:1784191862.419206:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].30, 224 off13448 00000040:00080000:0.0:1784191862.419216:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].31, 88 off13536 00000040:00080000:0.0:1784191862.419225:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].32, 128 off13664 00000040:00080000:0.0:1784191862.419236:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].33, 144 off13808 00000040:00080000:0.0:1784191862.419246:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].34, 128 off13936 00000040:00080000:0.0:1784191862.419256:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].35, 224 off14160 00000040:00080000:0.0:1784191862.419265:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].36, 224 off14384 00000040:00080000:0.0:1784191862.419274:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].37, 80 off14464 00000040:00080000:0.0:1784191862.419301:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].38, 224 off14688 00000040:00080000:0.0:1784191862.419315:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].39, 224 off14912 00000040:00080000:0.0:1784191862.419326:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].40, 88 off15000 00000040:00080000:0.0:1784191862.419341:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].41, 128 off15128 00000040:00080000:0.0:1784191862.419355:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].42, 144 off15272 00000040:00080000:0.0:1784191862.419368:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].43, 128 off15400 00000040:00080000:0.0:1784191862.419382:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].44, 224 off15624 00000040:00080000:0.0:1784191862.419397:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].45, 224 off15848 00000040:00080000:0.0:1784191862.419409:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].46, 80 off15928 00000040:00080000:0.0:1784191862.419422:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].47, 224 off16152 00000040:00080000:0.0:1784191862.419446:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].48, 232 off16384 00000100:00100000:0.0:1784191862.419503:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827910016:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784191862.419588:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191862.419638:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2278f9840 going to sleep for 11 seconds 00000100:00100000:1.0:1784191862.419906:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827910016 00000100:00100000:1.0:1784191862.419913:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827910016 00000100:00100000:1.0:1784191862.419961:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1784191862.419971:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af11066a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:165480:x1870858827910016:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784191862.420103:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af11066a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:165480:x1870858827910016:12345-0@lo:502:mount.lustre.0 Request processed in 133us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191862.420122:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1784191862.420811:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827910016:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784191862.421014:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].49, 224 off16608 00000040:00080000:0.0:1784191862.421043:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].50, 120 off16728 00000100:00100000:0.0:1784191862.421078:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827910144:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784191862.421146:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191862.421177:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2278f9840 going to sleep for 11 seconds 00000100:00100000:3.0:1784191862.421246:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827910144 00000100:00100000:3.0:1784191862.421252:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827910144 00000100:00100000:3.0:1784191862.421343:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1784191862.421352:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:165480:x1870858827910144:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784191862.421469:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:165480:x1870858827910144:12345-0@lo:502:mount.lustre.0 Request processed in 118us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.421476:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1784191862.422207:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827910144:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784191862.422437:0:165480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].51, 224 off16952 00000040:00080000:0.0:1784191862.422452:0:165480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1784191862.428458:0:165496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1784191862.428480:0:165496:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8af105a7cd40) 00000020:00000080:3.0:1784191862.428510:0:165496:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1784191862.429037:0:165496:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af22dcd8000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1784191862.429042:0:165496:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af22dcd8000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1784191862.429044:0:165496:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af22dcd8000 3 00010000:00080000:3.0:1784191862.429074:0:165496:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af23ea15000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.116@tcp at head 00010000:00010000:3.0:1784191862.430590:0:165496:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-12 is initialized 00000020:00000080:3.0:1784191862.435359:0:165496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1784191862.435439:0:165496:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784191862.435459:0:165496:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xfeec3c2dc5a4aa0c 00000100:00080000:3.0:1784191862.435471:0:165496:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784191862.435477:0:165496:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8af23ea15000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:3.0:1784191862.435523:0:165496:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af10f4edf80 x1870858827910272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784191862.435599:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:106498:1870858827910272:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784191862.435677:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784191862.438392:0:165496:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784191862.439460:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827910272 00000100:00100000:1.0:1784191862.439475:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827910272 00000100:00100000:1.0:1784191862.439528:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1784191862.439537:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:106498:x1870858827910272:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1784191862.439577:0:158665:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 5482 last 0 00000020:00000080:1.0:1784191862.439625:0:158665:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xfeec3c2dc5a4aa13 00000004:00100000:1.0:1784191862.439644:0:158665:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784191862.439682:0:158665:0:(import.c:65:import_set_state_nolock()) ffff8af1086f2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784191862.439802:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106498:x1870858827910272:12345-0@lo:38:llog_process_th.0 Request processed in 264us (4124us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191862.439811:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1784191862.439857:0:106498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784191862.439866:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 8 00000100:00080000:1.0:1784191862.439873:0:106498:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1784191862.439878:0:106498:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784191862.439880:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23ea15000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784191862.439886:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:106498:1870858827910272:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1784191862.446350:0:165496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 52 count 51 00000020:01000000:0.0:1784191862.446834:0:165480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1784191862.446875:0:165480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784191862.446994:0:165480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1019d4000/0xfeec3c2dc5a4a9f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a9fe expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191862.447009:0:165480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af1019d4000/0xfeec3c2dc5a4a9f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4a9fe expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784191862.447075:0:165480:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784191862.447078:0:165480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784191862.447079:0:165480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784191862.447080:0:165480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784191862.447082:0:165480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784191862.447083:0:165480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784191862.447085:0:165480:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784191862.447087:0:165480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784191862.447088:0:165480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784191862.447098:0:165480:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1784191862.447100:0:165480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784191862.447102:0:165480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784191862.447102:0:165480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784191862.447103:0:165480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784191862.447104:0:165480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784191862.447105:0:165480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784191862.447115:0:165480:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784191862.447116:0:165480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784191862.447117:0:165480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784191862.447148:0:165480:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1784191862.447175:0:165480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827910400:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784191862.447248:0:165480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191862.447288:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827910400 00000100:00100000:0.0:1784191862.447295:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827910400 00000100:00100000:0.0:1784191862.447344:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1784191862.447352:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af11066a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:165480:x1870858827910400:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784191862.447382:0:158659:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1784191862.447396:0:158659:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1784191862.447559:0:165480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107aff180 going to sleep for 11 seconds 00000001:00100000:3.0:1784191862.451152:0:158645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1784191862.451236:0:158659:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784191862.451247:0:158659:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1784191862.451548:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af11066a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:165480:x1870858827910400:12345-0@lo:253:mount.lustre.0 Request processed in 4190us (4294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191862.451561:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 20000000:01000000:2.0:1784191862.451656:0:158681:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784191862.451661:0:158681:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784191862.451682:0:158681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8af1019d4c00/0xfeec3c2dc5a4aa1a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 158681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.451722:0:158681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af10e24be00/0xfeec3c2dc5a478f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a478e9 expref: 23 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.451733:0:158681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af10b5e5e00/0xfeec3c2dc5a4a54a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5f2 expref: 9 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.451740:0:158681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af233127e00/0xfeec3c2dc5a4a9db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a9d4 expref: 23 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.451748:0:158681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8af1019d4c00/0xfeec3c2dc5a4aa1a lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 158681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.451786:0:158681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af233127e00/0xfeec3c2dc5a4a9db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeec3c2dc5a4a9d4 expref: 23 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.451809:0:158681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af233127e00/0xfeec3c2dc5a4a9db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeec3c2dc5a4a9d4 expref: 23 pid: 158660 timeout: 5582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191862.451823:0:158681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:158681:1870858827910528:0@lo:104: 00000100:00100000:2.0:1784191862.451865:0:158681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784191862.451910:0:158681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af10b5e5e00/0xfeec3c2dc5a4a54a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5f2 expref: 9 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.451919:0:158681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af10b5e5e00/0xfeec3c2dc5a4a54a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5f2 expref: 9 pid: 158658 timeout: 5582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191862.451928:0:158681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:158681:1870858827910656:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191862.453745:0:158681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af10e24be00/0xfeec3c2dc5a478f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeec3c2dc5a478e9 expref: 23 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.453762:0:158681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af10e24be00/0xfeec3c2dc5a478f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeec3c2dc5a478e9 expref: 23 pid: 158659 timeout: 5582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191862.453776:0:158681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:158681:1870858827910784:0@lo:104: 00000100:00100000:2.0:1784191862.453828:0:158681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191862.453852:0:158681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1784191862.453977:0:165480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:165480:1870858827910400:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784191862.453992:0:165480:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1784191862.453996:0:165480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784191862.453998:0:165480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784191862.454000:0:165480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784191862.454001:0:165480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784191862.454003:0:165480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784191862.454004:0:165480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784191862.454005:0:165480:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784191862.454007:0:165480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784191862.454008:0:165480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784191862.454024:0:165480:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1784191862.454829:0:158649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827910528 00000100:00100000:1.0:1784191862.454837:0:158649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827910528 00000100:00100000:1.0:1784191862.454867:0:158649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827910784 00000100:00100000:1.0:1784191862.454870:0:158649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827910784 00000100:00100000:1.0:1784191862.454883:0:158649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784191862.454890:0:158649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+4:158681:x1870858827910528:12345-0@lo:104: 00010000:00010000:1.0:1784191862.454905:0:158649:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.116@tcp lock: ffff8af233127800/0xfeec3c2dc5a4a9d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeec3c2dc5a4a9db expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.455004:0:158649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784191862.455010:0:158649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+4:158681:x1870858827910528:12345-0@lo:104: Request processed in 121us (3145us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191862.455017:0:158649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784191862.455034:0:158649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784191862.455039:0:158649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+3:158681:x1870858827910784:12345-0@lo:104: 00010000:00010000:1.0:1784191862.455046:0:158649:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.116@tcp lock: ffff8af10e24a200/0xfeec3c2dc5a478e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeec3c2dc5a478f0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.455072:0:158649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784191862.455077:0:158649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+3:158681:x1870858827910784:12345-0@lo:104: Request processed in 38us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191862.455082:0:158649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1784191862.455097:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784191862.455102:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.116@tcp lock: ffff8af233127800/0xfeec3c2dc5a4a9d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeec3c2dc5a4a9db expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.455122:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127800 already unused, calling callback (ffffffffc1384c20) 10000000:00010000:1.0:1784191862.455126:0:160901:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.116@tcp lock: ffff8af233127800/0xfeec3c2dc5a4a9d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeec3c2dc5a4a9db expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.455135:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af233127800/0xfeec3c2dc5a4a9d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeec3c2dc5a4a9db expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191862.455143:0:160901:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af233127800/0xfeec3c2dc5a4a9d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeec3c2dc5a4a9db expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191862.455149:0:160901:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784191862.455183:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.116@tcp lock: ffff8af233127800/0xfeec3c2dc5a4a9d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeec3c2dc5a4a9db expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.455190:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191862.455207:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.116@tcp lock: ffff8af233127800/0xfeec3c2dc5a4a9d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeec3c2dc5a4a9db expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.455214:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af233127800/0xfeec3c2dc5a4a9d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeec3c2dc5a4a9db expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.455227:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191862.455230:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.116@tcp lock: ffff8af10e24a200/0xfeec3c2dc5a478e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeec3c2dc5a478f0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.455235:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10e24a200 already unused, calling callback (ffffffffc1384c20) 10000000:00010000:1.0:1784191862.455238:0:160901:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.116@tcp lock: ffff8af10e24a200/0xfeec3c2dc5a478e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeec3c2dc5a478f0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.455244:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af10e24a200/0xfeec3c2dc5a478e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeec3c2dc5a478f0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191862.455250:0:160901:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af10e24a200/0xfeec3c2dc5a478e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeec3c2dc5a478f0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191862.455255:0:160901:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784191862.455264:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.116@tcp lock: ffff8af10e24a200/0xfeec3c2dc5a478e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeec3c2dc5a478f0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.455269:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191862.455279:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.116@tcp lock: ffff8af10e24a200/0xfeec3c2dc5a478e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeec3c2dc5a478f0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.455294:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af10e24a200/0xfeec3c2dc5a478e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeec3c2dc5a478f0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.455306:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191862.455307:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191862.455309:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191862.456540:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827911040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784191862.456598:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784191862.456860:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191862.456901:0:158681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:158681:1870858827910528:0@lo:104: 00000100:00100000:3.0:1784191862.456912:0:158681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:158681:1870858827910784:0@lo:104: 00000100:00100000:0.0:1784191862.457589:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827910912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191862.457634:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191862.457739:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827911040 00000100:00100000:1.0:1784191862.457747:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827911040 00010000:00010000:1.0:1784191862.457782:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af10e24be00/0xfeec3c2dc5a478f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeec3c2dc5a478e9 expref: 24 pid: 158659 timeout: 5582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191862.457819:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827910912 00000100:00100000:1.0:1784191862.457823:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827910912 00010000:00010000:1.0:1784191862.457836:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af233127e00/0xfeec3c2dc5a4a9db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeec3c2dc5a4a9d4 expref: 25 pid: 158660 timeout: 5582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191862.457853:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784191862.457861:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+25:106501:x1870858827911040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191862.457876:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191862.457881:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af10e24be00/0xfeec3c2dc5a478f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeec3c2dc5a478e9 expref: 25 pid: 158659 timeout: 5582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.457891:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af10e24be00/0xfeec3c2dc5a478f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeec3c2dc5a478e9 expref: 25 pid: 158659 timeout: 5582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.457913:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af10e24be00/0xfeec3c2dc5a478f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeec3c2dc5a478e9 expref: 25 pid: 158659 timeout: 5582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.457927:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191862.458163:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784191862.458172:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106500:x1870858827910912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784191862.458180:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191862.458185:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af233127e00/0xfeec3c2dc5a4a9db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeec3c2dc5a4a9d4 expref: 24 pid: 158660 timeout: 5582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.458204:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af233127e00/0xfeec3c2dc5a4a9db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeec3c2dc5a4a9d4 expref: 24 pid: 158660 timeout: 5582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.458215:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af233127e00/0xfeec3c2dc5a4a9db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeec3c2dc5a4a9d4 expref: 24 pid: 158660 timeout: 5582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.458224:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191862.468565:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191862.468612:0:158651:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1784191862.468641:0:158651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:3.0:1784191862.470300:0:158681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:158681:1870858827910656:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191862.470343:0:158681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8af1019d4c00/0xfeec3c2dc5a4aa1a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 158681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191862.470546:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:106500:x1870858827910912:12345-0@lo:103:ldlm_bl.0 Request processed in 12373us (12909us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.470559:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784191862.470610:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827910912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191862.470636:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812340608 00000100:00100000:3.0:1784191862.470645:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812340608 00010000:00010000:3.0:1784191862.470683:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af10b5e5e00/0xfeec3c2dc5a4a54a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5f2 expref: 10 pid: 158658 timeout: 5582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191862.472509:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:106501:x1870858827911040:12345-0@lo:103:ldlm_bl.0 Request processed in 14639us (15901us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191862.472523:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784191862.474222:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 100 00000100:00100000:3.0:1784191862.474247:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812340608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191862.474270:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191862.474292:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af10b5e5e00/0xfeec3c2dc5a4a54a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5f2 expref: 10 pid: 158658 timeout: 5582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.474311:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af10b5e5e00/0xfeec3c2dc5a4a54a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5f2 expref: 10 pid: 158658 timeout: 5582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.474332:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af10b5e5e00/0xfeec3c2dc5a4a54a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5f2 expref: 10 pid: 158658 timeout: 5582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.474351:0:158652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8af1019d4c00/0xfeec3c2dc5a4aa1a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 158681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.474378:0:158652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af1019d4c00/0xfeec3c2dc5a4aa1a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 158681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784191862.474397:0:158652:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.022736132s 00010000:00010000:3.0:1784191862.474402:0:158652:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af1019d4c00/0xfeec3c2dc5a4aa1a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 158681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.474410:0:158652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af1019d4c00/0xfeec3c2dc5a4aa1a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 158681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.474417:0:158652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8af1019d4c00/0xfeec3c2dc5a4aa1a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 158681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.474425:0:158652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8af1019d4c00/0xfeec3c2dc5a4aa1a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 158681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.474431:0:158652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4c00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.474435:0:158652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8af1019d4c00/0xfeec3c2dc5a4aa1a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 158681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.474443:0:158652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8af1019d4c00/0xfeec3c2dc5a4aa1a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 158681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.474460:0:158652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8af1019d4c00/0xfeec3c2dc5a4aa1a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.474471:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784191862.474494:0:158681:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8af1019d4c00/0xfeec3c2dc5a4aa1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.474502:0:158681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8af1019d4c00/0xfeec3c2dc5a4aa1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.474515:0:158681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af1019d4c00/0xfeec3c2dc5a4aa1a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191862.474587:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+9:69109:x1870858812340608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 352us (6036us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.474595:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 100 00000100:00100000:0.0:1784191862.477250:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827911040:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1784191862.479542:0:165480:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0001: committed batchid 17179869212 00000040:01000000:0.0:1784191862.480137:0:165480:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1784191862.480178:0:165502:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 17179869212 00000020:00080000:2.0:1784191862.480183:0:165502:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179869212 00000040:01000000:3.0:1784191862.480471:0:165503:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784191862.481240:0:165480:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1784191862.481945:0:165504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ec000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827911168:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.482047:0:165504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.482094:0:165504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23b0039c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191862.482161:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827911168 00000100:00100000:2.0:1784191862.482171:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827911168 00000040:01000000:0.0:1784191862.482215:0:165480:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:2.0:1784191862.482235:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:2.0:1784191862.482245:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827911168:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1784191862.482316:0:165480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784191862.482334:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827911168:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 90us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191862.482347:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:1.0:1784191862.482634:0:165504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ec000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827911168:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1784191862.482666:0:165504:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1784191862.482928:0:165504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827911296:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784191862.482982:0:165504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191862.483000:0:165504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23b0039c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191862.483160:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827911296 00000100:00100000:3.0:1784191862.483165:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827911296 00000100:00100000:3.0:1784191862.483193:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1784191862.483199:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827911296:12345-0@lo:1000:lod0001_rec0000.0 00000004:00000080:0.0:1784191862.483201:0:165480:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1784191862.483228:0:165480:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1784191862.483274:0:165480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784191862.483307:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827911296:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 107us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.483315:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1784191862.483344:0:165504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827911296:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.483411:0:165504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4edc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:165504:1870858827911424:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.483439:0:165504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.483464:0:158676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827911424 00000100:00100000:3.0:1784191862.483468:0:158676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827911424 00000100:00100000:3.0:1784191862.483500:0:158676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784191862.483505:0:158676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:165504:x1870858827911424:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.483534:0:158676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:165504:x1870858827911424:12345-0@lo:900:lod0001_rec0000.0 Request processed in 29us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.483547:0:158676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784191862.483561:0:165504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef50600 going to sleep for 11 seconds 00000100:00100000:3.0:1784191862.483573:0:165504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4edc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:165504:1870858827911424:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.483606:0:165504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4edc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827911552:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.483626:0:165504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.483642:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827911552 00000100:00100000:3.0:1784191862.483645:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827911552 00000100:00100000:3.0:1784191862.483662:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:3.0:1784191862.483667:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827911552:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.483743:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827911552:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 74us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.483749:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:3.0:1784191862.483767:0:165504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef50f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191862.483779:0:165504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4edc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827911552:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.483834:0:165504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4edc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827911680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.483887:0:165504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.483907:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827911680 00000100:00100000:3.0:1784191862.483911:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827911680 00000100:00100000:3.0:1784191862.483931:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:3.0:1784191862.483936:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827911680:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.484119:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827911680:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 171us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.484126:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:3.0:1784191862.484143:0:165504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef503c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191862.484166:0:165504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4edc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827911680:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1784191862.484200:0:165504:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 6, last_idx 8 00000100:00100000:3.0:1784191862.484293:0:165504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4edc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827911808:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.484333:0:165504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.484354:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827911808 00000100:00100000:3.0:1784191862.484358:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827911808 00000100:00100000:3.0:1784191862.484378:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:3.0:1784191862.484384:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827911808:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.484488:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827911808:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 104us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.484495:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:3.0:1784191862.484514:0:165504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef503c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191862.484525:0:165504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4edc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827911808:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1784191862.484554:0:165504:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 8 synced_idx: 0 lgh_last_idx: 8 00000040:00080000:3.0:1784191862.484559:0:165504:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200003ab1:0x1:0x0] at index 7 of catalog [0x200000401:0x1:0x0] 00000100:00100000:3.0:1784191862.484598:0:165504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4edc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827911936:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.484623:0:165504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.484642:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827911936 00000100:00100000:3.0:1784191862.484645:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827911936 00000100:00100000:3.0:1784191862.484664:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:3.0:1784191862.484669:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827911936:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.484734:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827911936:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 64us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.484741:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:3.0:1784191862.484757:0:165504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef50f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191862.484774:0:165504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4edc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827911936:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.484825:0:165504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827912064:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.484862:0:165504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.484880:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827912064 00000100:00100000:3.0:1784191862.484884:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827912064 00000100:00100000:3.0:1784191862.484904:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:3.0:1784191862.484910:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827912064:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.485046:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827912064:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 136us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.485053:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:3.0:1784191862.485070:0:165504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef503c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191862.485082:0:165504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827912064:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.485160:0:165504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827912192:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.485198:0:165504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.485219:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827912192 00000100:00100000:3.0:1784191862.485222:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827912192 00000100:00100000:3.0:1784191862.485243:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1784191862.485249:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827912192:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.485387:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827912192:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 138us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.485395:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1784191862.485412:0:165504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef503c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191862.485423:0:165504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827912192:0@lo:1000:lod0001_rec0000.0 00000004:00080000:3.0:1784191862.485450:0:165504:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x200003ab1:0x1:0x0].7 00000020:00080000:3.0:1784191862.485456:0:165504:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869213 transno = 21474836527 mdt_index 0 00000004:00080000:3.0:1784191862.485473:0:165504:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x200003ab1:0x1:0x0].8 00000020:00080000:3.0:1784191862.485476:0:165504:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869214 transno = 21474836528 mdt_index 0 00000004:00080000:3.0:1784191862.485481:0:165504:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x200003ab1:0x1:0x0].9 00000020:00080000:3.0:1784191862.485484:0:165504:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869215 transno = 21474836529 mdt_index 0 00000004:00080000:3.0:1784191862.485490:0:165504:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x200003ab1:0x1:0x0].10 00000020:00080000:3.0:1784191862.485492:0:165504:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869216 transno = 21474836530 mdt_index 0 00000004:00080000:3.0:1784191862.485498:0:165504:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x200003ab1:0x1:0x0].11 00000020:00080000:3.0:1784191862.485501:0:165504:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869217 transno = 21474836531 mdt_index 0 00000004:00080000:3.0:1784191862.485506:0:165504:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x200003ab1:0x1:0x0].12 00000020:00080000:3.0:1784191862.485509:0:165504:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869218 transno = 21474836532 mdt_index 0 00000004:00080000:3.0:1784191862.485515:0:165504:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x200003ab1:0x1:0x0].13 00000020:00080000:3.0:1784191862.485517:0:165504:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869219 transno = 21474836533 mdt_index 0 00000004:00080000:3.0:1784191862.485523:0:165504:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x200003ab1:0x1:0x0].14 00000020:00080000:3.0:1784191862.485526:0:165504:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869220 transno = 21474836534 mdt_index 0 00000004:00080000:3.0:1784191862.485531:0:165504:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x200003ab1:0x1:0x0].15 00000020:00080000:3.0:1784191862.485534:0:165504:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869221 transno = 21474836535 mdt_index 0 00000100:00100000:3.0:1784191862.485561:0:165504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827912320:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.485598:0:165504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.485617:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827912320 00000100:00100000:3.0:1784191862.485621:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827912320 00000100:00100000:3.0:1784191862.485643:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:3.0:1784191862.485649:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827912320:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.485805:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827912320:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 155us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.485817:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:3.0:1784191862.485836:0:165504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef503c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191862.485850:0:165504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827912320:0@lo:1000:lod0001_rec0000.0 00000004:00080000:3.0:1784191862.485874:0:165504:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x200003ab1:0x1:0x0].16 00000020:00080000:3.0:1784191862.485878:0:165504:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869222 transno = 21474836536 mdt_index 0 00000040:00080000:3.0:1784191862.485885:0:165504:0:(llog.c:862:llog_process_thread()) stop processing plain [0x200003ab1:0x1:0x0] index 17 count 11 00000100:00100000:3.0:1784191862.485925:0:165504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d636d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827912448:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.485962:0:165504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.485982:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827912448 00000100:00100000:3.0:1784191862.485985:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827912448 00000100:00100000:3.0:1784191862.486006:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:3.0:1784191862.486012:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827912448:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1784191862.486735:0:165480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784191862.487289:0:165480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1784191862.487336:0:165480:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1784191862.487453:0:165480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1784191862.487994:0:165480:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x67:0x0] (8/32) registered 00000100:00100000:1.0:1784191862.488261:0:165504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef503c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191862.488305:0:165504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d636d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827912448:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1784191862.488365:0:165504:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:1.0:1784191862.488381:0:165504:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200003ab1:0x2:0x0] at index 8 of catalog [0x200000401:0x1:0x0] 00000100:00100000:1.0:1784191862.488450:0:165504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827912576:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.490233:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827912448:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 4209us (4258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.490250:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:2.0:1784191862.495829:0:165504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191862.495878:0:165504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111d08c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784191862.495939:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827912576 00000100:00100000:1.0:1784191862.495947:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827912576 00000100:00100000:1.0:1784191862.496023:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:1.0:1784191862.496032:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827912576:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784191862.496144:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827912576:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 111us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191862.496152:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:2.0:1784191862.496289:0:165504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827912576:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1784191862.496355:0:165504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784191862.496452:0:165504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827912704:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1784191862.496493:0:165504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191862.496510:0:165504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111d08c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191862.496682:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827912704 00000100:00100000:3.0:1784191862.496706:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827912704 00000100:00100000:3.0:1784191862.496744:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:3.0:1784191862.496752:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827912704:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784191862.496820:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165504:x1870858827912704:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 68us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.496827:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:3.0:1784191862.496856:0:165504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:165504:1870858827912704:0@lo:1000:lod0001_rec0000.0 00000004:00080000:3.0:1784191862.496895:0:165504:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af1115020c0 with version 1 00000040:00080000:3.0:1784191862.496932:0:165504:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 6, last_idx 8 00000004:00080000:3.0:1784191862.496945:0:165504:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af10ef506c0 with version 2 00000040:00080000:3.0:1784191862.496949:0:165504:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x200003ab1:0x2:0x0] at index 8 of catalog [0x200000401:0x1:0x0] 00010000:00080000:0.0:1784191862.497043:0:165480:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0001, 2 recoverable clients, last_transno 21474836536 00000004:00080000:1.0:1784191862.497123:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 1 rpc_version 1 00000020:00100000:1.0:1784191862.497142:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784191862.497150:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af2331d6300 x1870858827912960/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784191862.497165:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827912960:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784191862.497201:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191862.497218:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2055e4180 going to sleep for 11 seconds 00000100:00100000:1.0:1784191862.497231:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827912960 00000100:00100000:1.0:1784191862.497235:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827912960 00000100:00100000:1.0:1784191862.497262:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:1.0:1784191862.497268:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165486:x1870858827912960:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784191862.497631:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:165486:x1870858827912960:12345-0@lo:1000:osp_up0-1.0 Request processed in 362us (427us total) trans 34359738632 rc 0/0 00000100:00100000:1.0:1784191862.497638:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:0.0:1784191862.497837:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827912960:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1784191862.497850:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 2 rpc_version 2 00000020:00100000:0.0:1784191862.497868:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784191862.497875:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af233157480 x1870858827913216/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784191862.497891:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233157480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827913216:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784191862.497928:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191862.497958:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2055e4180 going to sleep for 11 seconds 00010000:00080000:2.0:1784191862.498121:0:165505:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0001: started recovery thread pid 165505 00010000:02000000:2.0:1784191862.498135:0:165505:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0001: in recovery but waiting for the first client to connect 00000004:00000080:0.0:1784191862.498426:0:165480:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0001: cmd=8008668e len=0 karg=ffffb46d00d7fb10 uarg=0000000000000000 00000004:02000400:0.0:1784191862.498461:0:165480:0:(mdt_handler.c:8202:mdt_iocontrol()) lustre-MDT0001: Aborting client recovery 00000100:00100000:1.0:1784191862.498525:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827913216 00000100:00100000:1.0:1784191862.498532:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827913216 00000100:00100000:1.0:1784191862.498573:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:1.0:1784191862.498581:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:165486:x1870858827913216:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784191862.498773:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:165486:x1870858827913216:12345-0@lo:1000:osp_up0-1.0 Request processed in 192us (843us total) trans 34359738633 rc 0/0 00000100:00100000:1.0:1784191862.498780:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000040:00080000:3.0:1784191862.498848:0:165504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 9 count 2 00000004:00080000:3.0:1784191862.498923:0:165504:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1784191862.500555:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233157480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827913216:0@lo:1000:osp_up0-1.0 00000040:00080000:3.0:1784191862.501918:0:165503:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x240000400:0x1:0x0] first idx 3, last_idx 4 00000040:00080000:3.0:1784191862.502367:0:165503:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1784191862.502382:0:165503:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x240002340:0x1:0x0] at index 4 of catalog [0x240000400:0x1:0x0] 00010000:00080000:2.0:1784191862.506744:0:165505:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1784191862.506754:0:165505:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000004:00080000:3.0:1784191862.513206:0:165503:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x240002340:0x1:0x0].7 00000020:00080000:3.0:1784191862.513220:0:165503:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869213 transno = 0 mdt_index 1 00000004:00080000:3.0:1784191862.513233:0:165503:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x240002340:0x1:0x0].8 00000020:00080000:3.0:1784191862.513236:0:165503:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869214 transno = 0 mdt_index 1 00000004:00080000:3.0:1784191862.513243:0:165503:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x240002340:0x1:0x0].9 00000020:00080000:3.0:1784191862.513246:0:165503:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869215 transno = 0 mdt_index 1 00000004:00080000:3.0:1784191862.513251:0:165503:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x240002340:0x1:0x0].10 00000020:00080000:3.0:1784191862.513253:0:165503:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869216 transno = 0 mdt_index 1 00000004:00080000:3.0:1784191862.513259:0:165503:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x240002340:0x1:0x0].11 00000020:00080000:3.0:1784191862.513262:0:165503:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869217 transno = 0 mdt_index 1 00000004:00080000:3.0:1784191862.513266:0:165503:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x240002340:0x1:0x0].12 00000020:00080000:3.0:1784191862.513268:0:165503:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869218 transno = 0 mdt_index 1 00000004:00080000:3.0:1784191862.513276:0:165503:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x240002340:0x1:0x0].13 00000020:00080000:3.0:1784191862.513278:0:165503:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869219 transno = 0 mdt_index 1 00000004:00080000:3.0:1784191862.513286:0:165503:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x240002340:0x1:0x0].14 00000020:00080000:3.0:1784191862.513288:0:165503:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869220 transno = 0 mdt_index 1 00000004:00080000:3.0:1784191862.513293:0:165503:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x240002340:0x1:0x0].15 00000020:00080000:3.0:1784191862.513304:0:165503:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869221 transno = 0 mdt_index 1 00000004:00080000:3.0:1784191862.513341:0:165503:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x240002340:0x1:0x0].16 00000020:00080000:3.0:1784191862.513344:0:165503:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 17179869222 transno = 0 mdt_index 1 00000040:00080000:3.0:1784191862.513349:0:165503:0:(llog.c:862:llog_process_thread()) stop processing plain [0x240002340:0x1:0x0] index 17 count 11 00000040:00080000:3.0:1784191862.513382:0:165503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 5 count 2 00000004:00080000:3.0:1784191862.513463:0:165503:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1784191862.513467:0:165503:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00080000:2.0:1784191862.513730:0:165505:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00020000:0.0:1784191862.515183:0:165480:0:(ldlm_lib.c:3003:target_stop_recovery_thread()) lustre-MDT0001: Aborting recovery 00010000:00080000:2.0:1784191862.521332:0:165505:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 1 expired 0 00010000:00000400:2.0:1784191862.521345:0:165505:0:(ldlm_lib.c:2403:target_recovery_overseer()) recovery is aborted, evict exports in recovery 00000020:00080000:2.0:1784191862.529596:0:165505:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t21474836527 00000020:00080000:2.0:1784191862.529624:0:165505:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t21474836528 00000020:00080000:2.0:1784191862.529628:0:165505:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t21474836529 00000020:00080000:2.0:1784191862.529632:0:165505:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t21474836530 00000020:00080000:2.0:1784191862.529637:0:165505:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t21474836531 00000020:00080000:2.0:1784191862.529641:0:165505:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t21474836532 00000020:00080000:2.0:1784191862.529645:0:165505:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t21474836533 00000020:00080000:2.0:1784191862.529654:0:165505:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t21474836534 00000020:00080000:2.0:1784191862.529680:0:165505:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t21474836535 00000020:00080000:2.0:1784191862.529716:0:165505:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t21474836536 00000020:00000400:2.0:1784191862.529725:0:165505:0:(genops.c:1622:class_disconnect_stale_exports()) lustre-MDT0001: disconnect stale client 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@ 00000020:00080000:2.0:1784191862.547982:0:165505:0:(genops.c:1840:print_export_data()) lustre-MDT0001: EVICTING ffff8af23f638800 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 3 (0 0 0) 0 0 1 0: 0000000000000000 21474836536 stale:0 00000020:00000400:2.0:1784191862.547998:0:165505:0:(genops.c:1622:class_disconnect_stale_exports()) lustre-MDT0001: disconnect stale client lustre-MDT0000-mdtlov_UUID@ 00000020:00080000:2.0:1784191862.548001:0:165505:0:(genops.c:1840:print_export_data()) lustre-MDT0001: EVICTING ffff8af23f638000 lustre-MDT0000-mdtlov_UUID 3 (0 0 0) 0 0 1 0: 0000000000000000 21474836522 stale:0 00000020:02000400:2.0:1784191862.548005:0:165505:0:(genops.c:1629:class_disconnect_stale_exports()) lustre-MDT0001: disconnecting 2 stale clients 00000020:00080000:2.0:1784191862.559236:0:165505:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at (ffff8af23f638000), last request at 1784191862 00000020:00000080:2.0:1784191862.559253:0:165505:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4a979 00000001:00000004:2.0:1784191862.563664:0:165505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 21474836536 00010000:00010000:0.0:1784191862.563732:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1784191862.563834:0:165505:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at (ffff8af23f638000): rc 0 00000020:00080000:0.0:1784191862.563841:0:165505:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at (ffff8af23f638800), last request at 1784191862 00000020:00000080:0.0:1784191862.563846:0:165505:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4a980 00000001:00000004:0.0:1784191862.563877:0:165505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 21474836536 00000020:00080000:0.0:1784191862.563902:0:165505:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at (ffff8af23f638800): rc 0 00010000:00080000:0.0:1784191862.563910:0:165505:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 21474836537 00010000:02000000:0.0:1784191862.563914:0:165505:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0001: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1784191862.563917:0:165505:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 0, completed: 0, queue_len: 0, req_transno: 0, next_transno: 21474836537 00010000:00080000:0.0:1784191862.563920:0:165505:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for aborted recovery 00010000:00000400:0.0:1784191862.563922:0:165505:0:(ldlm_lib.c:2403:target_recovery_overseer()) recovery is aborted, evict exports in recovery 00010000:00080000:0.0:1784191862.563925:0:165505:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:02000000:0.0:1784191862.563927:0:165505:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0001: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1784191862.563943:0:165505:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00010000:00000400:0.0:1784191862.563945:0:165505:0:(ldlm_lib.c:2403:target_recovery_overseer()) recovery is aborted, evict exports in recovery 00000001:00000004:0.0:1784191862.563984:0:165505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 25769803776 00010000:00010000:2.0:1784191862.565585:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784191862.566432:0:165481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000020:00000080:0.0:1784191862.566440:0:165481:0:(genops.c:906:class_export_put()) final put ffff8af23f638800/62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000001:00100000:0.0:1784191862.566469:0:165481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784191862.566472:0:165481:0:(genops.c:906:class_export_put()) final put ffff8af23f638000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784191862.566557:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23f638800/62ac9b09-d016-4ae6-b1b1-fe120a3abe0a for lustre-MDT0001 00000020:00000080:2.0:1784191862.566609:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23f638000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00080000:1.0:1784191862.566734:0:165505:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784191862.566777:0:165505:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0001: cmd=c00866c1 len=0 karg=ffff8af1077a54c0 uarg=0000000000000000 00000004:00000080:1.0:1784191862.566827:0:165505:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866c1 len=0 karg=ffff8af1077a54c0 00000004:00000080:1.0:1784191862.566833:0:165505:0:(lod_dev.c:2754:lod_iocontrol()) lustre-MDT0001-mdtlov: cmd=c00866c1 len=0 karg=ffff8af1077a54c0 uarg=0000000000000000 00000004:02000040:1.0:1784191862.566882:0:165505:0:(lod_dev.c:409:lod_sub_cancel_llog()) lustre-MDT0001-osd: cancel update llog [0x240000400:0x1:0x0] 00000040:00080000:1.0:1784191862.570079:0:165505:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1784191862.570088:0:165505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x240002340:0x1:0x0] at index 4 of catalog [0x240000400:0x1:0x0] 00000040:00080000:1.0:1784191862.577658:0:165505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 5 count 2 00000040:01000000:1.0:1784191862.577831:0:165505:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1784191862.587184:0:165505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:02000040:1.0:1784191862.592214:0:165505:0:(lod_dev.c:409:lod_sub_cancel_llog()) lustre-MDT0000-osp-MDT0001: cancel update llog [0x200000401:0x1:0x0] 00000100:00100000:0.0:1784191862.597513:0:165505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233154000 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:165505:1870858827913344:0@lo:1000:tgt_recover_1.0 00000100:00100000:0.0:1784191862.597640:0:165505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191862.598389:0:165505:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233dd7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784191862.598450:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827913344 00000100:00100000:1.0:1784191862.598461:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827913344 00000100:00100000:1.0:1784191862.598573:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:1.0:1784191862.598583:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:165505:x1870858827913344:12345-0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1784191862.598843:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:165505:x1870858827913344:12345-0@lo:1000:tgt_recover_1.0 Request processed in 261us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191862.598851:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1784191862.598928:0:165505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233154000 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:165505:1870858827913344:0@lo:1000:tgt_recover_1.0 00000040:00080000:0.0:1784191862.598988:0:165505:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 8 synced_idx: 0 lgh_last_idx: 8 00000040:00080000:0.0:1784191862.598993:0:165505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200003ab1:0x1:0x0] at index 7 of catalog [0x200000401:0x1:0x0] 00000004:00080000:0.0:1784191862.599053:0:165505:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af233dd7e40 with version 3 00000004:00080000:3.0:1784191862.599116:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 3 rpc_version 3 00000100:00100000:0.0:1784191862.599122:0:165505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233154000 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:165505:1870858827913472:0@lo:1000:tgt_recover_1.0 00000020:00100000:3.0:1784191862.599139:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784191862.599149:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af20d637b80 x1870858827913728/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191862.599165:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d637b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827913728:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784191862.599188:0:165505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191862.599600:0:165505:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233dd7240 going to sleep for 11 seconds 00000100:00100000:2.0:1784191862.599645:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827913472 00000100:00100000:2.0:1784191862.599651:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827913472 00000100:00100000:2.0:1784191862.599837:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:2.0:1784191862.599846:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:165505:x1870858827913472:12345-0@lo:1000:tgt_recover_1.0 00000100:00100000:2.0:1784191862.600000:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:165505:x1870858827913472:12345-0@lo:1000:tgt_recover_1.0 Request processed in 155us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191862.600007:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1784191862.600060:0:165505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233154000 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:165505:1870858827913472:0@lo:1000:tgt_recover_1.0 00000040:00080000:0.0:1784191862.600097:0:165505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 9 count 2 00000040:01000000:0.0:1784191862.600137:0:165505:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000004:00080000:0.0:1784191862.600178:0:165505:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af233dd7f00 with version 4 00000100:00100000:0.0:1784191862.600235:0:165505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233154000 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:165505:1870858827913856:0@lo:700:tgt_recover_1.0 00000100:00100000:0.0:1784191862.600266:0:165505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191862.600471:0:158675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827913856 00000100:00100000:0.0:1784191862.600476:0:158675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827913856 00000100:00100000:0.0:1784191862.600518:0:158675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784191862.600532:0:158675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+7:165505:x1870858827913856:12345-0@lo:700:tgt_recover_1.0 00000100:00100000:0.0:1784191862.600574:0:158675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+7:165505:x1870858827913856:12345-0@lo:700:tgt_recover_1.0 Request processed in 43us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191862.600580:0:158675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784191862.600599:0:165505:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233dd7240 going to sleep for 11 seconds 00000100:00100000:0.0:1784191862.600613:0:165505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233154000 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:165505:1870858827913856:0@lo:700:tgt_recover_1.0 00000004:00080000:0.0:1784191862.600716:0:165505:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af233dd7240 with version 0 00000020:00100000:0.0:1784191862.600733:0:165505:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 2 is allocated opc 1000, max 8 00000100:00100000:0.0:1784191862.600740:0:165505:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af233154000 x1870858827914112/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784191862.600753:0:165505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233154000 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:165505:1870858827914112:0@lo:1000:tgt_recover_1.0 00000100:00100000:0.0:1784191862.600780:0:165505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191862.600805:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827914112 00000100:00100000:0.0:1784191862.600809:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827914112 00000100:00100000:0.0:1784191862.600832:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:0.0:1784191862.600838:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:165505:x1870858827914112:12345-0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1784191862.601755:0:165505:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233dd7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784191862.604093:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.604167:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef50600 going to sleep for 11 seconds 00000001:00080000:1.0:1784191862.606351:0:158645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738634 is committed 00000100:00100000:1.0:1784191862.606395:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827913728 00000100:00100000:1.0:1784191862.606405:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827913728 00000100:00100000:1.0:1784191862.606471:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1784191862.606485:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:165486:x1870858827913728:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784191862.606890:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:165486:x1870858827913728:12345-0@lo:1000:osp_up0-1.0 Request processed in 406us (2801us total) trans 34359738635 rc 0/0 00000100:00100000:0.0:1784191862.607039:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:165505:x1870858827914112:12345-0@lo:1000:tgt_recover_1.0 Request processed in 6199us (6256us total) trans 34359738634 rc 0/0 00000100:00100000:0.0:1784191862.607049:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000004:00080000:0.0:1784191862.607101:0:165505:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738634 committed transno 34359738634 00000100:00100000:0.0:1784191862.607115:0:165505:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 34359738634 gen 2 00000004:00080000:0.0:1784191862.607120:0:165505:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738632 committed transno 34359738634 00000004:00080000:0.0:1784191862.607142:0:165505:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738633 committed transno 34359738634 00000100:00100000:0.0:1784191862.607167:0:165505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233154000 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:165505:1870858827914112:0@lo:1000:tgt_recover_1.0 00000100:00100000:0.0:1784191862.607255:0:165505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233154000 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:165505:1870858827914240:0@lo:1000:tgt_recover_1.0 00000100:00100000:0.0:1784191862.607314:0:165505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191862.607343:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827914240 00000100:00100000:0.0:1784191862.607348:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827914240 00000100:00100000:0.0:1784191862.607369:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1784191862.607375:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:165505:x1870858827914240:12345-0@lo:1000:tgt_recover_1.0 00000100:00100000:0.0:1784191862.607417:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:165505:x1870858827914240:12345-0@lo:1000:tgt_recover_1.0 Request processed in 43us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191862.607424:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1784191862.607439:0:165505:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af205d9e000 going to sleep for 11 seconds 00000100:00100000:0.0:1784191862.607450:0:165505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233154000 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:165505:1870858827914240:0@lo:1000:tgt_recover_1.0 00000040:00080000:0.0:1784191862.607463:0:165505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1784191862.607488:0:165505:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af205d9e780 with version 5 00010000:00080000:0.0:1784191862.607552:0:165505:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0001: cancel recovery timer 00000100:00100000:1.0:1784191862.611205:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1784191862.611580:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d637b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827913728:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1784191862.611600:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 4 rpc_version 4 00000020:00100000:3.0:1784191862.611653:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784191862.611662:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af20d636680 x1870858827914496/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191862.611708:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d636680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827914496:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784191862.611787:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.611832:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef50f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784191862.611909:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827914496 00000100:00100000:2.0:1784191862.611916:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827914496 00000100:00100000:2.0:1784191862.611972:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1784191862.611983:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:165486:x1870858827914496:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784191862.612521:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:165486:x1870858827914496:12345-0@lo:1000:osp_up0-1.0 Request processed in 539us (732us total) trans 34359738636 rc 0/0 00000100:00100000:2.0:1784191862.612530:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:3.0:1784191862.612635:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d636680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827914496:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1784191862.612646:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 5 rpc_version 5 00000020:00100000:3.0:1784191862.612662:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784191862.612668:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af20d636a00 x1870858827914752/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191862.612720:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d636a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827914752:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784191862.612757:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.612777:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef50f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784191862.612959:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827914752 00000100:00100000:2.0:1784191862.612964:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827914752 00000100:00100000:2.0:1784191862.612999:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1784191862.613007:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:165486:x1870858827914752:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:1.0:1784191862.614460:0:158645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738637 is committed 00000100:00100000:2.0:1784191862.615543:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165486:x1870858827914752:12345-0@lo:1000:osp_up0-1.0 Request processed in 2530us (2778us total) trans 34359738637 rc 0/0 00000100:00100000:2.0:1784191862.615557:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000004:00080000:3.0:1784191862.615671:0:165486:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738637 committed transno 34359738637 00000100:00100000:3.0:1784191862.615675:0:165486:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 34359738637 gen 2 00000004:00080000:3.0:1784191862.615679:0:165486:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738635 committed transno 34359738637 00000004:00080000:3.0:1784191862.615759:0:165486:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738636 committed transno 34359738637 00000100:00100000:3.0:1784191862.615798:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d636a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827914752:0@lo:1000:osp_up0-1.0 00000004:00000080:1.0:1784191862.642056:0:165505:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb46d0fa83e10 00100000:10000000:1.0:1784191862.642074:0:165505:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000004:00080000:2.0:1784191862.643468:0:165492:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x43:0x0] 00000100:00100000:2.0:1784191862.643524:0:165492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:165492:1870858827914880:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1784191862.643602:0:165492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191862.643641:0:165492:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1068ceb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191862.643758:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827914880 00000100:00100000:1.0:1784191862.643767:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827914880 00000100:00100000:1.0:1784191862.643815:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1784191862.643824:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:165492:x1870858827914880:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1784191862.643854:0:160166:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 161 -> diff = -94 00002000:02000040:1.0:1784191862.643859:0:160166:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:68 to 0x2c0000400:161) 00000020:01000004:3.0:1784191862.644193:0:165480:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784191862.644232:0:165480:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.116@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784191862.644260:0:165480:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1784191862.644292:0:165480:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000004:00080000:0.0:1784191862.646084:0:165490:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x82:0x0] 00000100:00100000:0.0:1784191862.646152:0:165490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233154000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:165490:1870858827915008:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1784191862.646227:0:165490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191862.646286:0:165490:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af205d9e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191862.646419:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827915008 00000100:00100000:2.0:1784191862.646428:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827915008 00000100:00100000:2.0:1784191862.646494:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1784191862.646504:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+6:165490:x1870858827915008:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1784191862.646539:0:162396:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 161 -> diff = -31 00002000:02000040:2.0:1784191862.646545:0:162396:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:161) 00000020:00000004:3.0:1784191862.646957:0:165480:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784191862.648551:0:165480:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00002000:00010000:1.0:1784191862.674254:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xa1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.674284:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4aa21 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674303:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa1:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.674308:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.674316:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4aa21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674336:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4aa21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674348:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4aa21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674356:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4aa21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674383:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784191862.674507:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xa0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.674513:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3c6a7cd/0xfeec3c2dc5a4aa28 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674522:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa0:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.674526:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.674530:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3c6a7cd/0xfeec3c2dc5a4aa28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674540:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3c6a7cd/0xfeec3c2dc5a4aa28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674556:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3c6a7cd/0xfeec3c2dc5a4aa28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674563:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3c6a7cd/0xfeec3c2dc5a4aa28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674584:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784191862.674628:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.674633:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a09c1cad/0xfeec3c2dc5a4aa2f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674641:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9f:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.674644:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.674649:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a09c1cad/0xfeec3c2dc5a4aa2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674658:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a09c1cad/0xfeec3c2dc5a4aa2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674666:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a09c1cad/0xfeec3c2dc5a4aa2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674673:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a09c1cad/0xfeec3c2dc5a4aa2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674718:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1784191862.674759:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.674764:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034cd9df9/0xfeec3c2dc5a4aa36 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674772:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9e:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.674775:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.674779:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034cd9df9/0xfeec3c2dc5a4aa36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674788:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034cd9df9/0xfeec3c2dc5a4aa36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674796:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034cd9df9/0xfeec3c2dc5a4aa36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674803:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034cd9df9/0xfeec3c2dc5a4aa36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674811:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1784191862.674844:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.674849:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c94d6048/0xfeec3c2dc5a4aa3d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674855:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9d:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.674864:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.674869:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c94d6048/0xfeec3c2dc5a4aa3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674878:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c94d6048/0xfeec3c2dc5a4aa3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674884:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c94d6048/0xfeec3c2dc5a4aa3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674890:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c94d6048/0xfeec3c2dc5a4aa3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674898:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1784191862.674937:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.674942:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051a72a92/0xfeec3c2dc5a4aa44 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674949:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9c:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.674952:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.674955:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051a72a92/0xfeec3c2dc5a4aa44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674963:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051a72a92/0xfeec3c2dc5a4aa44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674971:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051a72a92/0xfeec3c2dc5a4aa44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674984:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051a72a92/0xfeec3c2dc5a4aa44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.674991:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1784191862.675050:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.675055:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a6e67f/0xfeec3c2dc5a4aa4b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675063:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9b:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.675066:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.675069:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a6e67f/0xfeec3c2dc5a4aa4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675077:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2a6e67f/0xfeec3c2dc5a4aa4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675084:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a6e67f/0xfeec3c2dc5a4aa4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675090:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a6e67f/0xfeec3c2dc5a4aa4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675097:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1784191862.675144:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.675149:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fc22617/0xfeec3c2dc5a4aa52 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675163:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9a:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.675166:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.675170:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fc22617/0xfeec3c2dc5a4aa52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675179:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fc22617/0xfeec3c2dc5a4aa52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675187:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fc22617/0xfeec3c2dc5a4aa52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675194:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fc22617/0xfeec3c2dc5a4aa52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675201:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1784191862.675241:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.675246:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064b52797/0xfeec3c2dc5a4aa59 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675254:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x99:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.675257:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x99:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.675260:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064b52797/0xfeec3c2dc5a4aa59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675268:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064b52797/0xfeec3c2dc5a4aa59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675287:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064b52797/0xfeec3c2dc5a4aa59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675294:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064b52797/0xfeec3c2dc5a4aa59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675302:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1784191862.675339:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.675344:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4aa60 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675351:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x98:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.675354:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x98:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.675358:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4aa60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675366:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4aa60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675374:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4aa60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675381:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4aa60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675399:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1784191862.675438:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.675444:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a08b2a9e/0xfeec3c2dc5a4aa67 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675451:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x97:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.675454:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x97:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.675458:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a08b2a9e/0xfeec3c2dc5a4aa67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675466:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a08b2a9e/0xfeec3c2dc5a4aa67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675473:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a08b2a9e/0xfeec3c2dc5a4aa67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675480:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a08b2a9e/0xfeec3c2dc5a4aa67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675488:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:1.0:1784191862.675523:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.675528:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4aa6e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675535:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x96:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.675544:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x96:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.675548:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4aa6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675558:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4aa6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675565:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4aa6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675572:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4aa6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675580:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:1.0:1784191862.675618:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.675622:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d1638d4/0xfeec3c2dc5a4aa75 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675630:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x95:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.675632:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x95:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.675636:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d1638d4/0xfeec3c2dc5a4aa75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675645:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d1638d4/0xfeec3c2dc5a4aa75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675653:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d1638d4/0xfeec3c2dc5a4aa75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675666:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d1638d4/0xfeec3c2dc5a4aa75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675674:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:1.0:1784191862.675747:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.675753:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4aa7c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675760:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x94:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.675763:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x94:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.675767:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4aa7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675776:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4aa7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675783:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4aa7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675789:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4aa7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675798:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:1.0:1784191862.675835:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.675841:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca579565/0xfeec3c2dc5a4aa83 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675854:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x93:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.675857:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x93:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.675861:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca579565/0xfeec3c2dc5a4aa83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675869:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca579565/0xfeec3c2dc5a4aa83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675877:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca579565/0xfeec3c2dc5a4aa83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675883:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca579565/0xfeec3c2dc5a4aa83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675891:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:1.0:1784191862.675928:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.675933:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d75ce80/0xfeec3c2dc5a4aa8a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675940:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x92:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.675943:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x92:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.675946:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d75ce80/0xfeec3c2dc5a4aa8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675954:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d75ce80/0xfeec3c2dc5a4aa8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675974:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d75ce80/0xfeec3c2dc5a4aa8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675981:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d75ce80/0xfeec3c2dc5a4aa8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.675989:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:1.0:1784191862.676027:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.676032:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085f29342/0xfeec3c2dc5a4aa91 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676040:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x91:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.676043:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x91:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.676047:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085f29342/0xfeec3c2dc5a4aa91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676056:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085f29342/0xfeec3c2dc5a4aa91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676063:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085f29342/0xfeec3c2dc5a4aa91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676069:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085f29342/0xfeec3c2dc5a4aa91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676087:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:1.0:1784191862.676142:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.676147:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fc995a0/0xfeec3c2dc5a4aa98 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676154:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x90:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.676157:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x90:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.676161:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fc995a0/0xfeec3c2dc5a4aa98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676169:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fc995a0/0xfeec3c2dc5a4aa98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676177:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fc995a0/0xfeec3c2dc5a4aa98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676184:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fc995a0/0xfeec3c2dc5a4aa98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676192:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:1.0:1784191862.676320:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.676326:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6d9fe83/0xfeec3c2dc5a4aa9f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676334:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8f:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.676342:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.676347:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d9fe83/0xfeec3c2dc5a4aa9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676356:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6d9fe83/0xfeec3c2dc5a4aa9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676363:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6d9fe83/0xfeec3c2dc5a4aa9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676371:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d9fe83/0xfeec3c2dc5a4aa9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676379:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:1.0:1784191862.676419:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.676424:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4aaa6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676431:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8e:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.676434:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.676437:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4aaa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676446:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4aaa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676454:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4aaa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676467:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4aaa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676475:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:1.0:1784191862.676512:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.676517:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed8080af/0xfeec3c2dc5a4aaad lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676525:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8d:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.676528:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.676531:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed8080af/0xfeec3c2dc5a4aaad lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676539:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed8080af/0xfeec3c2dc5a4aaad lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676547:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed8080af/0xfeec3c2dc5a4aaad lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676554:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed8080af/0xfeec3c2dc5a4aaad lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676561:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:1.0:1784191862.676597:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.676601:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adc4f613/0xfeec3c2dc5a4aab4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676614:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8c:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.676617:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.676621:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adc4f613/0xfeec3c2dc5a4aab4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676630:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adc4f613/0xfeec3c2dc5a4aab4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676639:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adc4f613/0xfeec3c2dc5a4aab4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676645:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000adc4f613/0xfeec3c2dc5a4aab4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676654:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/22 locks to regular blp list, 22 blwis in pool 00002000:00010000:1.0:1784191862.676720:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.676725:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000057e141a/0xfeec3c2dc5a4aabb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676733:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8b:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.676735:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.676739:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000057e141a/0xfeec3c2dc5a4aabb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676748:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000057e141a/0xfeec3c2dc5a4aabb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676766:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000057e141a/0xfeec3c2dc5a4aabb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676773:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000057e141a/0xfeec3c2dc5a4aabb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676781:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/23 locks to regular blp list, 23 blwis in pool 00002000:00010000:1.0:1784191862.676820:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.676825:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4aac2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676833:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8a:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.676835:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.676839:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4aac2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676846:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4aac2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676853:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4aac2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676859:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4aac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676877:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/24 locks to regular blp list, 24 blwis in pool 00002000:00010000:1.0:1784191862.676919:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.676925:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005003ce52/0xfeec3c2dc5a4aac9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676933:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x89:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.676935:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x89:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.676938:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005003ce52/0xfeec3c2dc5a4aac9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676947:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005003ce52/0xfeec3c2dc5a4aac9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676953:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005003ce52/0xfeec3c2dc5a4aac9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676960:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005003ce52/0xfeec3c2dc5a4aac9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.676968:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/25 locks to regular blp list, 25 blwis in pool 00002000:00010000:1.0:1784191862.677006:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.677011:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b93b2b5/0xfeec3c2dc5a4aad0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.677019:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x88:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.677028:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x88:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.677033:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b93b2b5/0xfeec3c2dc5a4aad0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.677042:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b93b2b5/0xfeec3c2dc5a4aad0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.677050:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b93b2b5/0xfeec3c2dc5a4aad0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.677057:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b93b2b5/0xfeec3c2dc5a4aad0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.677065:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/26 locks to regular blp list, 26 blwis in pool 00010000:00010000:3.0:1784191862.677814:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 25 total in blp. (25 blwis in pool) 00010000:00010000:3.0:1784191862.677825:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4aa21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.677835:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127800 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.677839:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4aa21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.677849:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4aa21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.677867:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4aa21 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.677888:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4aa21 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.677915:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 24 total in blp. (24 blwis in pool) 00010000:00010000:3.0:1784191862.677919:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3c6a7cd/0xfeec3c2dc5a4aa28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.677925:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233126a00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.677929:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3c6a7cd/0xfeec3c2dc5a4aa28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.677936:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3c6a7cd/0xfeec3c2dc5a4aa28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.677945:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3c6a7cd/0xfeec3c2dc5a4aa28 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.677952:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3c6a7cd/0xfeec3c2dc5a4aa28 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.677965:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 23 total in blp. (23 blwis in pool) 00010000:00010000:3.0:1784191862.677969:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a09c1cad/0xfeec3c2dc5a4aa2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.677975:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127e00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.677984:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a09c1cad/0xfeec3c2dc5a4aa2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.677992:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a09c1cad/0xfeec3c2dc5a4aa2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678002:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a09c1cad/0xfeec3c2dc5a4aa2f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678010:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a09c1cad/0xfeec3c2dc5a4aa2f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678024:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 22 total in blp. (22 blwis in pool) 00010000:00010000:3.0:1784191862.678027:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034cd9df9/0xfeec3c2dc5a4aa36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678034:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127a00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.678037:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034cd9df9/0xfeec3c2dc5a4aa36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678044:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034cd9df9/0xfeec3c2dc5a4aa36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678053:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034cd9df9/0xfeec3c2dc5a4aa36 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678060:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034cd9df9/0xfeec3c2dc5a4aa36 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678079:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 21 total in blp. (21 blwis in pool) 00010000:00010000:3.0:1784191862.678083:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c94d6048/0xfeec3c2dc5a4aa3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678089:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233126400 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.678092:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c94d6048/0xfeec3c2dc5a4aa3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678099:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c94d6048/0xfeec3c2dc5a4aa3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678123:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c94d6048/0xfeec3c2dc5a4aa3d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678130:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c94d6048/0xfeec3c2dc5a4aa3d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678145:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:3.0:1784191862.678148:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051a72a92/0xfeec3c2dc5a4aa44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678154:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127c00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.678157:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051a72a92/0xfeec3c2dc5a4aa44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678175:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051a72a92/0xfeec3c2dc5a4aa44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678185:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051a72a92/0xfeec3c2dc5a4aa44 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678191:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051a72a92/0xfeec3c2dc5a4aa44 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678204:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:3.0:1784191862.678208:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2a6e67f/0xfeec3c2dc5a4aa4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678214:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233126600 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.678216:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a6e67f/0xfeec3c2dc5a4aa4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678224:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a6e67f/0xfeec3c2dc5a4aa4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678234:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2a6e67f/0xfeec3c2dc5a4aa4b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678241:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2a6e67f/0xfeec3c2dc5a4aa4b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678265:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:3.0:1784191862.678269:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fc22617/0xfeec3c2dc5a4aa52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678275:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233126800 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.678278:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fc22617/0xfeec3c2dc5a4aa52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678286:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fc22617/0xfeec3c2dc5a4aa52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678295:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fc22617/0xfeec3c2dc5a4aa52 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678302:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fc22617/0xfeec3c2dc5a4aa52 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678314:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:3.0:1784191862.678318:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064b52797/0xfeec3c2dc5a4aa59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678325:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127200 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.678328:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064b52797/0xfeec3c2dc5a4aa59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678346:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064b52797/0xfeec3c2dc5a4aa59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678356:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064b52797/0xfeec3c2dc5a4aa59 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678363:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064b52797/0xfeec3c2dc5a4aa59 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678380:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:3.0:1784191862.678384:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4aa60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678391:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127000 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.678394:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4aa60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678402:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4aa60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678411:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4aa60 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678418:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4aa60 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678441:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:3.0:1784191862.678445:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a08b2a9e/0xfeec3c2dc5a4aa67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678452:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd69a00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.678455:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a08b2a9e/0xfeec3c2dc5a4aa67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678463:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a08b2a9e/0xfeec3c2dc5a4aa67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678471:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a08b2a9e/0xfeec3c2dc5a4aa67 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678478:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a08b2a9e/0xfeec3c2dc5a4aa67 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678490:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:3.0:1784191862.678494:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4aa6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678501:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68600 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.678504:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4aa6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678522:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4aa6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678533:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4aa6e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678541:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4aa6e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678556:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:3.0:1784191862.678559:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d1638d4/0xfeec3c2dc5a4aa75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678566:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd69600 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.678569:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d1638d4/0xfeec3c2dc5a4aa75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678576:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d1638d4/0xfeec3c2dc5a4aa75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678585:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d1638d4/0xfeec3c2dc5a4aa75 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678591:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d1638d4/0xfeec3c2dc5a4aa75 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678615:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:3.0:1784191862.678619:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4aa7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678627:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68200 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.678630:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4aa7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678637:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4aa7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678647:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4aa7c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678654:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4aa7c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678666:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:3.0:1784191862.678670:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca579565/0xfeec3c2dc5a4aa83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678676:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68e00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.678679:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca579565/0xfeec3c2dc5a4aa83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678722:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca579565/0xfeec3c2dc5a4aa83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678733:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca579565/0xfeec3c2dc5a4aa83 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678740:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca579565/0xfeec3c2dc5a4aa83 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678754:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1784191862.678758:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d75ce80/0xfeec3c2dc5a4aa8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678764:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68a00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.678768:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d75ce80/0xfeec3c2dc5a4aa8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678775:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d75ce80/0xfeec3c2dc5a4aa8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678784:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d75ce80/0xfeec3c2dc5a4aa8a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678791:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d75ce80/0xfeec3c2dc5a4aa8a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678814:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1784191862.678817:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085f29342/0xfeec3c2dc5a4aa91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678824:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68c00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.678827:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085f29342/0xfeec3c2dc5a4aa91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678834:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085f29342/0xfeec3c2dc5a4aa91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678843:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085f29342/0xfeec3c2dc5a4aa91 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678850:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085f29342/0xfeec3c2dc5a4aa91 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678863:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1784191862.678866:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fc995a0/0xfeec3c2dc5a4aa98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678872:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68400 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.678875:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fc995a0/0xfeec3c2dc5a4aa98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678906:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fc995a0/0xfeec3c2dc5a4aa98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678917:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fc995a0/0xfeec3c2dc5a4aa98 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678924:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fc995a0/0xfeec3c2dc5a4aa98 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678937:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1784191862.678941:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6d9fe83/0xfeec3c2dc5a4aa9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678947:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd69400 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.678950:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6d9fe83/0xfeec3c2dc5a4aa9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678958:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6d9fe83/0xfeec3c2dc5a4aa9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678966:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6d9fe83/0xfeec3c2dc5a4aa9f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678973:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6d9fe83/0xfeec3c2dc5a4aa9f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.678998:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1784191862.679001:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4aaa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679007:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68000 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.679011:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4aaa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679018:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4aaa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679029:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4aaa6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679037:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4aaa6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679049:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1784191862.679053:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed8080af/0xfeec3c2dc5a4aaad lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679058:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd69e00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.679061:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed8080af/0xfeec3c2dc5a4aaad lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679077:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed8080af/0xfeec3c2dc5a4aaad lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679086:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed8080af/0xfeec3c2dc5a4aaad lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679093:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed8080af/0xfeec3c2dc5a4aaad lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679118:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784191862.679121:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000adc4f613/0xfeec3c2dc5a4aab4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679128:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd69200 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.679131:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000adc4f613/0xfeec3c2dc5a4aab4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679138:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000adc4f613/0xfeec3c2dc5a4aab4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679149:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000adc4f613/0xfeec3c2dc5a4aab4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679156:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adc4f613/0xfeec3c2dc5a4aab4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679179:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784191862.679183:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000057e141a/0xfeec3c2dc5a4aabb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679190:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd69c00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.679192:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000057e141a/0xfeec3c2dc5a4aabb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679200:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000057e141a/0xfeec3c2dc5a4aabb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679210:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000057e141a/0xfeec3c2dc5a4aabb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679217:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000057e141a/0xfeec3c2dc5a4aabb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679230:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784191862.679234:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4aac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679241:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68800 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.679245:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4aac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679263:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4aac2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679274:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4aac2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679282:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4aac2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679296:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784191862.679300:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005003ce52/0xfeec3c2dc5a4aac9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679306:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8400 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.679309:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005003ce52/0xfeec3c2dc5a4aac9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679317:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005003ce52/0xfeec3c2dc5a4aac9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679326:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005003ce52/0xfeec3c2dc5a4aac9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679333:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005003ce52/0xfeec3c2dc5a4aac9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679356:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784191862.679360:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b93b2b5/0xfeec3c2dc5a4aad0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679365:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9400 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.679369:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b93b2b5/0xfeec3c2dc5a4aad0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679376:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b93b2b5/0xfeec3c2dc5a4aad0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679385:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b93b2b5/0xfeec3c2dc5a4aad0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679391:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b93b2b5/0xfeec3c2dc5a4aad0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.679402:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191862.679403:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191862.679405:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191862.681916:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784191862.685269:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.685301:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef7cfb6d/0xfeec3c2dc5a4aad7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685330:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x87:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.685337:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x87:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.685345:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef7cfb6d/0xfeec3c2dc5a4aad7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685364:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef7cfb6d/0xfeec3c2dc5a4aad7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685378:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef7cfb6d/0xfeec3c2dc5a4aad7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685398:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef7cfb6d/0xfeec3c2dc5a4aad7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685435:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784191862.685632:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.685638:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f891bfd9/0xfeec3c2dc5a4aade lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685648:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x86:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.685650:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x86:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.685654:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f891bfd9/0xfeec3c2dc5a4aade lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685663:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f891bfd9/0xfeec3c2dc5a4aade lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685671:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f891bfd9/0xfeec3c2dc5a4aade lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685678:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f891bfd9/0xfeec3c2dc5a4aade lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685716:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784191862.685764:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.685770:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a8b649d/0xfeec3c2dc5a4aae5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685784:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x85:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.685787:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x85:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.685791:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a8b649d/0xfeec3c2dc5a4aae5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685800:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a8b649d/0xfeec3c2dc5a4aae5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685807:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a8b649d/0xfeec3c2dc5a4aae5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685815:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a8b649d/0xfeec3c2dc5a4aae5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685823:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1784191862.685863:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.685867:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4aaec lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685875:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x84:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.685878:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x84:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.685882:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4aaec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685889:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4aaec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685909:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4aaec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685916:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4aaec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685924:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1784191862.685965:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.685970:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c6d270f/0xfeec3c2dc5a4aaf3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685978:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x83:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.685981:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x83:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.685985:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c6d270f/0xfeec3c2dc5a4aaf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.685994:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c6d270f/0xfeec3c2dc5a4aaf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.686002:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c6d270f/0xfeec3c2dc5a4aaf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.686010:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c6d270f/0xfeec3c2dc5a4aaf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.686029:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1784191862.686069:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.686074:0:160166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b51bd98e/0xfeec3c2dc5a4aafa lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.686082:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x82:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.686085:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.686089:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51bd98e/0xfeec3c2dc5a4aafa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.686098:0:160166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b51bd98e/0xfeec3c2dc5a4aafa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.686119:0:160166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b51bd98e/0xfeec3c2dc5a4aafa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.686127:0:160166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b51bd98e/0xfeec3c2dc5a4aafa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.686135:0:160166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00080000:1.0:1784191862.686561:0:160166:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000400:67 00000100:00100000:1.0:1784191862.686667:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:165492:x1870858827914880:12345-0@lo:5:osp-pre-1-1.0 Request processed in 42840us (43061us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191862.686677:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00010000:00010000:3.0:1784191862.688374:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1784191862.688387:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef7cfb6d/0xfeec3c2dc5a4aad7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688400:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9a00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.688415:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef7cfb6d/0xfeec3c2dc5a4aad7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688427:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef7cfb6d/0xfeec3c2dc5a4aad7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688448:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef7cfb6d/0xfeec3c2dc5a4aad7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688456:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef7cfb6d/0xfeec3c2dc5a4aad7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688480:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784191862.688484:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f891bfd9/0xfeec3c2dc5a4aade lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688490:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9800 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.688492:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f891bfd9/0xfeec3c2dc5a4aade lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688498:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f891bfd9/0xfeec3c2dc5a4aade lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688506:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f891bfd9/0xfeec3c2dc5a4aade lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688512:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f891bfd9/0xfeec3c2dc5a4aade lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688537:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784191862.688541:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a8b649d/0xfeec3c2dc5a4aae5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688547:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8800 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.688550:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a8b649d/0xfeec3c2dc5a4aae5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688558:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a8b649d/0xfeec3c2dc5a4aae5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688569:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a8b649d/0xfeec3c2dc5a4aae5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688575:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a8b649d/0xfeec3c2dc5a4aae5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688588:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784191862.688592:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4aaec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688598:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9c00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.688601:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4aaec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688620:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4aaec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688632:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4aaec lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688639:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4aaec lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688653:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784191862.688656:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c6d270f/0xfeec3c2dc5a4aaf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688663:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8a00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.688667:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c6d270f/0xfeec3c2dc5a4aaf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688673:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c6d270f/0xfeec3c2dc5a4aaf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688682:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c6d270f/0xfeec3c2dc5a4aaf3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688704:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c6d270f/0xfeec3c2dc5a4aaf3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688728:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784191862.688732:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b51bd98e/0xfeec3c2dc5a4aafa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688738:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9e00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191862.688742:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b51bd98e/0xfeec3c2dc5a4aafa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688749:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b51bd98e/0xfeec3c2dc5a4aafa lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688758:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b51bd98e/0xfeec3c2dc5a4aafa lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688766:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b51bd98e/0xfeec3c2dc5a4aafa lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191862.688778:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191862.688779:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191862.688781:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.689802:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191862.689878:0:165492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:165492:1870858827914880:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1784191862.689896:0:165492:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0xa1:0x0] from OST, last_created [0x2c0000400:0xa1:0x0]last_used is [0x2c0000400:0x43:0x0] 00000100:00100000:2.0:1784191862.689946:0:165492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:165492:1870858827915136:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1784191862.690077:0:165492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.690127:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827915136 00000100:00100000:2.0:1784191862.690130:0:165492:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1068ceb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784191862.690136:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827915136 00002000:00010000:2.0:1784191862.690177:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.690184:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051b00e52/0xfeec3c2dc5a4ab01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191862.690190:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1784191862.690200:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:165492:x1870858827915136:12345-0@lo:5:osp-pre-1-1.0 00010000:00010000:2.0:1784191862.690205:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa1:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.690209:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.690216:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051b00e52/0xfeec3c2dc5a4ab01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.690232:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051b00e52/0xfeec3c2dc5a4ab01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.690241:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051b00e52/0xfeec3c2dc5a4ab01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1784191862.690243:0:162386:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000400 at 162 00010000:00010000:2.0:1784191862.690249:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051b00e52/0xfeec3c2dc5a4ab01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.690264:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784191862.690671:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.690677:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004896f667/0xfeec3c2dc5a4ab08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.690811:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa0:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.690816:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.690822:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004896f667/0xfeec3c2dc5a4ab08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.690833:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004896f667/0xfeec3c2dc5a4ab08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.690855:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004896f667/0xfeec3c2dc5a4ab08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.690862:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004896f667/0xfeec3c2dc5a4ab08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.690892:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784191862.690901:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784191862.690905:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051b00e52/0xfeec3c2dc5a4ab01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.690913:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5e00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.690917:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051b00e52/0xfeec3c2dc5a4ab01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.690925:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051b00e52/0xfeec3c2dc5a4ab01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.690943:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051b00e52/0xfeec3c2dc5a4ab01 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.690950:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051b00e52/0xfeec3c2dc5a4ab01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.690981:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.690991:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004896f667/0xfeec3c2dc5a4ab08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.690997:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4800 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.691000:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004896f667/0xfeec3c2dc5a4ab08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691007:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004896f667/0xfeec3c2dc5a4ab08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691019:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004896f667/0xfeec3c2dc5a4ab08 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691026:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004896f667/0xfeec3c2dc5a4ab08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691040:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.691042:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.691044:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.691091:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.691097:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000394c8244/0xfeec3c2dc5a4ab0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691117:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9f:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.691120:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.691124:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000394c8244/0xfeec3c2dc5a4ab0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691145:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000394c8244/0xfeec3c2dc5a4ab0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691154:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000394c8244/0xfeec3c2dc5a4ab0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691160:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000394c8244/0xfeec3c2dc5a4ab0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691171:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.691178:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.691182:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000394c8244/0xfeec3c2dc5a4ab0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691188:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5000 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.691192:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000394c8244/0xfeec3c2dc5a4ab0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691201:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000394c8244/0xfeec3c2dc5a4ab0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691212:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000394c8244/0xfeec3c2dc5a4ab0f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691219:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000394c8244/0xfeec3c2dc5a4ab0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691239:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.691240:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.691242:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.691300:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.691305:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073e3f816/0xfeec3c2dc5a4ab16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691314:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9e:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.691317:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.691321:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073e3f816/0xfeec3c2dc5a4ab16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691330:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073e3f816/0xfeec3c2dc5a4ab16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691338:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073e3f816/0xfeec3c2dc5a4ab16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691345:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073e3f816/0xfeec3c2dc5a4ab16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691561:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.691571:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.691575:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073e3f816/0xfeec3c2dc5a4ab16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691593:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5600 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.691597:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073e3f816/0xfeec3c2dc5a4ab16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691604:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073e3f816/0xfeec3c2dc5a4ab16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691614:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073e3f816/0xfeec3c2dc5a4ab16 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691620:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073e3f816/0xfeec3c2dc5a4ab16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691633:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.691634:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.691635:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.691682:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.691719:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4ab1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691727:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9d:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.691730:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.691734:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4ab1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691742:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4ab1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691754:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4ab1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691760:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4ab1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691771:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.691778:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.691781:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4ab1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691787:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4a00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.691790:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4ab1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691797:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4ab1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691807:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4ab1d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691813:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3cc491a/0xfeec3c2dc5a4ab1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691824:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.691830:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.691831:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.691870:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.691874:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4ab24 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691881:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9c:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.691884:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.691888:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4ab24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691897:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4ab24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691904:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4ab24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691911:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4ab24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691921:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.691927:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.691930:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4ab24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691936:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4400 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.691939:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4ab24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691956:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4ab24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691978:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4ab24 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691985:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4ab24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.691998:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.692000:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.692002:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.692044:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.692049:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f62f0b9a/0xfeec3c2dc5a4ab2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.692059:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9b:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.692062:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.692066:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f62f0b9a/0xfeec3c2dc5a4ab2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.692075:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f62f0b9a/0xfeec3c2dc5a4ab2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.692083:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f62f0b9a/0xfeec3c2dc5a4ab2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.692098:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f62f0b9a/0xfeec3c2dc5a4ab2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.692127:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784191862.692168:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.692173:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de80b18d/0xfeec3c2dc5a4ab32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.692180:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9a:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.692183:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.692186:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de80b18d/0xfeec3c2dc5a4ab32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.692194:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de80b18d/0xfeec3c2dc5a4ab32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.692202:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de80b18d/0xfeec3c2dc5a4ab32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.692209:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de80b18d/0xfeec3c2dc5a4ab32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.692217:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1784191862.692251:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.692257:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c8885c2/0xfeec3c2dc5a4ab39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.692270:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x99:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.692273:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x99:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.692277:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c8885c2/0xfeec3c2dc5a4ab39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.692286:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c8885c2/0xfeec3c2dc5a4ab39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.692294:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c8885c2/0xfeec3c2dc5a4ab39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.692300:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c8885c2/0xfeec3c2dc5a4ab39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.692308:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1784191862.692347:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.692364:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4ab40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.692895:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784191862.692909:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f62f0b9a/0xfeec3c2dc5a4ab2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.692917:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4600 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:1.0:1784191862.692921:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f62f0b9a/0xfeec3c2dc5a4ab2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.692928:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f62f0b9a/0xfeec3c2dc5a4ab2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.692941:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f62f0b9a/0xfeec3c2dc5a4ab2b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.692948:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f62f0b9a/0xfeec3c2dc5a4ab2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.692965:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784191862.692968:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de80b18d/0xfeec3c2dc5a4ab32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.692974:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4e00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:1.0:1784191862.692977:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de80b18d/0xfeec3c2dc5a4ab32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.692985:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de80b18d/0xfeec3c2dc5a4ab32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.693007:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de80b18d/0xfeec3c2dc5a4ab32 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.693014:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de80b18d/0xfeec3c2dc5a4ab32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693020:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x98:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.693023:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x98:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191862.693027:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.693028:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4ab40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.693030:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c8885c2/0xfeec3c2dc5a4ab39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.693037:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5200 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.693039:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4ab40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.693040:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c8885c2/0xfeec3c2dc5a4ab39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.693048:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c8885c2/0xfeec3c2dc5a4ab39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693060:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4ab40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.693060:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c8885c2/0xfeec3c2dc5a4ab39 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.693068:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c8885c2/0xfeec3c2dc5a4ab39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693069:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4ab40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693078:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784191862.693079:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191862.693082:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4ab40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.693091:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5800 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:1.0:1784191862.693094:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4ab40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.693100:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4ab40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191862.693147:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.693152:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a92762e/0xfeec3c2dc5a4ab47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693164:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x97:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.693168:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x97:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.693171:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a92762e/0xfeec3c2dc5a4ab47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191862.693173:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.693180:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a92762e/0xfeec3c2dc5a4ab47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693187:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a92762e/0xfeec3c2dc5a4ab47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693193:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a92762e/0xfeec3c2dc5a4ab47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693221:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.693227:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.693231:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a92762e/0xfeec3c2dc5a4ab47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693237:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5a00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.693240:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a92762e/0xfeec3c2dc5a4ab47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693247:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a92762e/0xfeec3c2dc5a4ab47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693258:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a92762e/0xfeec3c2dc5a4ab47 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693264:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a92762e/0xfeec3c2dc5a4ab47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693276:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.693278:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.693279:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.693318:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.693323:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4ab4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693331:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x96:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.693339:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x96:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.693343:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4ab4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693472:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4ab4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693482:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4ab4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693490:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4ab4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693502:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.693508:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.693512:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4ab4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693518:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4200 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.693521:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4ab4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693528:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4ab4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693538:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4ab4e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693554:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4ab4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693567:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.693569:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.693570:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.693613:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.693619:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa5daca8/0xfeec3c2dc5a4ab55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693626:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x95:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.693630:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x95:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.693634:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa5daca8/0xfeec3c2dc5a4ab55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693643:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa5daca8/0xfeec3c2dc5a4ab55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693650:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa5daca8/0xfeec3c2dc5a4ab55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693657:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa5daca8/0xfeec3c2dc5a4ab55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693667:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.693678:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.693681:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa5daca8/0xfeec3c2dc5a4ab55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693702:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5400 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.693705:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa5daca8/0xfeec3c2dc5a4ab55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693850:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa5daca8/0xfeec3c2dc5a4ab55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693861:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa5daca8/0xfeec3c2dc5a4ab55 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693867:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa5daca8/0xfeec3c2dc5a4ab55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693880:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.693882:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.693884:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.693924:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.693929:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7246328/0xfeec3c2dc5a4ab5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693936:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x94:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.693938:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x94:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.693942:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7246328/0xfeec3c2dc5a4ab5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693959:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7246328/0xfeec3c2dc5a4ab5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693966:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7246328/0xfeec3c2dc5a4ab5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693973:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7246328/0xfeec3c2dc5a4ab5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693983:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.693989:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.693993:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7246328/0xfeec3c2dc5a4ab5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.693999:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4c00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.694002:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7246328/0xfeec3c2dc5a4ab5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694018:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7246328/0xfeec3c2dc5a4ab5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694028:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7246328/0xfeec3c2dc5a4ab5c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694035:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7246328/0xfeec3c2dc5a4ab5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694053:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.694055:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.694056:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.694097:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.694477:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4ab63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694490:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x93:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.694494:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x93:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.694498:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4ab63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694509:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4ab63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694519:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4ab63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694528:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4ab63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694542:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.694550:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.694553:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4ab63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694572:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5e00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.694576:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4ab63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694585:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4ab63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694597:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4ab63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694606:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006122c98a/0xfeec3c2dc5a4ab63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694622:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.694624:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.694626:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.694678:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.694684:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f533b2f/0xfeec3c2dc5a4ab6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694788:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x92:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.694791:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x92:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.694796:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f533b2f/0xfeec3c2dc5a4ab6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694805:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f533b2f/0xfeec3c2dc5a4ab6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694819:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f533b2f/0xfeec3c2dc5a4ab6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694825:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f533b2f/0xfeec3c2dc5a4ab6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694836:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.694843:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.694846:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f533b2f/0xfeec3c2dc5a4ab6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694852:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4e00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.694855:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f533b2f/0xfeec3c2dc5a4ab6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694862:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f533b2f/0xfeec3c2dc5a4ab6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694872:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f533b2f/0xfeec3c2dc5a4ab6a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694879:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f533b2f/0xfeec3c2dc5a4ab6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.694891:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.694898:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.694900:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191862.695002:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4ab40 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.695010:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4ab40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191862.695025:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.695027:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191862.695029:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.695030:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4ab71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.695030:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.695038:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x91:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.695041:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x91:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.695044:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4ab71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.695053:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4ab71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.695061:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4ab71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.695067:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4ab71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.695088:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784191862.695821:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191862.695829:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4ab71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191862.695838:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4800 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191862.695841:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4ab71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191862.695861:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4ab71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191862.695875:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4ab71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191862.695881:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4ab71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191862.695897:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191862.695899:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191862.695901:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191862.696265:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.697955:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.697976:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4ab78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.697992:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x90:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.697996:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x90:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.698001:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4ab78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.698022:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4ab78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.698032:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4ab78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.698040:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4ab78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.698064:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.698077:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.698083:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4ab78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.698090:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5000 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.698096:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4ab78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.698116:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4ab78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.698131:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4ab78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.698139:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4ab78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.698167:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.698169:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.698171:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.698229:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.698235:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1fb0ce4/0xfeec3c2dc5a4ab7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.698243:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8f:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.698246:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.698250:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1fb0ce4/0xfeec3c2dc5a4ab7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.698260:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1fb0ce4/0xfeec3c2dc5a4ab7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.698268:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1fb0ce4/0xfeec3c2dc5a4ab7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.698275:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1fb0ce4/0xfeec3c2dc5a4ab7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.698291:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.698298:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.698302:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1fb0ce4/0xfeec3c2dc5a4ab7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.698320:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5600 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.698324:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1fb0ce4/0xfeec3c2dc5a4ab7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.698331:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1fb0ce4/0xfeec3c2dc5a4ab7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.698342:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1fb0ce4/0xfeec3c2dc5a4ab7f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.698349:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1fb0ce4/0xfeec3c2dc5a4ab7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.699855:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.699858:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.699860:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.699956:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.699964:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030be1520/0xfeec3c2dc5a4ab86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.699976:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8e:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.699980:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.699985:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030be1520/0xfeec3c2dc5a4ab86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.699998:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030be1520/0xfeec3c2dc5a4ab86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.700018:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030be1520/0xfeec3c2dc5a4ab86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.700025:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030be1520/0xfeec3c2dc5a4ab86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.700052:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784191862.700077:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191862.700085:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030be1520/0xfeec3c2dc5a4ab86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.700094:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5800 already unused, calling callback (ffffffffc0d7c230) 00002000:00010000:2.0:1784191862.700095:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191862.700099:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030be1520/0xfeec3c2dc5a4ab86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.700100:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4ab8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.700119:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8d:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:1.0:1784191862.700119:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030be1520/0xfeec3c2dc5a4ab86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.700122:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.700126:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4ab8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.700136:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4ab8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.700143:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4ab8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.700143:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030be1520/0xfeec3c2dc5a4ab86 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.700151:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4ab8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.700152:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030be1520/0xfeec3c2dc5a4ab86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.700166:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191862.700167:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.700173:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:0.0:1784191862.702875:0:160977:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869232 is committed 00000001:00100000:0.0:1784191862.702933:0:160977:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:1.0:1784191862.703228:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191862.703238:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4ab8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.703252:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4400 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:1.0:1784191862.703258:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4ab8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.703270:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4ab8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.703305:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4ab8d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.703314:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4ab8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191862.703360:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191862.703362:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191862.703364:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1784191862.704421:0:162386:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000400 at 170 00000001:00080000:3.0:1784191862.705265:0:162386:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869232 00002000:00080000:3.0:1784191862.705297:0:162386:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000400 at 178 00000001:00080000:3.0:1784191862.705820:0:162386:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869233 00002000:00080000:3.0:1784191862.705838:0:162386:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000400 at 186 00000001:00080000:3.0:1784191862.706952:0:162386:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869234 00010000:00010000:2.0:1784191862.707649:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.707910:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.707920:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062d35918/0xfeec3c2dc5a4ab94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.707938:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8c:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.707943:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.707950:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062d35918/0xfeec3c2dc5a4ab94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.707981:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062d35918/0xfeec3c2dc5a4ab94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.707994:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062d35918/0xfeec3c2dc5a4ab94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.708001:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062d35918/0xfeec3c2dc5a4ab94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.708020:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.708030:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.708036:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062d35918/0xfeec3c2dc5a4ab94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.708044:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4200 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.708061:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062d35918/0xfeec3c2dc5a4ab94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.708071:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062d35918/0xfeec3c2dc5a4ab94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.708087:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062d35918/0xfeec3c2dc5a4ab94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.708095:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062d35918/0xfeec3c2dc5a4ab94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.708127:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.708129:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.708131:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.708179:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.708184:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080082b14/0xfeec3c2dc5a4ab9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.708193:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8b:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.708196:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.708200:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080082b14/0xfeec3c2dc5a4ab9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.708209:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080082b14/0xfeec3c2dc5a4ab9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.708217:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080082b14/0xfeec3c2dc5a4ab9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.708230:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080082b14/0xfeec3c2dc5a4ab9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.708247:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.708256:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.708260:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080082b14/0xfeec3c2dc5a4ab9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.708268:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4c00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.708271:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080082b14/0xfeec3c2dc5a4ab9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.708279:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080082b14/0xfeec3c2dc5a4ab9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.708292:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080082b14/0xfeec3c2dc5a4ab9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.708299:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080082b14/0xfeec3c2dc5a4ab9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.708312:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.708314:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.708316:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.708932:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.708948:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4aba2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.708959:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8a:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.709026:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.709034:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4aba2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709046:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4aba2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709055:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4aba2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709063:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4aba2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709078:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.709090:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.709094:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4aba2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709111:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4600 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.709115:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4aba2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709124:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4aba2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709145:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4aba2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709153:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4aba2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709170:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.709171:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.709173:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.709243:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.709249:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4aba9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709257:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x89:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.709260:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x89:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.709265:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4aba9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709274:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4aba9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709281:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4aba9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709289:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4aba9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709312:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.709321:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.709324:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4aba9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709331:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4a00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.709335:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4aba9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709343:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4aba9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709539:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4aba9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709549:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4aba9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709564:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.709566:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.709568:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.709614:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.709619:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4abb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709627:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x88:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.709638:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x88:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.709642:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4abb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709652:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4abb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709659:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4abb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709666:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4abb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709678:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.709685:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.709783:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4abb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709792:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5a00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.709796:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4abb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709803:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4abb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709814:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4abb0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709832:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4abb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.709847:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.709849:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.709850:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.709949:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.709955:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4abb7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710047:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x87:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.710052:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x87:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.710057:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4abb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710068:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4abb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710075:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4abb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710082:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4abb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710094:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.710119:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.710123:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4abb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710130:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5c00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.710133:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4abb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710140:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4abb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710151:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4abb7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710157:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4abb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710170:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.710171:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.710173:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.710213:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.710218:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083040df4/0xfeec3c2dc5a4abbe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191862.710221:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:165492:x1870858827915136:12345-0@lo:5:osp-pre-1-1.0 Request processed in 20017us (20140us total) trans 17179869235 rc 0/0 00010000:00010000:2.0:1784191862.710225:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x86:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.710228:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x86:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1784191862.710232:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00010000:00010000:2.0:1784191862.710232:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083040df4/0xfeec3c2dc5a4abbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784191862.710240:0:162386:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00010000:00010000:2.0:1784191862.710250:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083040df4/0xfeec3c2dc5a4abbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710257:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083040df4/0xfeec3c2dc5a4abbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710263:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083040df4/0xfeec3c2dc5a4abbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710275:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.710281:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.710284:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083040df4/0xfeec3c2dc5a4abbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710290:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4000 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.710292:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083040df4/0xfeec3c2dc5a4abbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710299:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083040df4/0xfeec3c2dc5a4abbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191862.710305:0:165492:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869232 gen 2 00010000:00010000:2.0:1784191862.710308:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083040df4/0xfeec3c2dc5a4abbe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191862.710315:0:165492:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8af10d29e680 x1870858827915136/t17179869235(17179869235) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784191878 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1784191862.710315:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083040df4/0xfeec3c2dc5a4abbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191862.710327:0:165492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:165492:1870858827915136:0@lo:5:osp-pre-1-1.0 00010000:00010000:2.0:1784191862.710333:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.710335:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.710336:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784191862.710344:0:165492:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0xa1:0x0]-[0x2c0000400:0xc1:0x0] 00000100:00100000:3.0:1784191862.710390:0:165492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d636a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:165492:1870858827915264:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1784191862.710429:0:165492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.710453:0:165492:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef50900 going to sleep for 11 seconds 00000100:00100000:3.0:1784191862.710471:0:158676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827915264 00000100:00100000:3.0:1784191862.710477:0:158676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827915264 00000100:00100000:3.0:1784191862.710520:0:158676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784191862.710528:0:158676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:165492:x1870858827915264:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1784191862.710584:0:158676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:165492:x1870858827915264:12345-0@lo:900:osp-pre-1-1.0 Request processed in 56us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191862.710591:0:158676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784191862.710625:0:165492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d636a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:165492:1870858827915264:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1784191862.710908:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.710915:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4abc5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710924:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x85:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.710927:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x85:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.710932:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4abc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710941:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4abc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710949:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4abc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710955:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4abc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.710981:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.710989:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.710993:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4abc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711010:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5200 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.711012:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4abc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711020:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4abc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711031:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4abc5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711038:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4abc5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711052:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.711053:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.711055:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.711112:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.711118:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003af6ff5d/0xfeec3c2dc5a4abcc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711126:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x84:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.711129:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x84:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.711133:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003af6ff5d/0xfeec3c2dc5a4abcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711143:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003af6ff5d/0xfeec3c2dc5a4abcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711156:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003af6ff5d/0xfeec3c2dc5a4abcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711164:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003af6ff5d/0xfeec3c2dc5a4abcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711176:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.711183:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.711187:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003af6ff5d/0xfeec3c2dc5a4abcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711193:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e400 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.711196:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003af6ff5d/0xfeec3c2dc5a4abcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711202:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003af6ff5d/0xfeec3c2dc5a4abcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711213:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003af6ff5d/0xfeec3c2dc5a4abcc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711219:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003af6ff5d/0xfeec3c2dc5a4abcc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711232:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.711240:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.711242:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191862.711294:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191862.711299:0:162396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4abd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711306:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x83:0x0].0x0 since=5482s v=(0 0) 00010000:00010000:2.0:1784191862.711310:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x83:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191862.711314:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4abd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711322:0:162396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4abd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711330:0:162396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4abd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711336:0:162396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4abd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711347:0:162396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191862.711528:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191862.711534:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4abd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711542:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ee00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191862.711546:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4abd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711565:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4abd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711579:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4abd3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711585:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023b61243/0xfeec3c2dc5a4abd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191862.711598:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.711599:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191862.711601:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1784191862.711636:0:162396:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:130 00000100:00100000:2.0:1784191862.711930:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+6:165490:x1870858827915008:12345-0@lo:5:osp-pre-0-1.0 Request processed in 65425us (65700us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191862.711941:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1784191862.712860:0:165490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233154000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:165490:1870858827915008:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1784191862.712880:0:165490:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0xa1:0x0] from OST, last_created [0x280000400:0xa1:0x0]last_used is [0x280000400:0x82:0x0] 00000100:00100000:1.0:1784191862.712936:0:165490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:165490:1870858827915392:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1784191862.712986:0:165490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191862.713031:0:165490:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233dfee40 going to sleep for 11 seconds 00000100:00100000:2.0:1784191862.714648:0:162390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827915392 00000100:00100000:2.0:1784191862.714661:0:162390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827915392 00000100:00100000:2.0:1784191862.714741:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1784191862.714752:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+6:165490:x1870858827915392:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1784191862.714800:0:162390:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000400 at 162 00000001:00080000:1.0:1784191862.723261:0:160160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836541 is committed 00000001:00100000:1.0:1784191862.723308:0:160160:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00002000:00080000:2.0:1784191862.723472:0:162390:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000400 at 170 00000001:00080000:2.0:1784191862.724217:0:162390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836541 00002000:00080000:2.0:1784191862.724246:0:162390:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000400 at 178 00000001:00080000:2.0:1784191862.725160:0:162390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836542 00002000:00080000:2.0:1784191862.725180:0:162390:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000400 at 186 00000001:00080000:2.0:1784191862.725852:0:162390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836543 00000100:00100000:2.0:1784191862.725963:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:165490:x1870858827915392:12345-0@lo:5:osp-pre-0-1.0 Request processed in 11209us (12972us total) trans 21474836544 rc 0/0 00000100:00100000:2.0:1784191862.725975:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00080000:2.0:1784191862.725981:0:162390:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00000100:00100000:3.0:1784191862.728299:0:165490:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836541 gen 2 00000100:00100000:3.0:1784191862.728319:0:165490:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8af2331d6300 x1870858827915392/t21474836544(21474836544) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784191878 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784191862.728335:0:165490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:165490:1870858827915392:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1784191862.728354:0:165490:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0xa1:0x0]-[0x280000400:0xc1:0x0] 00000100:00100000:3.0:1784191862.728406:0:165490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d636a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:165490:1870858827915520:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1784191862.728468:0:165490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191862.728501:0:165490:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef50f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784191862.729135:0:158676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827915520 00000100:00100000:2.0:1784191862.729144:0:158676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827915520 00000100:00100000:2.0:1784191862.729188:0:158676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784191862.729196:0:158676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:165490:x1870858827915520:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1784191862.729248:0:158676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:165490:x1870858827915520:12345-0@lo:900:osp-pre-0-1.0 Request processed in 52us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191862.729255:0:158676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784191862.729337:0:165490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d636a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:165490:1870858827915520:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1784191862.859861:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191863.644151:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191863.644237:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191863.644369:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812340992 00000100:00100000:2.0:1784191863.644383:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812340992 00000100:00100000:2.0:1784191863.644437:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 430 00000100:00100000:2.0:1784191863.644446:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:69108:x1870858812340992:12345-192.168.204.16@tcp:38:kworker.0 00010000:00080000:2.0:1784191863.644488:0:158667:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp t21474836527 exp 0000000000000000 cur 5483 last 0 00000020:00000080:2.0:1784191863.644550:0:158667:0:(genops.c:1406:class_connect()) connect: client 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a, cookie 0xfeec3c2dc5a4abda 00000004:00100000:2.0:1784191863.644578:0:158667:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000001:00000004:2.0:1784191863.644585:0:158667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 25769803776 00000100:00100000:0.0:1784191863.644774:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191863.649777:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191863.649825:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191863.649860:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812340864 00000100:00100000:1.0:1784191863.649870:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812340864 00000100:00100000:1.0:1784191863.649940:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 316 00000100:00100000:1.0:1784191863.649951:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812340864:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191863.650037:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812340864:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 87us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191863.650046:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 316 00000100:00080000:1.0:1784191863.650071:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784191863.652160:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812341120 00000100:00100000:2.0:1784191863.652173:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812341120 00000100:00100000:2.0:1784191863.652391:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812341248 00000100:00100000:2.0:1784191863.652396:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812341248 00000100:00100000:2.0:1784191863.652425:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 243 00000100:00100000:2.0:1784191863.652435:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69108:x1870858812341120:12345-192.168.204.16@tcp:9:kworker.0 00000020:00000080:2.0:1784191863.652464:0:162391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4a566 00000100:00080000:2.0:1784191863.652486:0:162391:0:(import.c:65:import_set_state_nolock()) ffff8af109050000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784191863.652533:0:162391:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836544 00000100:00100000:2.0:1784191863.652708:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+2:69108:x1870858812341120:12345-192.168.204.16@tcp:9:kworker.0 Request processed in 256us (8453us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191863.652717:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 243 00000100:00100000:2.0:1784191863.652733:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 244 00000100:00100000:2.0:1784191863.652740:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69108:x1870858812341248:12345-192.168.204.16@tcp:9:kworker.0 00000020:00000080:2.0:1784191863.652751:0:162391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4a56d 00000100:00080000:2.0:1784191863.652757:0:162391:0:(import.c:65:import_set_state_nolock()) ffff8af22dcdb800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784191863.652781:0:162391:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869235 00000100:00100000:2.0:1784191863.652848:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+2:69108:x1870858812341248:12345-192.168.204.16@tcp:9:kworker.0 Request processed in 108us (8073us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191863.652855:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 244 00010000:00010000:2.0:1784191863.652895:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191863.652901:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191863.653579:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812340736 00000100:00100000:3.0:1784191863.653588:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812340736 00000100:00100000:3.0:1784191863.653649:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 274 00000100:00100000:3.0:1784191863.653658:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+9:69111:x1870858812340736:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191863.653713:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+9:69111:x1870858812340736:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 56us (3950us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191863.653720:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 274 00000100:00080000:2.0:1784191863.656912:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784191863.656924:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784191863.664194:0:158667:0:(import.c:65:import_set_state_nolock()) ffff8af10de03800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784191863.664284:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69108:x1870858812340992:12345-192.168.204.16@tcp:38:kworker.0 Request processed in 19835us (20142us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191863.664296:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 430 00000100:00100000:3.0:1784191863.830034:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191863.830098:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812341376 00000100:00100000:3.0:1784191863.830107:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812341376 00000100:00100000:3.0:1784191863.830498:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 275 00000100:00100000:3.0:1784191863.830510:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+9:122642:x1870858812341376:12345-192.168.204.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784191863.830530:0:158659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191863.830552:0:158659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af110db3000/0xfeec3c2dc5a4abe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b6b6 expref: -99 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191863.830596:0:158659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af110db3000/0xfeec3c2dc5a4abe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6b6 expref: 10 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191863.830609:0:158659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af110db3000/0xfeec3c2dc5a4abe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6b6 expref: 10 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191863.830618:0:158659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3000, rc 0) 00000100:00100000:3.0:1784191863.830844:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:122642:x1870858812341376:12345-192.168.204.16@tcp:101:ll_cfg_requeue.0 Request processed in 335us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191863.830852:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 275 00000100:00100000:2.0:1784191863.835894:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191863.836298:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812341504 00000100:00100000:3.0:1784191863.836310:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812341504 00000100:00100000:3.0:1784191863.836377:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 276 00000100:00100000:3.0:1784191863.836388:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:122642:x1870858812341504:12345-192.168.204.16@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784191863.836421:0:158660:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1784191863.836442:0:158660:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784191863.836445:0:158660:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 37 00000100:00100000:3.0:1784191863.850493:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:122642:x1870858812341504:12345-192.168.204.16@tcp:256:ll_cfg_requeue.0 Request processed in 14096us (14599us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191863.850508:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 276 00010000:00010000:1.0:1784191863.883851:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784191863.948641:0:158662:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784191863.948651:0:158662:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8af22dcd8000 from 37 10000000:01000000:3.0:1784191863.948657:0:158662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784191863.948738:0:158662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af110db2800/0xfeec3c2dc5a4abe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191863.948751:0:158662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af110db2800/0xfeec3c2dc5a4abe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191863.948784:0:158662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af110db2800/0xfeec3c2dc5a4abe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191863.948813:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827915648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784191863.948884:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191863.948933:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af104f1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1784191863.948996:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827915648 00000100:00100000:0.0:1784191863.949005:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827915648 00000100:00100000:0.0:1784191863.949068:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1784191863.949089:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:158662:x1870858827915648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784191863.949105:0:158658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191863.949134:0:158658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af10de3f400/0xfeec3c2dc5a4abef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4abe8 expref: -99 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191863.949164:0:158658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af10de3f400/0xfeec3c2dc5a4abef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4abe8 expref: 23 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191863.949183:0:158658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af10de3f400/0xfeec3c2dc5a4abef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4abe8 expref: 23 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191863.949193:0:158658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3f400, rc 0) 00000100:00100000:0.0:1784191863.949243:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:158662:x1870858827915648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191863.949464:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1784191863.952501:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827915648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784191863.952533:0:158662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af110db2800/0xfeec3c2dc5a4abe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4abef expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191863.952548:0:158662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af110db2800/0xfeec3c2dc5a4abe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4abef expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191863.952655:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827915776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784191863.952774:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191863.952825:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af104f1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1784191863.952968:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827915776 00000100:00100000:0.0:1784191863.952976:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827915776 00000100:00100000:0.0:1784191863.953034:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1784191863.953045:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:158662:x1870858827915776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784191863.953088:0:158660:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784191863.953120:0:158660:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784191863.953123:0:158660:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 37 00000100:00100000:0.0:1784191863.953248:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:158662:x1870858827915776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 204us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191863.953255:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1784191863.953419:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827915776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784191863.953472:0:158662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784191863.953485:0:158662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af110db2800/0xfeec3c2dc5a4abe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4abef expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191863.953495:0:158662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af110db2800/0xfeec3c2dc5a4abe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4abef expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191863.953507:0:158662:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784191863.953510:0:158662:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8af202ccc000 from 37 10000000:01000000:1.0:1784191863.953513:0:158662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784191863.953539:0:158662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4abf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191863.953548:0:158662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4abf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191863.953557:0:158662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4abf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191863.953572:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827915904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784191863.953605:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191863.953643:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233dfe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191863.953781:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827915904 00000100:00100000:2.0:1784191863.953787:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827915904 00000100:00100000:2.0:1784191863.953825:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1784191863.953833:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:158662:x1870858827915904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784191863.953844:0:158659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191863.953865:0:158659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af20cd7f800/0xfeec3c2dc5a4abfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4abf6 expref: -99 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191863.953888:0:158659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af20cd7f800/0xfeec3c2dc5a4abfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4abf6 expref: 24 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191863.953899:0:158659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af20cd7f800/0xfeec3c2dc5a4abfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4abf6 expref: 24 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191863.953908:0:158659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f800, rc 0) 00000100:00100000:2.0:1784191863.954356:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:158662:x1870858827915904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 523us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191863.954364:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1784191863.954945:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827915904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784191863.954967:0:158662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4abf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4abfd expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191863.954978:0:158662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4abf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4abfd expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191863.955036:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827916032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784191863.955110:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191863.955150:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233dfe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191863.955748:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827916032 00000100:00100000:2.0:1784191863.955756:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827916032 00000100:00100000:2.0:1784191863.955852:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1784191863.955862:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:158662:x1870858827916032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784191863.955885:0:158659:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784191863.955907:0:158659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784191863.955911:0:158659:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 37 00000100:00100000:2.0:1784191863.956019:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:158662:x1870858827916032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 158us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191863.956027:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1784191863.956120:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827916032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784191863.956190:0:158662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784191863.956199:0:158662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4abf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4abfd expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191863.956210:0:158662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4abf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4abfd expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191864.908056:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191865.868022:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784191865.868052:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827916160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784191865.868127:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191865.868170:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827916160 00000100:00100000:0.0:1784191865.868176:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827916160 00000100:00100000:0.0:1784191865.868226:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784191865.868234:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827916160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784191865.868267:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71049216 avail 63881216 00000100:00100000:0.0:1784191865.868304:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827916160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191865.868326:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:0.0:1784191865.868346:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191865.868379:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827916160:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784191865.931906:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191866.956911:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784191867.229525:0:165748:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1784191867.404389:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827916288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191867.404472:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191867.406394:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827916416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784191867.406467:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191867.406520:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827916288 00000100:00100000:1.0:1784191867.406527:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827916288 00000100:00100000:1.0:1784191867.406576:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827916416 00000100:00100000:1.0:1784191867.406580:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827916416 00000100:00100000:1.0:1784191867.406598:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784191867.406606:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:106499:x1870858827916288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784191867.406636:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71184384 avail 64016384 00000100:00100000:1.0:1784191867.406678:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:106499:x1870858827916288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (2206us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191867.406685:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784191867.406720:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784191867.406734:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827916416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784191867.406745:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71184384 avail 64016384 00000100:00100000:1.0:1784191867.406776:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827916416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191867.406781:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:1.0:1784191867.406802:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784191867.406839:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827916416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784191867.406877:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827916288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784191867.409416:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827916544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191867.409492:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191867.409553:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827916544 00000100:00100000:0.0:1784191867.409560:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827916544 00000100:00100000:0.0:1784191867.409607:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:0.0:1784191867.409616:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827916544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784191867.409659:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42549248 avail 36417536 00000100:00100000:0.0:1784191867.409723:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827916544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191867.409731:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:0.0:1784191867.409772:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827916544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784191867.412988:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784191867.413021:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827916672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784191867.413091:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191867.413143:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827916672 00000100:00100000:3.0:1784191867.413151:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827916672 00000100:00100000:3.0:1784191867.413206:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784191867.413216:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:106501:x1870858827916672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784191867.413257:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71049216 avail 63881216 00000100:00100000:3.0:1784191867.413305:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:106501:x1870858827916672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191867.413320:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1784191867.413347:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784191867.413383:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827916672:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784191867.922465:0:70119:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784191867.922471:0:70119:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1784191867.922475:0:70119:0:(import.c:65:import_set_state_nolock()) ffff8af10f422800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784191867.922485:0:70119:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 5482 00000100:00080000:1.0:1784191867.922492:0:70119:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784191867.922500:0:70119:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8af10f422800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191867.922525:0:70119:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af104c78700 x1870858827916928/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784191867.922585:0:70119:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784191867.922588:0:70119:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1784191867.922590:0:70119:0:(import.c:65:import_set_state_nolock()) ffff8af10c3ad800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784191867.922594:0:70119:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 5482 00000100:00080000:1.0:1784191867.922596:0:70119:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784191867.922600:0:70119:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8af10c3ad800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191867.922610:0:70119:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af20d5c9500 x1870858827917568/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784191867.922640:0:70119:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784191867.922644:0:70119:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1784191867.922645:0:70119:0:(import.c:65:import_set_state_nolock()) ffff8af23f2db000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784191867.922649:0:70119:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 5482 00000100:00080000:1.0:1784191867.922651:0:70119:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784191867.922655:0:70119:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8af23f2db000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191867.922665:0:70119:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af20d5c9880 x1870858827917824/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784191867.925855:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858827917312:0@lo:400:kworker.0 00000100:00100000:0.0:1784191867.925935:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191867.925986:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827918080:0@lo:400:kworker.0 00000100:00100000:0.0:1784191867.926021:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191867.926052:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784191867.926059:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827917184:0@lo:400:kworker.0 00000100:00100000:0.0:1784191867.926087:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191867.926107:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827917952:0@lo:400:kworker.0 00000100:00100000:0.0:1784191867.926131:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191867.926167:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827918080 00000100:00100000:3.0:1784191867.926280:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827917184 00000100:00100000:3.0:1784191867.926289:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827917184 00000100:00100000:3.0:1784191867.926344:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784191867.926354:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1051f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827917184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191867.926426:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1051f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827917184:12345-0@lo:400:kworker.0 Request processed in 74us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191867.926432:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784191867.926548:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827917312 00000100:00100000:2.0:1784191867.926552:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827917312 00000100:00100000:2.0:1784191867.926593:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1784191867.926601:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858827917312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191867.926651:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858827917312:12345-0@lo:400:kworker.0 Request processed in 51us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191867.926658:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1784191867.926679:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827917952 00000100:00100000:2.0:1784191867.926683:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827917952 00000100:00100000:2.0:1784191867.926767:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:2.0:1784191867.926774:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827917952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191867.926809:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827917952:12345-0@lo:400:kworker.0 Request processed in 35us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191867.926816:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1784191867.926895:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827918080 00000100:00100000:0.0:1784191867.926933:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1784191867.926939:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+8:106502:x1870858827918080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191867.926973:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+8:106502:x1870858827918080:12345-0@lo:400:kworker.0 Request processed in 35us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191867.926980:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1784191867.927278:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827917184:0@lo:400:kworker.0 00000100:00100000:0.0:1784191867.927291:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827917952:0@lo:400:kworker.0 00000100:00100000:0.0:1784191867.927301:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858827917312:0@lo:400:kworker.0 00000100:00100000:0.0:1784191867.927311:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827918080:0@lo:400:kworker.0 00000100:00100000:2.0:1784191867.929329:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827916800:0@lo:400:kworker.0 00000100:00100000:2.0:1784191867.929403:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191867.929452:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858827917440:0@lo:400:kworker.0 00000100:00100000:2.0:1784191867.929477:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191867.929501:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827918208:0@lo:400:kworker.0 00000100:00100000:2.0:1784191867.929521:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191867.929544:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784191867.929550:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827917056:0@lo:400:kworker.0 00000100:00100000:2.0:1784191867.929568:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191867.929581:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858827917696:0@lo:400:kworker.0 00000100:00100000:2.0:1784191867.929598:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191867.929613:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858827918336:0@lo:400:kworker.0 00000100:00100000:2.0:1784191867.929635:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191867.929662:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827917440 00000100:00100000:2.0:1784191867.929669:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827917440 00000100:00100000:2.0:1784191867.929742:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827917696 00000100:00100000:2.0:1784191867.929745:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827917696 00000100:00100000:2.0:1784191867.929761:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827918336 00000100:00100000:2.0:1784191867.929763:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827918336 00000100:00100000:2.0:1784191867.929776:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1784191867.929784:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858827917440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191867.929837:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858827917440:12345-0@lo:400:kworker.0 Request processed in 53us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191867.929845:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1784191867.929860:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1784191867.929865:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858827917696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191867.929885:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858827917696:12345-0@lo:400:kworker.0 Request processed in 20us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191867.929890:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1784191867.929901:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1784191867.929906:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858827918336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191867.929929:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858827918336:12345-0@lo:400:kworker.0 Request processed in 23us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191867.929935:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1784191867.929973:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858827917696:0@lo:400:kworker.0 00000100:00100000:2.0:1784191867.929982:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858827918336:0@lo:400:kworker.0 00000100:00100000:2.0:1784191867.929990:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858827917440:0@lo:400:kworker.0 00000100:00080000:3.0:1784191867.930098:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784191867.931325:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827916800 00000100:00100000:0.0:1784191867.931337:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827916800 00000100:00100000:0.0:1784191867.931388:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1784191867.931396:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858827916800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191867.931473:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858827916800:12345-0@lo:400:kworker.0 Request processed in 78us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191867.931481:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1784191867.931520:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827918208 00000100:00100000:0.0:1784191867.931524:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827918208 00000100:00100000:0.0:1784191867.931556:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827917056 00000100:00100000:0.0:1784191867.931559:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827917056 00000100:00100000:0.0:1784191867.931590:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1784191867.931597:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:106499:x1870858827918208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191867.931631:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:106499:x1870858827918208:12345-0@lo:400:kworker.0 Request processed in 34us (2109us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191867.931645:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1784191867.931656:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784191867.931660:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827917056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191867.931708:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827917056:12345-0@lo:400:kworker.0 Request processed in 46us (2137us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191867.931714:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784191867.931762:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827917056:0@lo:400:kworker.0 00000100:00100000:0.0:1784191867.931772:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827916800:0@lo:400:kworker.0 00000100:00100000:0.0:1784191867.931784:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827918208:0@lo:400:kworker.0 00000100:00080000:0.0:1784191867.931823:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784191867.932083:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827916928:0@lo:38:kworker.0 00000100:00100000:1.0:1784191867.932129:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191867.932167:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:106498:1870858827917568:0@lo:38:kworker.0 00000100:00100000:1.0:1784191867.932418:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191867.932486:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:106498:1870858827917824:0@lo:38:kworker.0 00000100:00100000:1.0:1784191867.932511:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191867.932554:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827916928 00000100:00100000:0.0:1784191867.932560:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827916928 00000100:00100000:0.0:1784191867.932591:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:0.0:1784191867.932596:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:106498:x1870858827916928:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784191867.932624:0:158670:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 5488 last 0 00000020:00000080:0.0:1784191867.932660:0:158670:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeec3c2dc5a4ac04 00000004:00100000:0.0:1784191867.932675:0:158670:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784191867.932880:0:158670:0:(import.c:65:import_set_state_nolock()) ffff8af23ea11800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784191867.932926:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:106498:x1870858827916928:12345-0@lo:38:kworker.0 Request processed in 329us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191867.932933:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00080000:1.0:1784191867.936094:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 6 00000100:00080000:1.0:1784191867.936130:0:106498:0:(import.c:1338:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-osp-MDT0000: evicting (reconnect/recover flags not set: 4) req@ffff8af104c78700 x1870858827916928/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/416 e 0 to 0 dl 1784191892 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784191867.936142:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10f422800 lustre-MDT0001_UUID: changing import state from CONNECTING to EVICTED 00000100:02020000:1.0:1784191867.936148:0:106498:0:(import.c:1663:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-osp-MDT0000: This client was evicted by lustre-MDT0001; in progress operations using this service will fail. 00000100:00100000:2.0:1784191867.941407:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827917568 00000100:00100000:2.0:1784191867.941423:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827917568 00000100:00100000:2.0:1784191867.941491:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827917824 00000100:00100000:2.0:1784191867.941495:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827917824 00000100:00100000:2.0:1784191867.941544:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1784191867.941552:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:106498:x1870858827917568:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784191867.941590:0:158667:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 5488 last 0 00000020:00000080:2.0:1784191867.941634:0:158667:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xfeec3c2dc5a4ac0b 00000004:00100000:2.0:1784191867.941653:0:158667:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784191867.941713:0:158667:0:(import.c:65:import_set_state_nolock()) ffff8af109024000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784191867.941808:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:106498:x1870858827917568:12345-0@lo:38:kworker.0 Request processed in 255us (9389us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191867.941816:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1784191867.941835:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:2.0:1784191867.941839:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:106498:x1870858827917824:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784191867.941854:0:158667:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 5488 last 0 00000020:00000080:2.0:1784191867.941880:0:158667:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xfeec3c2dc5a4ac12 00000004:00100000:2.0:1784191867.941888:0:158667:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784191867.941903:0:158667:0:(import.c:65:import_set_state_nolock()) ffff8af109021800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784191867.941933:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106498:x1870858827917824:12345-0@lo:38:kworker.0 Request processed in 92us (9421us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191867.941939:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00080000:1.0:1784191867.948000:0:106498:0:(import.c:1674:ptlrpc_import_recovery_state_machine()) evicted from lustre-MDT0001_UUID@0@lo; invalidating 00000100:00100000:2.0:1784191867.948449:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827916928:0@lo:38:kworker.0 00010000:00080000:2.0:1784191867.948494:0:106498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af20d5c9500 x1870858827917568/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784191887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784191867.948514:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 6 00000100:00080000:1.0:1784191867.949318:0:165781:0:(import.c:1598:ptlrpc_invalidate_import_thread()) thread invalidate import lustre-MDT0001-osp-MDT0000 to lustre-MDT0001_UUID@0@lo 00000100:00080000:1.0:1784191867.949324:0:165781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784191867.949333:0:165781:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8af10db4df80 x1870858827903872/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784191871 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784191867.949370:0:165781:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474836522 gen 3 00000100:00100000:1.0:1784191867.949377:0:165781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1784191867.949605:0:106498:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0000: lwp recover req@ffff8af20d5c9500 x1870858827917568/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784191887 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784191867.949614:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10c3ad800 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1784191867.949627:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10c3ad800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1784191867.949631:0:106498:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784191867.950307:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827903872:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1784191867.953842:0:165781:0:(import.c:65:import_set_state_nolock()) ffff8af10f422800 lustre-MDT0001_UUID: changing import state from EVICTED to RECOVER 00000100:00080000:1.0:1784191867.953853:0:165781:0:(import.c:65:import_set_state_nolock()) ffff8af10f422800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784191867.953872:0:165781:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-osp-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1784191867.956425:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784191867.956453:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827918464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784191867.956527:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191867.956585:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827918464 00000100:00100000:3.0:1784191867.956593:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827918464 00000100:00100000:3.0:1784191867.956643:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:3.0:1784191867.956653:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:106502:x1870858827918464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784191867.956709:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42651648 avail 36519936 00000100:00100000:3.0:1784191867.956758:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:106502:x1870858827918464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191867.956765:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:3.0:1784191867.956814:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827918464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784191867.969785:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:106498:1870858827917568:0@lo:38:kworker.0 00010000:00080000:2.0:1784191867.971956:0:106498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af20d5c9880 x1870858827917824/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784191887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784191867.971979:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 6 00000100:00080000:2.0:1784191867.972782:0:106498:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0001: lwp recover req@ffff8af20d5c9880 x1870858827917824/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784191887 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784191867.972795:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23f2db000 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1784191867.972800:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23f2db000 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1784191867.972804:0:106498:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1784191867.972809:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:106498:1870858827917824:0@lo:38:kworker.0 00010000:00010000:3.0:1784191867.984017:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784191868.199346:0:165802:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784191868.199618:0:165802:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784191868.759726:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191868.759883:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812341888 00000100:00100000:3.0:1784191868.759898:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812341888 00000100:00080000:0.0:1784191868.759983:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191868.760044:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 321 00000100:00100000:3.0:1784191868.760058:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812341888:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191868.760187:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812341888:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 133us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191868.760195:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 321 00000100:00100000:2.0:1784191868.762783:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191868.762893:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812341632 00000100:00100000:3.0:1784191868.762907:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812341632 00000100:00100000:3.0:1784191868.762979:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 282 00000100:00100000:3.0:1784191868.763002:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812341632:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191868.763167:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812341632:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 177us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191868.763177:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 282 00000100:00100000:2.0:1784191868.763348:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191868.763644:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812341760 00000100:00100000:3.0:1784191868.763649:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812341760 00000100:00100000:3.0:1784191868.763735:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 322 00000100:00100000:3.0:1784191868.763743:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812341760:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191868.763787:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812341760:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 45us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191868.763794:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 322 00000100:00080000:2.0:1784191868.764921:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1784191868.955660:0:160977:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000020:00000080:3.0:1784191868.955675:0:160977:0:(genops.c:906:class_export_put()) final put ffff8af109051800/62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000001:00080000:3.0:1784191868.955722:0:160977:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869235 is committed 00000020:00000080:3.0:1784191868.955755:0:123300:0:(genops.c:865:class_export_destroy()) destroying export ffff8af109051800/62ac9b09-d016-4ae6-b1b1-fe120a3abe0a for lustre-OST0001 00000020:00000080:3.0:1784191868.955811:0:123300:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af22dcdb800 for lustre-OST0001 00000001:00100000:1.0:1784191868.963717:0:160160:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000020:00000080:1.0:1784191868.963735:0:160160:0:(genops.c:906:class_export_put()) final put ffff8af109056000/62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000001:00080000:1.0:1784191868.963765:0:160160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836544 is committed 00000020:00000080:1.0:1784191868.963787:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af109056000/62ac9b09-d016-4ae6-b1b1-fe120a3abe0a for lustre-OST0000 00000020:00000080:1.0:1784191868.963844:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af109050000 for lustre-OST0000 00010000:00010000:3.0:1784191869.003903:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784191869.450199:0:165852:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784191869.451119:0:165852:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000001:00100000:0.0:1784191869.975833:0:165481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1784191869.975880:0:165481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00010000:00010000:1.0:1784191870.029120:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191870.990454:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827918592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784191870.990565:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191870.990721:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827918592 00000100:00100000:0.0:1784191870.990733:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827918592 00000100:00100000:0.0:1784191870.990813:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784191870.990825:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827918592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784191870.990868:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71049216 avail 63881216 00000100:00100000:0.0:1784191870.990925:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827918592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191870.990932:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:0.0:1784191870.990976:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784191870.993421:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827918592:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784191871.053466:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784191871.983240:0:165949:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866e6 len=0 uarg=00007ffe11f03c70 00000004:00000080:3.0:1784191871.983277:0:165949:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0001: cmd=c00866e6 len=608 karg=ffff8af210f0a000 uarg=0000000000000000 00000004:00000080:3.0:1784191871.983352:0:165949:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb46d0f77fd70 00100000:10000000:3.0:1784191871.983361:0:165949:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00100000:10000000:3.0:1784191871.984864:0:165951:0:(scrub.c:294:scrub_thread_prep()) lustre-MDT0001: OI scrub prep, flags = 0x46 00100000:10000000:3.0:1784191871.984873:0:165951:0:(scrub.c:116:scrub_file_reset()) lustre-MDT0001: reset OI scrub file, old flags = 0x0, add flags = 0x0 00100000:10000000:3.0:1784191871.984951:0:165951:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1784191872.000349:0:165950:0:(lfsck_namespace.c:4332:lfsck_namespace_reset()) lustre-MDT0001-osd: namespace LFSCK reset: rc = 0 00100000:10000000:1.0:1784191872.000392:0:165950:0:(lfsck_lib.c:2526:lfsck_start_assistant()) lustre-MDT0001-osd: start lfsck_namespace assistant thread 00100000:10000000:2.0:1784191872.000905:0:165950:0:(lfsck_namespace.c:4580:lfsck_namespace_prep()) lustre-MDT0001-osd: namespace LFSCK prep done, start pos [1, [0x0:0x0:0x0], 0x0]: rc = 0 00100000:10000000:2.0:1784191872.000955:0:165951:0:(osd_scrub.c:1263:osd_scrub_main()) lustre-MDT0001: OI scrub start, flags = 0x46, pos = 12 00100000:10000000:2.0:1784191872.002537:0:165950:0:(lfsck_namespace.c:4478:lfsck_namespace_checkpoint()) lustre-MDT0001-osd: namespace LFSCK checkpoint at the pos [13, [0x0:0x0:0x0], 0x0], status = 1: rc = 0 00100000:10000000:2.0:1784191872.002551:0:165950:0:(lfsck_engine.c:1034:lfsck_master_engine()) lustre-MDT0001-osd entry: oit_flags = 0x40000, dir_flags = 0xc006, oit_cookie = 13, dir_cookie = 0x0, parent = [0x0:0x0:0x0], pid = 165950 00100000:10000000:1.0:1784191872.004596:0:165952:0:(lfsck_engine.c:1551:lfsck_assistant_engine()) lustre-MDT0001-osd: lfsck_namespace LFSCK assistant thread start 00080000:02000000:1.0:1784191872.012459:0:165950:0:(osd_handler.c:1078:osd_check_lmv()) *** cfs_fail_loc=1e2, val=483*** 00100000:10000000:0.0:1784191872.015529:0:165951:0:(scrub.c:368:scrub_thread_post()) lustre-MDT0001: OI scrub post with result = 1 00100000:10000000:0.0:1784191872.015600:0:165951:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1784191872.015604:0:165951:0:(osd_scrub.c:1303:osd_scrub_main()) lustre-MDT0001: OI scrub: stop, pos = 40001: rc = 1 00080000:02000000:1.0:1784191872.020420:0:165950:0:(osd_handler.c:971:do_osd_stripe_dir_filldir()) *** cfs_fail_loc=1e3, val=0*** 00080000:02000000:1.0:1784191872.020438:0:165950:0:(osd_handler.c:1087:osd_check_lmv()) *** cfs_fail_loc=1e3, val=0*** 00080000:10000000:1.0:1784191872.020444:0:165950:0:(osd_handler.c:1094:osd_check_lmv()) lustre-MDT0001: cannot check LMV, ino = 20096/1402991439: rc = -116 00000100:00100000:1.0:1784191872.020572:0:165950:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789880 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-lwp-MDT0001_UUID:165950:1870858827918720:0@lo:900:lfsck.0 00000100:00100000:1.0:1784191872.020670:0:165950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191872.020778:0:165950:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2372c63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191872.023323:0:158677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827918720 00000100:00100000:0.0:1784191872.023343:0:158677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827918720 00000100:00100000:0.0:1784191872.023453:0:158677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784191872.023468:0:158677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:165950:x1870858827918720:12345-0@lo:900:lfsck.0 00000100:00100000:0.0:1784191872.023613:0:158677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:165950:x1870858827918720:12345-0@lo:900:lfsck.0 Request processed in 147us (2942us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191872.023623:0:158677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784191872.025552:0:165950:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789880 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-lwp-MDT0001_UUID:165950:1870858827918720:0@lo:900:lfsck.0 00000100:00100000:1.0:1784191872.026076:0:165950:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789880 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-lwp-MDT0001_UUID:165950:1870858827918848:0@lo:900:lfsck.0 00000100:00100000:1.0:1784191872.026169:0:165950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191872.026219:0:165950:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2372c6300 going to sleep for 11 seconds 00000100:00100000:0.0:1784191872.028376:0:158677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827918848 00000100:00100000:0.0:1784191872.028395:0:158677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827918848 00000100:00100000:0.0:1784191872.028496:0:158677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784191872.028510:0:158677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:165950:x1870858827918848:12345-0@lo:900:lfsck.0 00000100:00100000:0.0:1784191872.028657:0:158677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:165950:x1870858827918848:12345-0@lo:900:lfsck.0 Request processed in 149us (2487us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191872.028666:0:158677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784191872.028853:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827918976:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1784191872.028921:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191872.028973:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827918976 00000100:00100000:0.0:1784191872.028978:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827918976 00000100:00100000:0.0:1784191872.029014:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1784191872.029021:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827918976:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1784191872.029096:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827918976:12345-0@lo:1000:lfsck_namespace.0 Request processed in 75us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191872.029244:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1784191872.029271:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db180 going to sleep for 11 seconds 00000100:00100000:0.0:1784191872.029310:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827918976:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1784191872.029385:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827919104:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1784191872.029410:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191872.029439:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db180 going to sleep for 11 seconds 00000100:00100000:3.0:1784191872.029647:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827919104 00000100:00100000:3.0:1784191872.029653:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827919104 00000100:00100000:3.0:1784191872.029922:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1784191872.029942:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827919104:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.030051:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827919104:12345-0@lo:1000:lfsck_namespace.0 Request processed in 112us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191872.030059:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1784191872.030112:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827919104:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.030312:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67e680 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827919232:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.030377:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191872.030407:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827919232 00000100:00100000:3.0:1784191872.030411:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827919232 00000100:00100000:3.0:1784191872.030435:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:3.0:1784191872.030450:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827919232:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.030506:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827919232:12345-0@lo:1000:lfsck_namespace.0 Request processed in 57us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191872.030513:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:3.0:1784191872.030533:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af106955840 going to sleep for 11 seconds 00000100:00100000:3.0:1784191872.030545:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67e680 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827919232:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1784191872.031940:0:165950:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789880 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-lwp-MDT0001_UUID:165950:1870858827918848:0@lo:900:lfsck.0 00000100:00100000:3.0:1784191872.040507:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827919360:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.040623:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191872.040675:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827919360 00000100:00100000:3.0:1784191872.040684:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827919360 00000100:00100000:3.0:1784191872.040774:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:3.0:1784191872.040786:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827919360:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.053680:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827919360:12345-0@lo:1000:lfsck_namespace.0 Request processed in 12879us (13040us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191872.053720:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:3.0:1784191872.053829:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af106955b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784191872.053882:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827919360:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.054028:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827919488:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.054081:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191872.054144:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827919488 00000100:00100000:3.0:1784191872.054152:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827919488 00000100:00100000:3.0:1784191872.054211:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:3.0:1784191872.054247:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827919488:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.054346:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827919488:12345-0@lo:1000:lfsck_namespace.0 Request processed in 126us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191872.054376:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:3.0:1784191872.054400:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e2180 going to sleep for 11 seconds 00000100:00100000:3.0:1784191872.054414:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827919488:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.054520:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827919616:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.054544:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191872.054565:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827919616 00000100:00100000:3.0:1784191872.054569:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827919616 00000100:00100000:3.0:1784191872.054592:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:3.0:1784191872.054598:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827919616:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.054646:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827919616:12345-0@lo:1000:lfsck_namespace.0 Request processed in 48us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191872.054652:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:3.0:1784191872.054684:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af106955b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784191872.054723:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827919616:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.054852:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827919744:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.054877:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191872.054897:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827919744 00000100:00100000:3.0:1784191872.054900:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827919744 00000100:00100000:3.0:1784191872.054921:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1784191872.054938:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827919744:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.054987:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827919744:12345-0@lo:1000:lfsck_namespace.0 Request processed in 60us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191872.054993:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1784191872.055010:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2372c6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191872.055032:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827919744:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.055069:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827919872:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.055094:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191872.055116:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827919872 00000100:00100000:3.0:1784191872.055120:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827919872 00000100:00100000:3.0:1784191872.055142:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1784191872.055150:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827919872:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.055226:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827919872:12345-0@lo:1000:lfsck_namespace.0 Request processed in 76us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191872.055238:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1784191872.055260:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2372c6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191872.055271:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827919872:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.055321:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827920000:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.055345:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191872.055362:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827920000 00000100:00100000:3.0:1784191872.055365:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827920000 00000100:00100000:3.0:1784191872.055386:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:3.0:1784191872.055392:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827920000:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.055434:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827920000:12345-0@lo:1000:lfsck_namespace.0 Request processed in 43us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191872.055441:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:3.0:1784191872.055455:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2372c6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191872.055466:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827920000:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.059241:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827920128:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.059352:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191872.059430:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2372c6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784191872.060057:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827920128 00000100:00100000:1.0:1784191872.060069:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827920128 00000100:00100000:1.0:1784191872.060154:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:1.0:1784191872.060166:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827920128:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1784191872.060285:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827920128:12345-0@lo:1000:lfsck_namespace.0 Request processed in 122us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191872.060294:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1784191872.063084:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827920128:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.067107:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827920256:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.067222:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191872.067306:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827920256 00000100:00100000:3.0:1784191872.067317:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827920256 00000100:00100000:3.0:1784191872.067393:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:3.0:1784191872.067406:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827920256:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.067538:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827920256:12345-0@lo:1000:lfsck_namespace.0 Request processed in 134us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191872.067548:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:3.0:1784191872.067610:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2372c6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191872.067644:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827920256:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.067768:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827920384:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.067798:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191872.067828:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827920384 00000100:00100000:3.0:1784191872.067833:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827920384 00000100:00100000:3.0:1784191872.067862:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1784191872.067868:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827920384:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.067924:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827920384:12345-0@lo:1000:lfsck_namespace.0 Request processed in 55us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191872.067944:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1784191872.067965:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2372c6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191872.067979:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827920384:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.068241:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827920512:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.068272:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191872.068297:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827920512 00000100:00100000:3.0:1784191872.068302:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827920512 00000100:00100000:3.0:1784191872.068329:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:3.0:1784191872.068335:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827920512:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.068408:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827920512:12345-0@lo:1000:lfsck_namespace.0 Request processed in 72us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191872.068415:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:3.0:1784191872.068430:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2372c6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191872.068440:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827920512:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.068476:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827920640:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.068503:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191872.068521:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827920640 00000100:00100000:3.0:1784191872.068525:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827920640 00000100:00100000:3.0:1784191872.068543:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:3.0:1784191872.068549:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827920640:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.068607:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827920640:12345-0@lo:1000:lfsck_namespace.0 Request processed in 57us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191872.068613:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:3.0:1784191872.068627:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2372c6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191872.068637:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827920640:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.068711:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827920768:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.068735:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191872.068759:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827920768 00000100:00100000:3.0:1784191872.068762:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827920768 00000100:00100000:3.0:1784191872.068780:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:3.0:1784191872.068785:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827920768:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.068822:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827920768:12345-0@lo:1000:lfsck_namespace.0 Request processed in 36us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191872.068827:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:3.0:1784191872.068840:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2372c6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191872.068849:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827920768:0@lo:1000:lfsck_namespace.0 00010000:00010000:0.0:1784191872.088248:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191872.093637:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301f80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827920896:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1784191872.093771:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191872.093916:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233dfed80 going to sleep for 11 seconds 00000100:00100000:1.0:1784191872.094897:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827920896 00000100:00100000:1.0:1784191872.094913:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827920896 00000100:00100000:1.0:1784191872.094994:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:1.0:1784191872.095007:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827920896:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1784191872.095162:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827920896:12345-0@lo:1000:lfsck_namespace.0 Request processed in 156us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191872.095171:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:0.0:1784191872.095385:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301f80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827920896:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1784191872.095492:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301f80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827921024:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1784191872.095534:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191872.095582:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233dfed80 going to sleep for 11 seconds 00000100:00100000:3.0:1784191872.095963:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827921024 00000100:00100000:3.0:1784191872.095970:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827921024 00000100:00100000:3.0:1784191872.096012:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:3.0:1784191872.096021:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827921024:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.096195:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827921024:12345-0@lo:1000:lfsck_namespace.0 Request processed in 175us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191872.096204:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:3.0:1784191872.096249:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301f80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827921024:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.096353:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827921152:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.096387:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191872.096407:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2372c6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784191872.097259:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827921152 00000100:00100000:1.0:1784191872.097272:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827921152 00000100:00100000:1.0:1784191872.097338:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:1.0:1784191872.097349:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827921152:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1784191872.098294:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827921152:12345-0@lo:1000:lfsck_namespace.0 Request processed in 939us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191872.098309:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:3.0:1784191872.099726:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827921152:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.100005:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827921280:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.100076:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191872.100146:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2372c6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191872.100445:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827921280 00000100:00100000:0.0:1784191872.100456:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827921280 00000100:00100000:0.0:1784191872.100528:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:0.0:1784191872.100540:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827921280:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1784191872.100670:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827921280:12345-0@lo:1000:lfsck_namespace.0 Request processed in 132us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191872.100678:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00100000:10000000:1.0:1784191872.103367:0:165950:0:(lfsck_engine.c:1053:lfsck_master_engine()) lustre-MDT0001-osd ffff8af10ea627c0 exit: oit_flags = 0x40000, dir_flags = 0xc006, oit_cookie = 20125, dir_cookie = 0x236908c6dc1005b8, parent = [0x240002340:0xd:0x0], pid = 165950: rc = 1 00100000:10000000:1.0:1784191872.103391:0:165950:0:(lfsck_lib.c:2594:lfsck_post_generic()) lustre-MDT0001-osd: waiting for assistant to do lfsck_namespace post, rc = 1 00000100:00100000:3.0:1784191872.104017:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827921280:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.104424:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827921408:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.104515:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191872.105394:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2372c6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784191872.114004:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827921408 00000100:00100000:1.0:1784191872.114028:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827921408 00000100:00100000:1.0:1784191872.114131:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:1.0:1784191872.114157:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827921408:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1784191872.114381:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827921408:12345-0@lo:1000:lfsck_namespace.0 Request processed in 228us (9865us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191872.114391:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:3.0:1784191872.120172:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827921408:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.120392:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827921536:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.120482:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191872.120545:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2372c6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191872.124959:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827921536 00000100:00100000:0.0:1784191872.124998:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827921536 00000100:00100000:0.0:1784191872.125261:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:0.0:1784191872.125276:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827921536:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1784191872.125490:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827921536:12345-0@lo:1000:lfsck_namespace.0 Request processed in 217us (5007us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191872.125499:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:3.0:1784191872.126086:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827921536:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.126319:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827921664:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.126379:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191872.126433:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2372c6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191872.126900:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827921664 00000100:00100000:0.0:1784191872.126910:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827921664 00000100:00100000:0.0:1784191872.126981:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:0.0:1784191872.126993:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827921664:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1784191872.127087:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827921664:12345-0@lo:1000:lfsck_namespace.0 Request processed in 96us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191872.127304:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:3.0:1784191872.127440:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827921664:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.127516:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827921792:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.127583:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191872.127628:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2372c6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191872.127676:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827921792 00000100:00100000:0.0:1784191872.127680:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827921792 00000100:00100000:0.0:1784191872.127739:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:0.0:1784191872.127747:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827921792:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1784191872.128088:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827921792:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1784191872.128228:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827921920:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1784191872.128265:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191872.128307:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827921920 00000100:00100000:2.0:1784191872.128311:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827921920 00000100:00100000:2.0:1784191872.128347:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1784191872.128355:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:165952:x1870858827921920:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1784191872.128416:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:165952:x1870858827921920:12345-0@lo:1000:lfsck_namespace.0 Request processed in 60us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191872.128424:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1784191872.128454:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af110ef3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784191872.128468:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827921920:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1784191872.128593:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827922048:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1784191872.128628:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191872.128648:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827922048 00000100:00100000:2.0:1784191872.128651:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827922048 00000100:00100000:2.0:1784191872.128669:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:2.0:1784191872.128675:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af205712c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:165952:x1870858827922048:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1784191872.128752:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af205712c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:165952:x1870858827922048:12345-0@lo:1000:lfsck_namespace.0 Request processed in 76us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191872.128759:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:2.0:1784191872.128780:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af110ef3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784191872.128795:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827922048:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1784191872.128838:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827922176:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1784191872.129353:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191872.129419:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827921792:12345-0@lo:1000:lfsck_namespace.0 Request processed in 1666us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191872.129431:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:2.0:1784191872.129506:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827922176 00000100:00100000:2.0:1784191872.129518:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827922176 00000100:00100000:2.0:1784191872.129591:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:2.0:1784191872.129604:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827922176:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1784191872.129808:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827922176:12345-0@lo:1000:lfsck_namespace.0 Request processed in 208us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191872.129901:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:2.0:1784191872.129970:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af110ef3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784191872.130004:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827922176:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1784191872.130160:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827922304:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1784191872.130196:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191872.130228:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af110ef3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784191872.130259:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827922304 00000100:00100000:3.0:1784191872.130269:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827922304 00000100:00100000:3.0:1784191872.130323:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:3.0:1784191872.130330:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827922304:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.130438:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827922304:12345-0@lo:1000:lfsck_namespace.0 Request processed in 108us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191872.130446:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:2.0:1784191872.130498:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827922304:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1784191872.130614:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfaa680 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827922432:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1784191872.130646:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191872.130667:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af110ef3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784191872.130979:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827922432 00000100:00100000:3.0:1784191872.130987:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827922432 00000100:00100000:3.0:1784191872.131051:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:3.0:1784191872.131058:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827922432:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1784191872.131491:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827922432:12345-0@lo:1000:lfsck_namespace.0 Request processed in 432us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191872.131499:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1784191872.131776:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfaa680 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827922432:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1784191872.131939:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfaa680 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827922560:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1784191872.131995:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191872.132039:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af110ef3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784191872.132916:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827922560 00000100:00100000:0.0:1784191872.132938:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827922560 00000100:00100000:0.0:1784191872.133008:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:0.0:1784191872.133019:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827922560:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1784191872.133438:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827922560:12345-0@lo:1000:lfsck_namespace.0 Request processed in 419us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191872.133447:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:2.0:1784191872.133503:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfaa680 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827922560:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1784191872.134034:0:165952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfaa680 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827922688:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1784191872.134092:0:165952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191872.134634:0:165952:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af110ef3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784191872.135136:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827922688 00000100:00100000:0.0:1784191872.135145:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827922688 00000100:00100000:0.0:1784191872.135246:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:0.0:1784191872.135257:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827922688:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1784191872.135421:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:165952:x1870858827922688:12345-0@lo:1000:lfsck_namespace.0 Request processed in 166us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191872.135429:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1784191872.135489:0:165952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfaa680 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:165952:1870858827922688:0@lo:1000:lfsck_namespace.0 00100000:10000000:2.0:1784191872.135576:0:165952:0:(lfsck_engine.c:1612:lfsck_assistant_engine()) lustre-MDT0001-osd: lfsck_namespace LFSCK assistant thread post 00100000:10000000:2.0:1784191872.135601:0:165952:0:(lfsck_engine.c:1626:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant notified others for lfsck_namespace post: rc = 0 00100000:10000000:1.0:1784191872.135727:0:165950:0:(lfsck_lib.c:2604:lfsck_post_generic()) lustre-MDT0001-osd: the assistant has done lfsck_namespace post, rc = 1 00100000:10000000:1.0:1784191872.135828:0:165950:0:(lfsck_namespace.c:4808:lfsck_namespace_post()) lustre-MDT0001-osd: namespace LFSCK post done: rc = 0 00100000:10000000:1.0:1784191872.135869:0:165950:0:(lfsck_lib.c:2621:lfsck_double_scan_generic()) lustre-MDT0001-osd: waiting for assistant to do lfsck_namespace double_scan, status 2 00100000:10000000:2.0:1784191872.135957:0:165952:0:(lfsck_engine.c:1644:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant sync before the second-stage scaning 00000004:00080000:2.0:1784191872.135986:0:165952:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 5492315295550ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784191872.135996:0:165952:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1784191872.136034:0:165952:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 5492315344787ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784191872.136040:0:165952:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00100000:10000000:1.0:1784191872.136230:0:165950:0:(lfsck_lib.c:2630:lfsck_double_scan_generic()) lustre-MDT0001-osd: the assistant has done lfsck_namespace double_scan, status 0 00000004:00080000:1.0:1784191872.149292:0:165481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00000004:00080000:1.0:1784191872.149338:0:165481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00100000:10000000:3.0:1784191872.153822:0:165952:0:(lfsck_engine.c:1651:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant phase2 scan start, synced: rc = 0 00100000:10000000:3.0:1784191872.153877:0:165952:0:(lfsck_namespace.c:6700:lfsck_namespace_assistant_handler_p2()) lustre-MDT0001-osd: namespace LFSCK phase2 scan start 00100000:10000000:0.0:1784191872.154306:0:165952:0:(lfsck_namespace.c:6325:lfsck_namespace_scan_local_lpf()) lustre-MDT0001-osd: start to scan backend /lost+found 00100000:10000000:0.0:1784191872.154354:0:165952:0:(lfsck_namespace.c:6428:lfsck_namespace_scan_local_lpf()) lustre-MDT0001-osd: stop to scan backend /lost+found: rc = 1 00100000:10000000:0.0:1784191872.154429:0:165952:0:(lfsck_namespace.c:3284:lfsck_namespace_double_scan_dir()) lustre-MDT0001-osd: some MDT(s) maybe NOT take part in the namespace LFSCK, then the LFSCK cannot guarantee all the name entries have been verified in first-stage scanning. So have to skip orphan related handling for the directory object [0x240000403:0x1:0x0] with remote name entry 00100000:10000000:0.0:1784191872.154439:0:165952:0:(lfsck_namespace.c:3284:lfsck_namespace_double_scan_dir()) lustre-MDT0001-osd: some MDT(s) maybe NOT take part in the namespace LFSCK, then the LFSCK cannot guarantee all the name entries have been verified in first-stage scanning. So have to skip orphan related handling for the directory object [0x240002343:0x1:0x0] with remote name entry 00100000:10000000:0.0:1784191872.154460:0:165952:0:(lfsck_namespace.c:3284:lfsck_namespace_double_scan_dir()) lustre-MDT0001-osd: some MDT(s) maybe NOT take part in the namespace LFSCK, then the LFSCK cannot guarantee all the name entries have been verified in first-stage scanning. So have to skip orphan related handling for the directory object [0x240002343:0x2:0x0] with remote name entry 00100000:10000000:0.0:1784191872.154476:0:165952:0:(lfsck_namespace.c:3284:lfsck_namespace_double_scan_dir()) lustre-MDT0001-osd: some MDT(s) maybe NOT take part in the namespace LFSCK, then the LFSCK cannot guarantee all the name entries have been verified in first-stage scanning. So have to skip orphan related handling for the directory object [0x240002343:0x3:0x0] with remote name entry 00100000:10000000:0.0:1784191872.154618:0:165952:0:(lfsck_namespace.c:3284:lfsck_namespace_double_scan_dir()) lustre-MDT0001-osd: some MDT(s) maybe NOT take part in the namespace LFSCK, then the LFSCK cannot guarantee all the name entries have been verified in first-stage scanning. So have to skip orphan related handling for the directory object [0x240002343:0x4:0x0] with remote name entry 00100000:10000000:0.0:1784191872.154661:0:165952:0:(lfsck_namespace.c:3284:lfsck_namespace_double_scan_dir()) lustre-MDT0001-osd: some MDT(s) maybe NOT take part in the namespace LFSCK, then the LFSCK cannot guarantee all the name entries have been verified in first-stage scanning. So have to skip orphan related handling for the directory object [0x240002343:0x5:0x0] with remote name entry 00100000:10000000:0.0:1784191872.154677:0:165952:0:(lfsck_namespace.c:3284:lfsck_namespace_double_scan_dir()) lustre-MDT0001-osd: some MDT(s) maybe NOT take part in the namespace LFSCK, then the LFSCK cannot guarantee all the name entries have been verified in first-stage scanning. So have to skip orphan related handling for the directory object [0x240002343:0x6:0x0] with remote name entry 00100000:10000000:0.0:1784191872.154718:0:165952:0:(lfsck_namespace.c:3284:lfsck_namespace_double_scan_dir()) lustre-MDT0001-osd: some MDT(s) maybe NOT take part in the namespace LFSCK, then the LFSCK cannot guarantee all the name entries have been verified in first-stage scanning. So have to skip orphan related handling for the directory object [0x240002343:0x7:0x0] with remote name entry 00100000:10000000:0.0:1784191872.154746:0:165952:0:(lfsck_namespace.c:3284:lfsck_namespace_double_scan_dir()) lustre-MDT0001-osd: some MDT(s) maybe NOT take part in the namespace LFSCK, then the LFSCK cannot guarantee all the name entries have been verified in first-stage scanning. So have to skip orphan related handling for the directory object [0x240002343:0x8:0x0] with remote name entry 00100000:10000000:0.0:1784191872.154773:0:165952:0:(lfsck_namespace.c:3284:lfsck_namespace_double_scan_dir()) lustre-MDT0001-osd: some MDT(s) maybe NOT take part in the namespace LFSCK, then the LFSCK cannot guarantee all the name entries have been verified in first-stage scanning. So have to skip orphan related handling for the directory object [0x240002343:0x9:0x0] with remote name entry 00100000:10000000:0.0:1784191872.154793:0:165952:0:(lfsck_namespace.c:3284:lfsck_namespace_double_scan_dir()) lustre-MDT0001-osd: some MDT(s) maybe NOT take part in the namespace LFSCK, then the LFSCK cannot guarantee all the name entries have been verified in first-stage scanning. So have to skip orphan related handling for the directory object [0x240002343:0xa:0x0] with remote name entry 00100000:10000000:0.0:1784191872.154848:0:165952:0:(lfsck_namespace.c:6719:lfsck_namespace_assistant_handler_p2()) lustre-MDT0001-osd: namespace LFSCK phase2 scan stop at the No. 16 trace file: rc = 1 00100000:10000000:0.0:1784191872.154862:0:165952:0:(lfsck_engine.c:1760:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant sync before exit 00000004:00080000:0.0:1784191872.154896:0:165952:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 5492334206529ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784191872.154913:0:165952:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1784191872.154957:0:165952:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 5492334266609ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784191872.154964:0:165952:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1784191872.161032:0:165481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00000004:00080000:1.0:1784191872.161062:0:165481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00100000:10000000:0.0:1784191872.161150:0:165952:0:(lfsck_engine.c:1766:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant synced before exit: rc = 0 00100000:10000000:0.0:1784191872.161264:0:165952:0:(lfsck_engine.c:1778:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant phase2 scan finished: rc = 1 00100000:10000000:0.0:1784191872.162856:0:165952:0:(lfsck_engine.c:1790:lfsck_assistant_engine()) lustre-MDT0001-osd: lfsck_namespace LFSCK assistant thread exit: rc = 1 00000100:00100000:0.0:1784191872.525231:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827922816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784191872.525339:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191872.525427:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784191872.525434:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827922944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191872.525463:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191872.525500:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827922816 00000100:00100000:0.0:1784191872.525509:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827922816 00000100:00100000:0.0:1784191872.525574:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1784191872.525587:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827922816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784191872.525614:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71049216 avail 63881216 00000100:00100000:0.0:1784191872.525660:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827922816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191872.525668:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1784191872.525713:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827922944 00000100:00100000:0.0:1784191872.525717:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827922944 00000100:00100000:0.0:1784191872.525746:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:0.0:1784191872.525752:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827922944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784191872.525785:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42549248 avail 36417536 00000100:00100000:0.0:1784191872.526007:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827922944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191872.526015:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00080000:0.0:1784191872.526037:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191872.526148:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827922944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191872.526163:0:106499:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836544 gen 2 00000100:00100000:0.0:1784191872.526190:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827922816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784191872.527599:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784191872.527623:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827923072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784191872.527723:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191872.527788:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827923072 00000100:00100000:2.0:1784191872.527797:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827923072 00000100:00100000:2.0:1784191872.527876:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784191872.527887:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827923072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784191872.527931:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71184384 avail 64016384 00000100:00100000:2.0:1784191872.527984:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827923072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191872.527991:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:2.0:1784191872.528016:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784191872.528052:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827923072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784191872.528611:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784191872.528625:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827923200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191872.528671:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191872.528813:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827923200 00000100:00100000:0.0:1784191872.528819:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827923200 00000100:00100000:0.0:1784191872.528966:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1784191872.528976:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827923200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784191872.528996:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71184384 avail 64016384 00000100:00100000:0.0:1784191872.529042:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827923200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191872.529049:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784191872.529129:0:106501:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869235 gen 2 00000100:00100000:1.0:1784191872.529151:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827923200:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1784191872.529973:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784191873.039536:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827923328:0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.039641:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191873.039736:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858827923840:0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.039770:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191873.039794:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858827924352:0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.039817:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191873.039851:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858827924864:0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.039876:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191873.039918:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784191873.039925:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827923456:0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.039957:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191873.039977:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858827923968:0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.040000:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191873.040019:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827924480:0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.040047:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191873.040085:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827923584:0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.040131:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191873.040153:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:106501:1870858827924096:0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.040176:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191873.040194:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827924608:0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.040218:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191873.040240:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784191873.040246:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827923712:0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.040268:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191873.040287:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858827924224:0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.040309:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191873.040320:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827924736:0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.040339:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191873.040381:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827923328 00000100:00100000:3.0:1784191873.040391:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827923328 00000100:00100000:3.0:1784191873.040450:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1784191873.040461:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858827923328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.040521:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858827923328:12345-0@lo:400:kworker.0 Request processed in 62us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191873.040530:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1784191873.040576:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827923840 00000100:00100000:3.0:1784191873.040580:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827923840 00000100:00100000:3.0:1784191873.040607:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827924352 00000100:00100000:3.0:1784191873.040610:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827924352 00000100:00100000:3.0:1784191873.040639:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827924864 00000100:00100000:3.0:1784191873.040643:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827924864 00000100:00100000:3.0:1784191873.040656:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827923968 00000100:00100000:3.0:1784191873.040659:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827923968 00000100:00100000:3.0:1784191873.040720:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827924096 00000100:00100000:3.0:1784191873.040724:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827924096 00000100:00100000:3.0:1784191873.040740:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827924224 00000100:00100000:3.0:1784191873.040744:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827924224 00000100:00100000:3.0:1784191873.040761:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1784191873.040768:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858827923840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.040809:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858827923840:12345-0@lo:400:kworker.0 Request processed in 41us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191873.040816:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1784191873.040830:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1784191873.040836:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858827924352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.040865:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858827924352:12345-0@lo:400:kworker.0 Request processed in 29us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191873.040871:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1784191873.040882:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1784191873.040888:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858827924864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.040930:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858827924864:12345-0@lo:400:kworker.0 Request processed in 42us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191873.040937:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1784191873.040948:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1784191873.040954:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858827923968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.040982:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858827923968:12345-0@lo:400:kworker.0 Request processed in 29us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191873.040988:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1784191873.040999:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1784191873.041005:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106501:x1870858827924096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.041051:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106501:x1870858827924096:12345-0@lo:400:kworker.0 Request processed in 46us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191873.041058:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1784191873.041072:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1784191873.041078:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858827924224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.041105:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858827924224:12345-0@lo:400:kworker.0 Request processed in 27us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191873.041111:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1784191873.041147:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827923456 00000100:00100000:3.0:1784191873.041151:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827923456 00000100:00100000:3.0:1784191873.041180:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827924480 00000100:00100000:3.0:1784191873.041184:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827924480 00000100:00100000:3.0:1784191873.041203:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1784191873.041209:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827923456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.041243:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827923456:12345-0@lo:400:kworker.0 Request processed in 33us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191873.041249:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1784191873.041259:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:3.0:1784191873.041264:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827924480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.041288:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827924480:12345-0@lo:400:kworker.0 Request processed in 24us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191873.041293:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:3.0:1784191873.041326:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827923584 00000100:00100000:3.0:1784191873.041329:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827923584 00000100:00100000:3.0:1784191873.041361:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827924608 00000100:00100000:3.0:1784191873.041364:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827924608 00000100:00100000:3.0:1784191873.041383:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827923712 00000100:00100000:3.0:1784191873.041394:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827923712 00000100:00100000:3.0:1784191873.041419:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827924736 00000100:00100000:3.0:1784191873.041422:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827924736 00000100:00100000:3.0:1784191873.041450:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1784191873.041455:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827923584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.041489:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827923584:12345-0@lo:400:kworker.0 Request processed in 34us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191873.041495:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1784191873.041507:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784191873.041513:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827924608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.041547:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827924608:12345-0@lo:400:kworker.0 Request processed in 32us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191873.041553:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784191873.041565:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1784191873.041570:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827923712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.041595:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827923712:12345-0@lo:400:kworker.0 Request processed in 26us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191873.041602:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1784191873.041612:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1784191873.041618:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827924736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.041645:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827924736:12345-0@lo:400:kworker.0 Request processed in 27us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191873.041650:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:3.0:1784191873.041717:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784191873.041723:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784191873.041725:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191873.041785:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827923712:0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.041808:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858827924224:0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.041820:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827924736:0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.041831:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827923584:0@lo:400:kworker.0 00010000:00080000:3.0:1784191873.041848:0:106501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af210f4df80 x1870858827924096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784191889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784191873.041858:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:106501:1870858827924096:0@lo:400:kworker.0 00000100:00100000:3.0:1784191873.041870:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827924608:0@lo:400:kworker.0 00000100:00100000:2.0:1784191873.045356:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827923456:0@lo:400:kworker.0 00000100:00100000:2.0:1784191873.045383:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858827923968:0@lo:400:kworker.0 00000100:00100000:2.0:1784191873.045399:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827924480:0@lo:400:kworker.0 00000100:00100000:2.0:1784191873.045413:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827923328:0@lo:400:kworker.0 00000100:00100000:2.0:1784191873.045428:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858827923840:0@lo:400:kworker.0 00010000:00080000:2.0:1784191873.045445:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af210f4ca80 x1870858827924352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784191889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784191873.045465:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858827924352:0@lo:400:kworker.0 00000100:00100000:2.0:1784191873.045482:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858827924864:0@lo:400:kworker.0 00000100:00100000:2.0:1784191873.045542:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784191873.045557:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827924992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784191873.045649:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191873.046497:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827924992 00000100:00100000:0.0:1784191873.046509:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827924992 00000100:00100000:0.0:1784191873.046585:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:0.0:1784191873.046596:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827924992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784191873.046651:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42651648 avail 36519936 00000100:00100000:0.0:1784191873.046759:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827924992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 164us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191873.046767:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:0.0:1784191873.046822:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827924992:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784191873.108064:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191873.879446:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191873.879494:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191873.879599:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191873.879642:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812342016 00000100:00100000:2.0:1784191873.879654:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812342016 00000100:00100000:3.0:1784191873.879814:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812342272 00000100:00100000:3.0:1784191873.879820:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812342272 00000100:00100000:3.0:1784191873.879901:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812342144 00000100:00100000:3.0:1784191873.879905:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812342144 00000100:00100000:3.0:1784191873.879944:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 329 00000100:00100000:3.0:1784191873.879958:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812342272:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191873.880886:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 284 00000100:00100000:2.0:1784191873.880913:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69111:x1870858812342016:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191873.881181:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69111:x1870858812342016:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 275us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191873.881191:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 284 00000100:00100000:3.0:1784191873.889295:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812342272:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 9308us (9835us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191873.889318:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 329 00000100:00100000:3.0:1784191873.889374:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 330 00000100:00100000:3.0:1784191873.889393:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812342144:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191873.889468:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812342144:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 84us (9972us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191873.889475:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 330 00000100:00080000:3.0:1784191873.889520:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784191873.889528:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1784191874.124619:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191875.147789:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191876.108732:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784191876.108758:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827925120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784191876.108839:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191876.109429:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827925120 00000100:00100000:2.0:1784191876.109439:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827925120 00000100:00100000:2.0:1784191876.109522:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784191876.109533:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210302680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827925120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784191876.109567:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71049216 avail 63881216 00000100:00100000:2.0:1784191876.109632:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210302680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827925120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191876.109640:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784191876.109735:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827925120:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784191876.109868:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784191876.175831:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191877.196375:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191877.645875:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827925248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784191877.645984:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191877.646089:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827925248 00000100:00100000:2.0:1784191877.646098:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827925248 00000100:00100000:2.0:1784191877.646174:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784191877.646187:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827925248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784191877.646230:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71184384 avail 64016384 00000100:00100000:2.0:1784191877.646286:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827925248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191877.646296:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784191877.646359:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827925248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191877.650300:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784191877.650334:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827925376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784191877.650430:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191877.650867:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827925376 00000100:00100000:3.0:1784191877.650877:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827925376 00000100:00100000:3.0:1784191877.650945:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784191877.650955:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827925376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784191877.650988:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71184384 avail 64016384 00000100:00100000:3.0:1784191877.651044:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827925376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191877.651052:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784191877.651113:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827925376:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784191877.653093:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784191877.657200:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827925632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784191877.657308:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191877.657391:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784191877.657402:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827925504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784191877.657434:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191877.657472:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827925504 00000100:00100000:2.0:1784191877.657483:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827925504 00000100:00080000:1.0:1784191877.657526:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784191877.657582:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1784191877.657595:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827925504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784191877.657629:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71049216 avail 63881216 00000100:00100000:2.0:1784191877.657722:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827925504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191877.657731:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784191877.658072:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827925632 00000100:00100000:3.0:1784191877.658079:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827925632 00000100:00100000:3.0:1784191877.659422:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:3.0:1784191877.659441:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827925632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784191877.659487:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42549248 avail 36417536 00000100:00100000:3.0:1784191877.659591:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827925632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (2283us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191877.659598:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00100000:3.0:1784191877.659853:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827925632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191877.660147:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827925504:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1784191877.684670:0:166195:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL osp.lustre-MDT0001-os[pc]-MDT0000.*_server_uuid 00000100:00100000:1.0:1784191878.157179:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827926016:0@lo:400:kworker.0 00000100:00100000:1.0:1784191878.157302:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191878.157392:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858827926528:0@lo:400:kworker.0 00000100:00100000:1.0:1784191878.157440:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191878.157462:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827927040:0@lo:400:kworker.0 00000100:00100000:1.0:1784191878.157497:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191878.157536:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784191878.157542:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827925888:0@lo:400:kworker.0 00000100:00100000:1.0:1784191878.157573:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191878.157603:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858827926400:0@lo:400:kworker.0 00000100:00100000:1.0:1784191878.157628:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191878.157647:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827926912:0@lo:400:kworker.0 00000100:00100000:1.0:1784191878.157669:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191878.157735:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827926016 00000100:00100000:1.0:1784191878.157745:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827926016 00000100:00100000:1.0:1784191878.157831:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827927040 00000100:00100000:1.0:1784191878.157835:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827927040 00000100:00100000:1.0:1784191878.157865:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1784191878.157877:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827926016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191878.157954:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827926016:12345-0@lo:400:kworker.0 Request processed in 77us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191878.157964:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1784191878.157988:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1784191878.157994:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827927040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191878.158022:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827927040:12345-0@lo:400:kworker.0 Request processed in 29us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191878.158029:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1784191878.158057:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827926528 00000100:00100000:1.0:1784191878.158072:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827926528 00000100:00100000:1.0:1784191878.158113:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827926400 00000100:00100000:1.0:1784191878.158117:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827926400 00000100:00100000:1.0:1784191878.158144:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1784191878.158151:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858827926528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191878.158189:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858827926528:12345-0@lo:400:kworker.0 Request processed in 38us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191878.158197:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1784191878.158209:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1784191878.158215:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858827926400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191878.158246:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858827926400:12345-0@lo:400:kworker.0 Request processed in 31us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191878.158253:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1784191878.158274:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827925888 00000100:00100000:1.0:1784191878.158278:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827925888 00000100:00100000:1.0:1784191878.158308:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827926912 00000100:00100000:1.0:1784191878.158311:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827926912 00000100:00100000:1.0:1784191878.158329:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:1.0:1784191878.158334:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827925888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191878.158370:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827925888:12345-0@lo:400:kworker.0 Request processed in 35us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191878.158376:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:1.0:1784191878.158387:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:1.0:1784191878.158393:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827926912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191878.158423:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827926912:12345-0@lo:400:kworker.0 Request processed in 31us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191878.158428:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00080000:1.0:1784191878.158457:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784191878.158462:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784191878.158466:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784191878.158524:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827925888:0@lo:400:kworker.0 00000100:00100000:1.0:1784191878.158539:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858827926400:0@lo:400:kworker.0 00000100:00100000:1.0:1784191878.158549:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827926912:0@lo:400:kworker.0 00000100:00100000:1.0:1784191878.158561:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827926016:0@lo:400:kworker.0 00010000:00080000:1.0:1784191878.158575:0:106500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af210f4ce00 x1870858827926528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784191894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784191878.158586:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858827926528:0@lo:400:kworker.0 00000100:00100000:1.0:1784191878.158596:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827927040:0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.159631:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827926144:0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.159731:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191878.159784:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858827926656:0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.159830:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191878.159852:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827927168:0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.159879:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191878.159908:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1784191878.159916:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827925760:0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.159950:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191878.159981:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827926272:0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.160007:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191878.160028:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827926784:0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.160051:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191878.160071:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827927296:0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.160094:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191878.160138:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827926144 00000100:00100000:2.0:1784191878.160149:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827926144 00000100:00100000:2.0:1784191878.160211:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827927168 00000100:00100000:2.0:1784191878.160214:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827927168 00000100:00100000:2.0:1784191878.160242:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784191878.160252:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827926144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.160329:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827926144:12345-0@lo:400:kworker.0 Request processed in 77us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191878.160339:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784191878.160360:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784191878.160367:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827927168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.160395:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827927168:12345-0@lo:400:kworker.0 Request processed in 29us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191878.160411:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784191878.160585:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827926656 00000100:00100000:2.0:1784191878.160589:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827926656 00000100:00100000:2.0:1784191878.160628:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827926272 00000100:00100000:2.0:1784191878.160631:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827926272 00000100:00100000:2.0:1784191878.160643:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827926784 00000100:00100000:2.0:1784191878.160646:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827926784 00000100:00100000:2.0:1784191878.160660:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827927296 00000100:00100000:2.0:1784191878.160663:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827927296 00000100:00100000:2.0:1784191878.160676:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1784191878.160682:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858827926656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.160764:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858827926656:12345-0@lo:400:kworker.0 Request processed in 81us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191878.160769:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1784191878.160781:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1784191878.160787:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827926272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.160826:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827926272:12345-0@lo:400:kworker.0 Request processed in 38us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191878.160832:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1784191878.160843:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1784191878.160849:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827926784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.160877:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827926784:12345-0@lo:400:kworker.0 Request processed in 28us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191878.160883:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1784191878.160895:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1784191878.160900:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827927296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.160945:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827927296:12345-0@lo:400:kworker.0 Request processed in 44us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191878.160951:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1784191878.160978:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827925760 00000100:00100000:2.0:1784191878.160982:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827925760 00000100:00100000:2.0:1784191878.161012:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1784191878.161019:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827925760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.161053:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827925760:12345-0@lo:400:kworker.0 Request processed in 35us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191878.161060:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1784191878.161143:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827925760:0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.161160:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827926272:0@lo:400:kworker.0 00010000:00080000:2.0:1784191878.161175:0:106501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af210f4c000 x1870858827926784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784191894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784191878.161186:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827926784:0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.161197:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827927296:0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.161210:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827926144:0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.161221:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858827926656:0@lo:400:kworker.0 00000100:00100000:2.0:1784191878.161232:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827927168:0@lo:400:kworker.0 00000100:00080000:2.0:1784191878.161309:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784191878.161315:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784191878.161565:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784191878.161586:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827927424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784191878.161635:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191878.161681:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827927424 00000100:00100000:1.0:1784191878.161704:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827927424 00000100:00100000:1.0:1784191878.161740:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:1.0:1784191878.161747:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827927424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784191878.161788:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42651648 avail 36519936 00000100:00100000:1.0:1784191878.161846:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827927424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191878.161853:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:1.0:1784191878.161894:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827927424:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1784191878.164051:0:166228:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: osp.lustre-MDT0001-os[pc]-MDT0000.*_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1784191878.220797:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191879.002765:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191879.002836:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191879.002875:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191879.002991:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812342528 00000100:00100000:2.0:1784191879.003005:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812342528 00000100:00100000:2.0:1784191879.003130:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812342656 00000100:00100000:2.0:1784191879.003134:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812342656 00000100:00100000:2.0:1784191879.003180:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 337 00000100:00100000:2.0:1784191879.003192:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69112:x1870858812342528:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191879.003299:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69112:x1870858812342528:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 108us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191879.003309:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 337 00000100:00100000:2.0:1784191879.003330:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 338 00000100:00100000:2.0:1784191879.003337:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69109:x1870858812342656:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191879.003366:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69109:x1870858812342656:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 29us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191879.003373:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 338 00000100:00080000:0.0:1784191879.004039:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784191879.004048:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784191879.004406:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812342400 00000100:00100000:3.0:1784191879.004417:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812342400 00000100:00100000:3.0:1784191879.004490:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 286 00000100:00100000:3.0:1784191879.004501:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69112:x1870858812342400:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191879.004579:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69112:x1870858812342400:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 80us (1742us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191879.004587:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 286 00010000:00010000:2.0:1784191879.246753:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191880.270042:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191881.228293:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784191881.228324:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827927552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784191881.228415:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191881.228481:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827927552 00000100:00100000:2.0:1784191881.228489:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827927552 00000100:00100000:2.0:1784191881.228553:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1784191881.228562:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827927552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784191881.228594:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71049216 avail 63881216 00000100:00100000:2.0:1784191881.228638:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827927552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191881.228645:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:2.0:1784191881.228666:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784191881.228737:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827927552:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784191881.297431:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191882.317356:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191882.764893:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827927680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784191882.764984:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191882.765057:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784191882.765064:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827927808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191882.765105:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191882.767953:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827927680 00000100:00100000:1.0:1784191882.767965:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827927680 00000100:00100000:1.0:1784191882.768044:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1784191882.768059:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827927680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784191882.768093:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71184384 avail 64016384 00000100:00100000:1.0:1784191882.768181:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827927680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (3197us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191882.768188:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1784191882.768212:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827927808 00000100:00100000:1.0:1784191882.768215:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827927808 00000100:00100000:1.0:1784191882.768243:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:1.0:1784191882.768250:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827927808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784191882.768271:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42549248 avail 36417536 00000100:00100000:1.0:1784191882.768301:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827927808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (3211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191882.768307:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:1.0:1784191882.768321:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784191882.768333:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827927936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784191882.768364:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191882.768401:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827927936 00000100:00100000:1.0:1784191882.768404:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827927936 00000100:00100000:1.0:1784191882.768426:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1784191882.768431:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827927936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784191882.768442:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71049216 avail 63881216 00000100:00100000:1.0:1784191882.768467:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827927936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191882.768473:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1784191882.768529:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827927936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784191882.768574:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827927808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784191882.768589:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827927680:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784191882.768678:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784191882.768682:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784191882.770371:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784191882.770394:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827928064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784191882.770470:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191882.770590:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827928064 00000100:00100000:3.0:1784191882.770598:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827928064 00000100:00100000:3.0:1784191882.770665:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784191882.770674:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827928064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784191882.770736:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71184384 avail 64016384 00000100:00100000:3.0:1784191882.770787:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827928064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191882.770793:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:0.0:1784191882.770872:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784191882.771362:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827928064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784191883.277772:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827928192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784191883.277866:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191883.278096:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827928192 00000100:00100000:0.0:1784191883.278105:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827928192 00000100:00100000:0.0:1784191883.278165:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1784191883.278174:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827928192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784191883.278214:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42651648 avail 36519936 00000100:00100000:0.0:1784191883.278270:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827928192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191883.278278:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:2.0:1784191883.278408:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827928192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784191883.278678:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827928576:0@lo:400:kworker.0 00000100:00100000:1.0:1784191883.278748:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191883.278771:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858827929088:0@lo:400:kworker.0 00000100:00100000:1.0:1784191883.278797:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191883.278813:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827929600:0@lo:400:kworker.0 00000100:00100000:1.0:1784191883.278835:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191883.278852:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784191883.278858:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827928448:0@lo:400:kworker.0 00000100:00100000:1.0:1784191883.278878:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191883.278893:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858827928960:0@lo:400:kworker.0 00000100:00100000:1.0:1784191883.278910:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191883.278925:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827929472:0@lo:400:kworker.0 00000100:00100000:1.0:1784191883.278942:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191883.278966:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827929088 00000100:00100000:1.0:1784191883.278969:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827929088 00000100:00100000:1.0:1784191883.279010:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827928960 00000100:00100000:1.0:1784191883.279013:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827928960 00000100:00100000:1.0:1784191883.279034:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1784191883.279041:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858827929088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191883.279082:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858827929088:12345-0@lo:400:kworker.0 Request processed in 42us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191883.279105:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1784191883.279123:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1784191883.279129:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af107905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858827928960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191883.279160:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af107905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858827928960:12345-0@lo:400:kworker.0 Request processed in 32us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191883.279166:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00080000:1.0:1784191883.279184:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784191883.279188:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784191883.279212:0:106500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af227e62d80 x1870858827928960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784191899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784191883.279223:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858827928960:0@lo:400:kworker.0 00000100:00100000:1.0:1784191883.279235:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858827929088:0@lo:400:kworker.0 00000100:00100000:2.0:1784191883.279685:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827928704:0@lo:400:kworker.0 00000100:00100000:2.0:1784191883.279753:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191883.279782:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827929216:0@lo:400:kworker.0 00000100:00100000:2.0:1784191883.279804:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191883.279821:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827929728:0@lo:400:kworker.0 00000100:00100000:2.0:1784191883.279843:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191883.279861:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784191883.279867:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827928320:0@lo:400:kworker.0 00000100:00100000:2.0:1784191883.279909:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191883.279940:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858827928832:0@lo:400:kworker.0 00000100:00100000:2.0:1784191883.279979:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191883.279997:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827929344:0@lo:400:kworker.0 00000100:00100000:2.0:1784191883.280021:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191883.280051:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827928320 00000100:00100000:2.0:1784191883.280056:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827928320 00000100:00100000:2.0:1784191883.280091:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1784191883.280098:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827928320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191883.280139:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827928320:12345-0@lo:400:kworker.0 Request processed in 40us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191883.280145:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1784191883.280173:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827928704 00000100:00100000:2.0:1784191883.280177:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827928704 00000100:00100000:2.0:1784191883.280198:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827929216 00000100:00100000:2.0:1784191883.280200:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827929216 00000100:00100000:2.0:1784191883.280220:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827929728 00000100:00100000:2.0:1784191883.280222:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827929728 00000100:00100000:2.0:1784191883.280231:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827928832 00000100:00100000:2.0:1784191883.280233:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827928832 00000100:00100000:2.0:1784191883.280247:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1784191883.280253:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827928704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191883.280285:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827928704:12345-0@lo:400:kworker.0 Request processed in 32us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191883.280291:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1784191883.280302:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1784191883.280308:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827929216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191883.280347:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827929216:12345-0@lo:400:kworker.0 Request processed in 39us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191883.280364:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1784191883.280377:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1784191883.280382:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827929728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191883.280410:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827929728:12345-0@lo:400:kworker.0 Request processed in 28us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191883.280416:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1784191883.280427:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1784191883.280432:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858827928832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191883.280458:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858827928832:12345-0@lo:400:kworker.0 Request processed in 26us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191883.280463:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00080000:2.0:1784191883.280481:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784191883.280485:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784191883.280493:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827929344 00000100:00100000:2.0:1784191883.280496:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827929344 00000100:00100000:2.0:1784191883.280518:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:2.0:1784191883.280524:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827929344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191883.280555:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827929344:12345-0@lo:400:kworker.0 Request processed in 31us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191883.280561:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:2.0:1784191883.280594:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827928320:0@lo:400:kworker.0 00000100:00100000:2.0:1784191883.280606:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858827928832:0@lo:400:kworker.0 00000100:00100000:2.0:1784191883.280615:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827929344:0@lo:400:kworker.0 00000100:00100000:2.0:1784191883.280624:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827928704:0@lo:400:kworker.0 00010000:00080000:2.0:1784191883.280645:0:106501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af227e60e00 x1870858827929216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784191899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784191883.280656:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827929216:0@lo:400:kworker.0 00000100:00100000:2.0:1784191883.280666:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827929728:0@lo:400:kworker.0 00000100:00100000:3.0:1784191883.281311:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827928576 00000100:00100000:3.0:1784191883.281318:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827928576 00000100:00100000:3.0:1784191883.281366:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827929600 00000100:00100000:3.0:1784191883.281370:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827929600 00000100:00100000:3.0:1784191883.281394:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827928448 00000100:00100000:3.0:1784191883.281397:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827928448 00000100:00100000:3.0:1784191883.281425:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827929472 00000100:00100000:3.0:1784191883.281428:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827929472 00000100:00100000:3.0:1784191883.281451:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1784191883.281459:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827928576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191883.281525:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827928576:12345-0@lo:400:kworker.0 Request processed in 66us (2776us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191883.281532:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1784191883.281550:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1784191883.281555:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827929600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191883.281597:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827929600:12345-0@lo:400:kworker.0 Request processed in 41us (2760us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191883.281603:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1784191883.281616:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1784191883.281621:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af107904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827928448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191883.281648:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af107904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827928448:12345-0@lo:400:kworker.0 Request processed in 27us (2769us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191883.281654:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1784191883.281663:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1784191883.281668:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af107904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827929472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191883.281731:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af107904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827929472:12345-0@lo:400:kworker.0 Request processed in 62us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191883.281737:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:3.0:1784191883.281776:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784191883.281801:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827928448:0@lo:400:kworker.0 00000100:00100000:3.0:1784191883.281812:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827929472:0@lo:400:kworker.0 00000100:00100000:3.0:1784191883.281833:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827928576:0@lo:400:kworker.0 00000100:00100000:3.0:1784191883.281843:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827929600:0@lo:400:kworker.0 00010000:00010000:3.0:1784191883.340118:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191884.120721:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191884.120768:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191884.120802:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191884.120833:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812342912 00000100:00100000:0.0:1784191884.120843:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812342912 00000100:00100000:0.0:1784191884.120905:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812343040 00000100:00100000:0.0:1784191884.120908:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812343040 00000100:00100000:0.0:1784191884.120934:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 345 00000100:00100000:0.0:1784191884.120948:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812342912:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191884.121025:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812342912:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 81us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191884.121032:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 345 00000100:00100000:0.0:1784191884.121050:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 346 00000100:00100000:0.0:1784191884.121057:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812343040:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191884.121086:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812343040:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 30us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191884.121113:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 346 00000100:00100000:0.0:1784191884.121137:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812342784 00000100:00100000:0.0:1784191884.121141:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812342784 00000100:00100000:0.0:1784191884.121168:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 288 00000100:00100000:0.0:1784191884.121174:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812342784:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191884.121202:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812342784:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 27us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191884.121209:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 288 00000100:00080000:0.0:1784191884.121235:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784191884.121239:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784191884.365902:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191885.388710:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191886.348254:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827929856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784191886.348373:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191886.348869:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827929856 00000100:00100000:2.0:1784191886.348882:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827929856 00000100:00080000:3.0:1784191886.349266:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784191886.349328:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784191886.349345:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827929856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784191886.349404:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71049216 avail 63881216 00000100:00100000:2.0:1784191886.350606:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827929856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1254us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191886.350621:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1784191886.368766:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827929856:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784191886.411889:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784191887.166165:0:166424:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-lfsck test 44: umount while lfsck is stopping == 04:51:24 (1784191884) 00010000:00010000:2.0:1784191887.435996:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191887.468364:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191887.468482:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812343168 00000100:00100000:1.0:1784191887.468495:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812343168 00000100:00100000:1.0:1784191887.468604:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 433 00000100:00100000:1.0:1784191887.468617:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:123531:x1870858812343168:12345-192.168.204.16@tcp:101:bash.0 00010000:00010000:1.0:1784191887.468652:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191887.468743:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8400/0xfeec3c2dc5a4ac19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b6bd expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.468836:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ac20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.468852:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ac20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.468888:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ac20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191887.468944:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784191887.468948:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784191887.468969:0:158665:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ac20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.468993:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8400/0xfeec3c2dc5a4ac19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6bd expref: 7 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.469013:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ac20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6bd expref: 6 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.469022:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5200) 00010000:00010000:1.0:1784191887.469025:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784191887.469028:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9400, rc 0) 00000100:00100000:1.0:1784191887.469092:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123531:x1870858812343168:12345-192.168.204.16@tcp:101:bash.0 Request processed in 478us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191887.469099:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 433 00000100:00080000:3.0:1784191887.469452:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784191887.481895:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191887.482180:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812343296 00000100:00100000:3.0:1784191887.482192:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812343296 00000100:00100000:3.0:1784191887.482254:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 103 00000100:00100000:3.0:1784191887.482265:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1099f5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123531:x1870858812343296:12345-192.168.204.16@tcp:37:bash.0 00000100:00100000:0.0:1784191887.498237:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1099f5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123531:x1870858812343296:12345-192.168.204.16@tcp:37:bash.0 Request processed in 15960us (16344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191887.498253:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 103 00000100:00100000:0.0:1784191887.522463:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191887.522996:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812343424 00000100:00100000:2.0:1784191887.523012:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812343424 00000100:00100000:2.0:1784191887.523097:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 434 00000100:00100000:2.0:1784191887.523110:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812343424:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191887.523136:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191887.523168:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4ac27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b6c4 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.523256:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4ac2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.523287:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4ac2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.523301:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4ac2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.523319:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4ac35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.523326:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4ac35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.523332:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4ac35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191887.523462:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de47800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:161504:1870858827929984:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191887.523526:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191887.523597:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10673f840 going to sleep for 11 seconds 00000100:00100000:1.0:1784191887.524148:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827929984 00000100:00100000:1.0:1784191887.524156:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827929984 00000100:00100000:1.0:1784191887.524207:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1784191887.524217:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:161504:x1870858827929984:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191887.524326:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:161504:x1870858827929984:12345-0@lo:1000:mdt00_003.0 Request processed in 109us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191887.524334:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1784191887.524465:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de47800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:161504:1870858827929984:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1784191887.524531:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4ac3c lrc: 3/1,0 mode: --/PR res: [0x240002343:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524546:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4ac3c lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524557:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4ac3c lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191887.524581:0:161504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4ac3c lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524607:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4ac2e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524613:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4ac2e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524620:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4ac2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524627:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4ac2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524633:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191887.524648:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4ac2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524655:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4ac2e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524677:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5200) 00010000:00010000:0.0:1784191887.524681:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191887.524686:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4ac2e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524715:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4ac2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524730:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4ac35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524736:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4ac35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524748:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4ac35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524754:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191887.524766:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4ac35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524774:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4ac35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524783:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed36d805 (ffff8af210e98000) 00010000:00010000:0.0:1784191887.524786:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191887.524789:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4ac35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524795:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4ac35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524845:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4ac27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6c4 expref: 8 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524861:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4ac3c lrc: 3/0,0 mode: PR/PR res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6c4 expref: 7 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.524869:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x1:0x0].0x0 (ffff8af203904900) 00010000:00010000:0.0:1784191887.524871:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784191887.524874:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3e200, rc 0) 00000100:00100000:0.0:1784191887.525201:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812343424:12345-192.168.204.16@tcp:101:rm.0 Request processed in 2092us (2753us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191887.525219:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 434 00000100:00100000:0.0:1784191887.527469:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191887.529861:0:158676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812343552 00000100:00100000:1.0:1784191887.529878:0:158676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812343552 00000100:00100000:1.0:1784191887.529995:0:158676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17 00000100:00100000:1.0:1784191887.530008:0:158676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:123674:x1870858812343552:12345-192.168.204.16@tcp:900:rm.0 00000100:00100000:1.0:1784191887.530144:0:158676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:123674:x1870858812343552:12345-192.168.204.16@tcp:900:rm.0 Request processed in 138us (2696us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191887.530152:0:158676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17 00000100:00080000:3.0:1784191887.530726:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784191887.544211:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191887.544350:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812343680 00000100:00100000:2.0:1784191887.544363:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812343680 00000100:00100000:2.0:1784191887.544433:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 435 00000100:00100000:2.0:1784191887.544444:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af107907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:123674:x1870858812343680:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191887.544468:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191887.544495:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4ac43 lrc: 2/0,0 mode: --/CR res: [0x240002343:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b6cb expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191887.545770:0:158666:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1221us 00010000:00010000:2.0:1784191887.580310:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ac4a lrc: 3/1,0 mode: --/PR res: [0x240002343:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.580349:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ac4a lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.580367:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ac4a lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191887.580491:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191887.580497:0:158666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1784191887.580565:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4ac43 lrc: 0/0,0 mode: --/CR res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6cb expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.580584:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ac4a lrc: 3/0,0 mode: PR/PR res: [0x240002343:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6cb expref: 6 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.580594:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x1:0x0].0x0 (ffff8af210e98e00) 00010000:00010000:2.0:1784191887.580597:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784191887.580600:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ec00, rc 0) 00000100:00100000:2.0:1784191887.580683:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af107907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812343680:12345-192.168.204.16@tcp:101:rm.0 Request processed in 36239us (36489us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191887.580726:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 435 00000100:00100000:2.0:1784191887.603508:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191887.603600:0:158676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812343808 00000100:00100000:1.0:1784191887.603612:0:158676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812343808 00000100:00100000:1.0:1784191887.603718:0:158676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18 00000100:00100000:1.0:1784191887.603731:0:158676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812343808:12345-192.168.204.16@tcp:900:rm.0 00000100:00100000:1.0:1784191887.603837:0:158676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812343808:12345-192.168.204.16@tcp:900:rm.0 Request processed in 109us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191887.603846:0:158676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18 00000100:00100000:0.0:1784191887.614956:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191887.615077:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812343936 00000100:00100000:2.0:1784191887.615088:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812343936 00000100:00100000:2.0:1784191887.615154:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 436 00000100:00100000:2.0:1784191887.615165:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812343936:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191887.615188:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191887.615212:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4ac51 lrc: 2/0,0 mode: --/CR res: [0x240002340:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b6d2 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.615289:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4ac58 lrc: 3/1,0 mode: --/PR res: [0x240002340:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.615304:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4ac58 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.615315:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4ac58 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191887.615370:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002340:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1784191887.615376:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1784191887.615414:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4ac51 lrc: 0/0,0 mode: --/CR res: [0x240002340:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6d2 expref: 8 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.615432:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4ac58 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6d2 expref: 7 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.615441:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x4:0x0].0x0 (ffff8af210e98800) 00010000:00010000:2.0:1784191887.615444:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784191887.615447:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f200, rc 0) 00000100:00100000:2.0:1784191887.615519:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812343936:12345-192.168.204.16@tcp:101:rm.0 Request processed in 356us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191887.615525:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 436 00000100:00100000:2.0:1784191887.645304:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191887.645404:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812344064 00000100:00100000:0.0:1784191887.645415:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812344064 00000100:00100000:0.0:1784191887.645538:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 437 00000100:00100000:0.0:1784191887.645549:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812344064:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191887.645572:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191887.645599:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4ac5f lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b6d9 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.645733:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ac66 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.645750:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ac66 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.645762:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ac66 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191887.645829:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x4:0x0]: returning size 4096 00000004:00200000:0.0:1784191887.645835:0:161504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1784191887.645878:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4ac5f lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6d9 expref: 9 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.645903:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ac66 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6d9 expref: 8 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.645935:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x4:0x0].0x0 (ffff8af203904700) 00010000:00010000:0.0:1784191887.645938:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784191887.645942:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3e600, rc 0) 00000100:00100000:0.0:1784191887.646011:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812344064:12345-192.168.204.16@tcp:101:rm.0 Request processed in 463us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191887.646018:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 437 00000100:00100000:3.0:1784191887.652328:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191887.653777:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812344320 00000100:00100000:2.0:1784191887.653792:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812344320 00000100:00100000:2.0:1784191887.653862:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 438 00000100:00100000:2.0:1784191887.653873:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812344320:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191887.653914:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191887.653943:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4ac6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b6e0 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191887.654144:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784191887.654293:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4ac6d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6e0 expref: 9 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.654312:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af210e98b00) 00010000:00010000:2.0:1784191887.654315:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191887.654320:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4ac6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6e0 expref: 9 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.654340:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ea00, rc 0) 00000100:00100000:2.0:1784191887.654410:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812344320:12345-192.168.204.16@tcp:101:rm.0 Request processed in 538us (2092us total) trans 25769803777 rc 301/301 00000100:00100000:2.0:1784191887.654418:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 438 00000100:00100000:2.0:1784191887.672445:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191887.672554:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812344448 00000100:00100000:0.0:1784191887.672564:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812344448 00000100:00100000:0.0:1784191887.672645:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 104 00000100:00100000:0.0:1784191887.672655:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812344448:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:0.0:1784191887.683611:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812344448:12345-192.168.204.16@tcp:37:rm.0 Request processed in 10941us (11161us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191887.683627:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 104 00000100:00100000:3.0:1784191887.695187:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191887.695455:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812344576 00000100:00100000:2.0:1784191887.695466:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812344576 00000100:00100000:2.0:1784191887.695531:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 105 00000100:00100000:2.0:1784191887.695543:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812344576:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:3.0:1784191887.700965:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812344576:12345-192.168.204.16@tcp:37:rm.0 Request processed in 5412us (5777us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191887.700979:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 105 00000100:00100000:3.0:1784191887.708878:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191887.709156:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812344832 00000100:00100000:2.0:1784191887.709171:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812344832 00000100:00100000:2.0:1784191887.709237:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 106 00000100:00100000:2.0:1784191887.709248:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812344832:12345-192.168.204.16@tcp:35:rm.0 00000100:00100000:2.0:1784191887.709538:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:123674:x1870858812344832:12345-192.168.204.16@tcp:35:rm.0 Request processed in 291us (670us total) trans 25769803778 rc 0/0 00000100:00100000:2.0:1784191887.709547:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 106 00000100:00100000:1.0:1784191887.715144:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191887.715196:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191887.715346:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812345216 00000100:00100000:0.0:1784191887.715357:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812345216 00000100:00100000:0.0:1784191887.715419:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 439 00000100:00100000:0.0:1784191887.715431:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:123674:x1870858812345216:12345-192.168.204.16@tcp:36:rm.0 00010000:00010000:0.0:1784191887.715491:0:164531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191887.715520:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ac4a lrc: 0/0,0 mode: --/PR res: [0x240002343:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6cb expref: 9 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.715541:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x1:0x0].0x0 (ffff8af210e98e00) 00010000:00010000:0.0:1784191887.715553:0:164531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191887.715645:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827930112:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784191887.716101:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191887.716230:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812344960 00000100:00100000:2.0:1784191887.716235:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812344960 00000100:00100000:2.0:1784191887.716281:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 57 00000100:00100000:2.0:1784191887.716290:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:69109:x1870858812344960:12345-192.168.204.16@tcp:103:rm.0 00010000:00010000:2.0:1784191887.716304:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191887.716320:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4ac3c lrc: 0/0,0 mode: --/PR res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6c4 expref: 8 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.716337:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x1:0x0].0x0 (ffff8af203904900) 00010000:00010000:2.0:1784191887.716344:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191887.716953:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e738d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784191887.716995:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827930112 00000100:00100000:0.0:1784191887.717000:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827930112 00000100:00100000:0.0:1784191887.717033:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:0.0:1784191887.717041:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:164531:x1870858827930112:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1784191887.724897:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69109:x1870858812344960:12345-192.168.204.16@tcp:103:rm.0 Request processed in 8594us (9686us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191887.724914:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 57 00000100:00100000:0.0:1784191887.727080:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:164531:x1870858827930112:12345-0@lo:1000:mdt00_004.0 Request processed in 10025us (10965us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191887.727100:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:2.0:1784191887.734342:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827930112:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1784191887.734469:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4ac7b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.734480:0:164531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4ac7b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.734491:0:164531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4ac7b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191887.734515:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827930240:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1784191887.734612:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191887.734709:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e738c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784191887.734833:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827930240 00000100:00100000:1.0:1784191887.734841:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827930240 00000100:00100000:1.0:1784191887.734903:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1784191887.734914:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:164531:x1870858827930240:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1784191887.734932:0:161739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191887.734951:0:161739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ac82 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4ac7b expref: -99 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.734995:0:161739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ac20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6bd expref: 6 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.735007:0:161739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ac82 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ac7b expref: 6 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.735033:0:161739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ac20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6bd expref: 6 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.735049:0:161739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ac20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6bd expref: 6 pid: 158665 timeout: 5607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191887.735062:0:161739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e61c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827930368:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191887.735130:0:161739:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784191887.738356:0:161739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e61c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827930368:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191887.738401:0:161739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ac82 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ac7b expref: 6 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.738415:0:161739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5200) 00010000:00010000:0.0:1784191887.738419:0:161739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191887.738423:0:161739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ac82 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ac7b expref: 6 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.738433:0:161739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8800, rc 0) 00000100:00100000:0.0:1784191887.738508:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:164531:x1870858827930240:12345-0@lo:101:mdt00_004.0 Request processed in 3595us (3895us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191887.738518:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:3.0:1784191887.738841:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191887.738926:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812345344 00000100:00100000:0.0:1784191887.738935:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812345344 00010000:00010000:0.0:1784191887.738973:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ac20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6bd expref: 7 pid: 158665 timeout: 5607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191887.739009:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 101 00000100:00100000:0.0:1784191887.739036:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69109:x1870858812345344:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191887.739052:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191887.739059:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ac20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6bd expref: 7 pid: 158665 timeout: 5607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.739072:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ac20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6bd expref: 7 pid: 158665 timeout: 5607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.739097:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ac20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6bd expref: 7 pid: 158665 timeout: 5607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.739116:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5200) 00010000:00010000:0.0:1784191887.739120:0:158652:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ac82 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ac7b expref: 5 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.739130:0:158652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ac82 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ac7b expref: 5 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.739139:0:158652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ac82 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ac7b expref: 5 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.739172:0:158652:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ac82 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ac7b expref: 5 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191887.739189:0:158652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:158652:1870858827930496:0@lo:105: 00000100:00100000:0.0:1784191887.739231:0:158652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191887.739273:0:158652:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af206bbc540 going to sleep for 11 seconds 00000100:00100000:3.0:1784191887.739330:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827930496 00000100:00100000:3.0:1784191887.739335:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827930496 00000100:00100000:3.0:1784191887.739369:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784191887.739377:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158652:x1870858827930496:12345-0@lo:105: 00010000:00010000:3.0:1784191887.739387:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4ac7b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ac82 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.739394:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4ac7b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ac82 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.739402:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4ac7b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ac82 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.739420:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4ac7b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4ac82 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.739427:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4ac7b lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4ac82 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.739437:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4ac7b lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4ac82 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.739450:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af20cd7fa00) 00000100:00100000:3.0:1784191887.739492:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158652:x1870858827930496:12345-0@lo:105: Request processed in 116us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191887.739499:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784191887.739530:0:158652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:158652:1870858827930496:0@lo:105: 00010000:00010000:3.0:1784191887.739544:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191887.739588:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812345344:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 554us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191887.739596:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 101 00000100:00100000:2.0:1784191887.740145:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827930240:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1784191887.740167:0:164531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4ac7b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ac82 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191887.740188:0:164531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1784191887.740225:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4ac89 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.740232:0:164531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4ac89 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.740242:0:164531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4ac89 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191887.740258:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827930624:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1784191887.740295:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191887.740323:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e738c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784191887.740380:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827930624 00000100:00100000:1.0:1784191887.740385:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827930624 00000100:00100000:1.0:1784191887.740428:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1784191887.740437:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:164531:x1870858827930624:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1784191887.740456:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191887.740472:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9c00/0xfeec3c2dc5a4ac90 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4ac89 expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.740493:0:158671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9c00/0xfeec3c2dc5a4ac90 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ac89 expref: 7 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.740506:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9c00/0xfeec3c2dc5a4ac90 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ac89 expref: 7 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.740523:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed36d805 (ffff8af23d0d5100) 00010000:00010000:1.0:1784191887.740526:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191887.740529:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9c00, rc 0) 00000100:00100000:1.0:1784191887.740576:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:164531:x1870858827930624:12345-0@lo:101:mdt00_004.0 Request processed in 141us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191887.740582:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:3.0:1784191887.740665:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827930624:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1784191887.740677:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4ac89 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ac90 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.740723:0:164531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4ac89 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ac90 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191887.740750:0:164531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1784191887.740813:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827930752:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784191887.740841:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191887.740864:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35840 going to sleep for 11 seconds 00000100:00100000:3.0:1784191887.740879:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827930752 00000100:00100000:3.0:1784191887.740882:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827930752 00000100:00100000:3.0:1784191887.740910:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:3.0:1784191887.740916:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:164531:x1870858827930752:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784191887.740978:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:164531:x1870858827930752:12345-0@lo:1000:mdt00_004.0 Request processed in 61us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191887.740984:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:3.0:1784191887.741013:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827930752:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784191887.741057:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827930880:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784191887.741080:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191887.741094:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35900 going to sleep for 11 seconds 00000100:00100000:1.0:1784191887.741556:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827930880 00000100:00100000:1.0:1784191887.741563:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827930880 00000100:00100000:1.0:1784191887.741603:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:1.0:1784191887.741609:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:164531:x1870858827930880:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1784191887.741741:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:164531:x1870858827930880:12345-0@lo:1000:mdt00_004.0 Request processed in 131us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191887.741747:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:0.0:1784191887.741853:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827930880:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784191887.741909:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827931008:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784191887.741942:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191887.741968:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10673f840 going to sleep for 11 seconds 00000100:00100000:2.0:1784191887.742116:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827931008 00000100:00100000:2.0:1784191887.742121:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827931008 00000100:00100000:2.0:1784191887.742157:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:2.0:1784191887.742165:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:164531:x1870858827931008:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1784191887.742249:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:164531:x1870858827931008:12345-0@lo:1000:mdt00_004.0 Request processed in 85us (307us total) trans 0 rc 1/1 00000100:00100000:2.0:1784191887.742256:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:0.0:1784191887.743024:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827931008:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1784191887.743099:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f000/0xfeec3c2dc5a4ac97 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.743110:0:164531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f000/0xfeec3c2dc5a4ac97 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.743120:0:164531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f000/0xfeec3c2dc5a4ac97 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191887.743136:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827931136:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1784191887.743174:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191887.743201:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2012543c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191887.743298:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827931136 00000100:00100000:3.0:1784191887.743303:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827931136 00000100:00100000:3.0:1784191887.743341:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:3.0:1784191887.743348:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:164531:x1870858827931136:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1784191887.743362:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191887.743378:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4ac9e lrc: 2/0,0 mode: --/EX res: [0x240002343:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4ac97 expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.743406:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4ac9e lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ac97 expref: 8 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.743440:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4ac9e lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ac97 expref: 8 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.743448:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x1:0x0].0x0 (ffff8af110071b00) 00010000:00010000:3.0:1784191887.743451:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784191887.743455:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db2c00, rc 0) 00000100:00100000:3.0:1784191887.743504:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:164531:x1870858827931136:12345-0@lo:101:mdt00_004.0 Request processed in 155us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191887.743510:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:0.0:1784191887.743778:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827931136:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1784191887.743793:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f000/0xfeec3c2dc5a4ac97 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ac9e expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.743914:0:164531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f000/0xfeec3c2dc5a4ac97 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ac9e expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.743946:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aca5 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.743956:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aca5 lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.743973:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aca5 lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.744093:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4acac lrc: 3/0,1 mode: --/EX res: [0x240002340:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.744107:0:164531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4ac58 lrc: 2/0,0 mode: PR/PR res: [0x240002340:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6d2 expref: 8 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.744115:0:164531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4acac lrc: 4/0,1 mode: --/EX res: [0x240002340:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.744142:0:164531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4ac58 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6d2 expref: 8 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.744159:0:164531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4ac58 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6d2 expref: 8 pid: 158667 timeout: 5607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191887.744170:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:164531:1870858827931264:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191887.744298:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2012543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191887.759459:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191887.759577:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:164531:1870858827931264:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191887.759607:0:164531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4acac lrc: 3/0,1 mode: --/EX res: [0x240002340:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191887.759774:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812345472 00000100:00100000:3.0:1784191887.759783:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812345472 00010000:00010000:3.0:1784191887.759849:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4ac58 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6d2 expref: 9 pid: 158667 timeout: 5607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191887.759889:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 102 00000100:00100000:3.0:1784191887.759900:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23d2c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812345472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191887.759920:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191887.759927:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4ac58 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6d2 expref: 9 pid: 158667 timeout: 5607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.759942:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4ac58 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6d2 expref: 9 pid: 158667 timeout: 5607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.759974:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4ac58 lrc: 0/0,0 mode: --/PR res: [0x240002340:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6d2 expref: 9 pid: 158667 timeout: 5607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.760014:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x4:0x0].0x0 (ffff8af210e98800) 00010000:00010000:3.0:1784191887.760019:0:158651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4acac lrc: 3/0,1 mode: --/EX res: [0x240002340:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.760029:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4acac lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.760038:0:158651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4acac lrc: 4/0,1 mode: EX/EX res: [0x240002340:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.760173:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191887.760232:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23d2c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:69112:x1870858812345472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 333us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191887.760241:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 102 00010000:00010000:0.0:1784191887.764994:0:164531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4acac lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.765012:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4acac lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.765074:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4acb3 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.765100:0:164531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4acb3 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.765114:0:164531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4acb3 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191887.765143:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827931392:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1784191887.765211:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191887.765241:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2012543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191887.765345:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827931392 00000100:00100000:1.0:1784191887.765354:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827931392 00000100:00100000:1.0:1784191887.765415:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1784191887.765424:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:164531:x1870858827931392:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1784191887.765452:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191887.765468:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4acba lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4acb3 expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.765494:0:158671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ac66 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6d9 expref: 5 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.765511:0:158671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4acba lrc: 4/0,0 mode: --/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4acb3 expref: 9 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.765539:0:158671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ac66 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6d9 expref: 5 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.765565:0:158671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ac66 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6d9 expref: 5 pid: 161504 timeout: 5607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191887.765577:0:158671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827931520:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191887.765662:0:158671:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f540 going to sleep for 11 seconds 00000100:00100000:0.0:1784191887.779755:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191887.780281:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812345600 00000100:00100000:2.0:1784191887.780292:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812345600 00010000:00010000:2.0:1784191887.780337:0:165501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ac66 lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6d9 expref: 6 pid: 161504 timeout: 5607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191887.780397:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 103 00000100:00100000:2.0:1784191887.780407:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812345600:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191887.780422:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191887.780429:0:165501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ac66 lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6d9 expref: 6 pid: 161504 timeout: 5607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.780444:0:165501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ac66 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6d9 expref: 6 pid: 161504 timeout: 5607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.780470:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x4:0x0].0x0 (ffff8af203904700) 00010000:00010000:2.0:1784191887.780477:0:165501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4acba lrc: 3/0,0 mode: --/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4acb3 expref: 9 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.780488:0:165501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4acba lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4acb3 expref: 9 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.780497:0:165501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4acba lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4acb3 expref: 9 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.780533:0:165501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4acba lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4acb3 expref: 9 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191887.780548:0:165501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:165501:1870858827931648:0@lo:105: 00000100:00100000:2.0:1784191887.780612:0:165501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191887.780667:0:165501:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e738d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784191887.780836:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827931648 00000100:00100000:0.0:1784191887.780840:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827931648 00000100:00100000:0.0:1784191887.780881:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784191887.780888:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:165501:x1870858827931648:12345-0@lo:105: 00010000:00010000:0.0:1784191887.780905:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4acb3 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4acba expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.780914:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4acb3 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4acba expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.780922:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4acb3 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4acba expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.780929:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4acb3 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4acba expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.780936:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4acb3 lrc: 5/0,1 mode: EX/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4acba expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.780957:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4acb3 lrc: 5/0,1 mode: EX/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4acba expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.780971:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af10de3fc00) 00000100:00100000:0.0:1784191887.781010:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:165501:x1870858827931648:12345-0@lo:105: Request processed in 122us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191887.781017:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784191887.781227:0:165501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:165501:1870858827931648:0@lo:105: 00010000:00010000:2.0:1784191887.781251:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191887.781311:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812345600:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 904us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191887.781319:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 103 00010000:00010000:1.0:1784191887.783606:0:158671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ac66 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6d9 expref: 5 pid: 161504 timeout: 5607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191887.783646:0:158671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827931520:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191887.783734:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4acba lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4acb3 expref: 9 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.783747:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x4:0x0].0x0 (ffff8af203904700) 00010000:00010000:1.0:1784191887.783750:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784191887.783753:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8e00, rc 0) 00000100:00100000:1.0:1784191887.783846:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:164531:x1870858827931392:12345-0@lo:101:mdt00_004.0 Request processed in 18422us (18634us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191887.783855:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:0.0:1784191887.784071:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827931392:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1784191887.784092:0:164531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4acb3 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4acba expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191887.785237:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827931776:0@lo:403:mdt00_004.0 00000100:00100000:0.0:1784191887.785319:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191887.785358:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af206bbc540 going to sleep for 11 seconds 00000100:00100000:1.0:1784191887.785826:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827931776 00000100:00100000:1.0:1784191887.785845:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827931776 00000100:00100000:1.0:1784191887.785911:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:1.0:1784191887.785923:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:164531:x1870858827931776:12345-0@lo:403:mdt00_004.0 00000100:00100000:1.0:1784191887.789264:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:164531:x1870858827931776:12345-0@lo:403:mdt00_004.0 Request processed in 3328us (3930us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191887.789282:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1784191887.789376:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827931776:0@lo:403:mdt00_004.0 00000040:00080000:1.0:1784191887.792153:0:164531:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784191887.792221:0:164531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab4:0x1:0x0].1, 64 off32832 00000004:00080000:1.0:1784191887.792232:0:164531:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af1053eed80 with version 6 00000040:00080000:1.0:1784191887.792347:0:164531:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784191887.792359:0:164531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab4:0x1:0x0].2, 64 off32896 00000004:00080000:1.0:1784191887.792364:0:164531:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af10f20f540 with version 7 00000004:00080000:3.0:1784191887.793015:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 6 rpc_version 6 00000020:00100000:3.0:1784191887.793068:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784191887.793081:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af210f4c000 x1870858827932032/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191887.793107:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827932032:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784191887.793196:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191887.793254:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35540 going to sleep for 11 seconds 00000100:00100000:2.0:1784191887.793343:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827932032 00000100:00100000:2.0:1784191887.793351:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827932032 00000100:00100000:2.0:1784191887.793416:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1784191887.793426:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:165486:x1870858827932032:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:1.0:1784191887.798388:0:164531:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784191887.802955:0:164531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002b10:0x1:0x0].1, 64 off32832 00000040:00080000:1.0:1784191887.803228:0:164531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002b10:0x2:0x0].1, 944 off33712 00000040:00080000:1.0:1784191887.803495:0:164531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab4:0x2:0x0].1, 1024 off33792 00000004:00080000:1.0:1784191887.803506:0:164531:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af206bbc540 with version 8 00000001:00080000:2.0:1784191887.808943:0:158645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738638 is committed 00000100:00100000:0.0:1784191887.809197:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:165486:x1870858827932032:12345-0@lo:1000:osp_up0-1.0 Request processed in 15766us (15994us total) trans 34359738638 rc 0/0 00000100:00100000:0.0:1784191887.809212:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000004:00080000:1.0:1784191887.809326:0:165486:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738638 committed transno 34359738638 00000100:00100000:1.0:1784191887.809331:0:165486:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 34359738638 gen 2 00000100:00100000:1.0:1784191887.809353:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827932032:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1784191887.809407:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 7 rpc_version 7 00000020:00100000:1.0:1784191887.809451:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784191887.809461:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af227e60380 x1870858827932288/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784191887.809487:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827932288:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784191887.809534:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191887.809575:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191887.811060:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827932288 00000100:00100000:2.0:1784191887.811077:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827932288 00000100:00100000:2.0:1784191887.811334:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:2.0:1784191887.811349:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:165486:x1870858827932288:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:0.0:1784191887.822897:0:158645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738639 is committed 00000100:00100000:2.0:1784191887.823087:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:165486:x1870858827932288:12345-0@lo:1000:osp_up0-1.0 Request processed in 11736us (13547us total) trans 34359738639 rc 0/0 00000100:00100000:2.0:1784191887.823111:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000004:00080000:1.0:1784191887.823230:0:165486:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738639 committed transno 34359738639 00000100:00100000:1.0:1784191887.823244:0:165486:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 34359738639 gen 2 00000100:00100000:1.0:1784191887.823263:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827932288:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1784191887.823293:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 8 rpc_version 8 00000020:00100000:1.0:1784191887.823325:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784191887.823332:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af227e60380 x1870858827932544/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784191887.823352:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827932544:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784191887.823396:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191887.823416:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784191887.823531:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827932544 00000100:00100000:0.0:1784191887.823538:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827932544 00000100:00100000:0.0:1784191887.823591:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:0.0:1784191887.823601:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:165486:x1870858827932544:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784191887.825178:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:165486:x1870858827932544:12345-0@lo:1000:osp_up0-1.0 Request processed in 1571us (1775us total) trans 34359738640 rc 0/0 00000100:00100000:0.0:1784191887.825203:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:1.0:1784191887.825360:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827932544:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1784191887.825435:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784191887.825469:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4acac lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.825480:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4acac lrc: 2/0,0 mode: EX/EX res: [0x240002340:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.825488:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4acac lrc: 3/0,0 mode: EX/EX res: [0x240002340:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.825494:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3f600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191887.825499:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4acac lrc: 3/0,0 mode: EX/EX res: [0x240002340:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.825516:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4acac lrc: 4/0,0 mode: EX/EX res: [0x240002340:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.825542:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x4:0x0].0x0 (ffff8af210e98800) 00010000:00010000:2.0:1784191887.825546:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784191887.825552:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4acac lrc: 2/0,0 mode: --/EX res: [0x240002340:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.825559:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4acac lrc: 0/0,0 mode: --/EX res: [0x240002340:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.825587:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4acb3 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4acba expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.825595:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4acb3 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4acba expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.825602:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4acb3 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4acba expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.825638:0:164531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1784191887.825651:0:164531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0x4:0x0] 00010000:00010000:2.0:1784191887.825662:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aca5 lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.825669:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aca5 lrc: 2/0,0 mode: EX/EX res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.825675:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aca5 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.825821:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191887.825828:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4acb3 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4acba expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.825835:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3fc00 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:1.0:1784191887.825840:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4acb3 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4acba expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191887.825848:0:158654:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4acb3 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4acba expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.825888:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4acb3 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4acba expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.825896:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191887.825925:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4acb3 lrc: 1/0,0 mode: --/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4acba expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.825945:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4acb3 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4acba expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.825963:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191887.825965:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191887.825967:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191887.825976:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784191887.825994:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827932672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191887.826045:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191887.826105:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827932672 00000100:00100000:1.0:1784191887.826112:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827932672 00000100:00100000:1.0:1784191887.826162:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784191887.826171:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:106500:x1870858827932672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191887.826187:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191887.826208:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4acba lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4acb3 expref: 10 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.826221:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x4:0x0].0x0 (ffff8af203904700) 00010000:00010000:1.0:1784191887.826230:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191887.826260:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:106500:x1870858827932672:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191887.826267:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784191887.826299:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827932672:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191887.826589:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191887.826594:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aca5 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826601:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aca5 lrc: 4/0,0 mode: EX/EX res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826613:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x1:0x0].0x0 (ffff8af203904b00) 00010000:00010000:2.0:1784191887.826615:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191887.826619:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aca5 lrc: 2/0,0 mode: --/EX res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826625:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aca5 lrc: 0/0,0 mode: --/EX res: [0x240002343:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826653:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f000/0xfeec3c2dc5a4ac97 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ac9e expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826661:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f000/0xfeec3c2dc5a4ac97 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4ac9e expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826670:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f000/0xfeec3c2dc5a4ac97 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4ac9e expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826720:0:164531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1784191887.826741:0:164531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1784191887.826749:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4ac7b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ac82 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826771:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4ac7b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4ac82 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826778:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4ac7b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4ac82 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826791:0:164531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1784191887.826797:0:164531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1784191887.826806:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784191887.826811:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f000/0xfeec3c2dc5a4ac97 lrc: 2/0,0 mode: EX/EX res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4ac9e expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826818:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3f000 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:2.0:1784191887.826822:0:158653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f000/0xfeec3c2dc5a4ac97 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4ac9e expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191887.826831:0:158653:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f000/0xfeec3c2dc5a4ac97 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4ac9e expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826855:0:158653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f000/0xfeec3c2dc5a4ac97 lrc: 2/0,0 mode: --/EX res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ac9e expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826863:0:158653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191887.826873:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f000/0xfeec3c2dc5a4ac97 lrc: 1/0,0 mode: --/EX res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ac9e expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826880:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f000/0xfeec3c2dc5a4ac97 lrc: 0/0,0 mode: --/EX res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ac9e expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826905:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191887.826908:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4ac7b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4ac82 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826915:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7fa00 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:2.0:1784191887.826919:0:158653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4ac7b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4ac82 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191887.826926:0:158653:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4ac7b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4ac82 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826944:0:158653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4ac7b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ac82 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826950:0:158653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191887.826972:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4ac7b lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ac82 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826980:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7fa00/0xfeec3c2dc5a4ac7b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ac82 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.826993:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191887.826994:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191887.826997:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191887.827007:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4ac89 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ac90 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.827015:0:164531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4ac89 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ac90 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191887.827101:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812345216:12345-192.168.204.16@tcp:36:rm.0 Request processed in 111670us (111979us total) trans 25769803779 rc 0/0 00000100:00100000:2.0:1784191887.827109:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 439 00000100:00100000:0.0:1784191887.827285:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784191887.827298:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827932800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191887.827338:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191887.827526:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827932800 00000100:00100000:2.0:1784191887.827532:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827932800 00000100:00100000:2.0:1784191887.827576:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784191887.827585:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:106499:x1870858827932800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191887.827598:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191887.827616:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4ac9e lrc: 0/0,0 mode: --/EX res: [0x240002343:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ac97 expref: 9 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.827627:0:160189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x1:0x0].0x0 (ffff8af110071b00) 00010000:00010000:2.0:1784191887.827645:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191887.827673:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:106499:x1870858827932800:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191887.827680:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:1.0:1784191887.827956:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191887.827970:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827932928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191887.828013:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191887.829436:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827932800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191887.829488:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827932928 00000100:00100000:0.0:1784191887.829493:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827932928 00000100:00100000:0.0:1784191887.829645:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784191887.829654:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:106501:x1870858827932928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784191887.829677:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191887.829715:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ac82 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ac7b expref: 8 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.829734:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5200) 00010000:00010000:0.0:1784191887.829744:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191887.829811:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:106501:x1870858827932928:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191887.829818:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784191887.830551:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827932928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191887.834582:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191887.834681:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812345728 00000100:00100000:2.0:1784191887.834741:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812345728 00000100:00100000:2.0:1784191887.834807:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 440 00000100:00100000:2.0:1784191887.834817:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:123674:x1870858812345728:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191887.834843:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191887.834873:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4acc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b6e7 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.834953:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4acc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.834983:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4acc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.834997:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4acc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191887.835068:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191887.835077:0:161504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191887.835116:0:161504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4acc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.835144:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4acc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6e7 expref: 7 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.835166:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4acc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6e7 expref: 6 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.835175:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af219b92400) 00010000:00010000:2.0:1784191887.835178:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191887.835182:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ee00, rc 0) 00000100:00100000:2.0:1784191887.835258:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812345728:12345-192.168.204.16@tcp:101:rm.0 Request processed in 442us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191887.835265:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 440 00000100:00100000:2.0:1784191887.841321:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191887.844470:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812345856 00000100:00100000:0.0:1784191887.844487:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812345856 00000100:00100000:0.0:1784191887.844587:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 441 00000100:00100000:0.0:1784191887.844599:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812345856:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191887.844622:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191887.844654:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4accf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b6ee expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.844770:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4acd6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.844786:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4acd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.844808:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4acd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.844826:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4acdd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.844833:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4acdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.844839:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4acdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191887.844972:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10cdb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:158667:1870858827933056:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784191887.845512:0:158667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191887.845557:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e738c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784191887.846038:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827933056 00000100:00100000:1.0:1784191887.846046:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827933056 00000100:00100000:1.0:1784191887.846099:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:1.0:1784191887.846108:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:158667:x1870858827933056:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1784191887.846229:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:158667:x1870858827933056:12345-0@lo:1000:mdt00_002.0 Request processed in 121us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191887.846237:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:0.0:1784191887.846462:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10cdb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:158667:1870858827933056:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1784191887.846524:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4ace4 lrc: 3/1,0 mode: --/PR res: [0x240002343:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.846540:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4ace4 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.846563:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4ace4 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191887.846606:0:158667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4ace4 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.846620:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4acd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.846627:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4acd6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.846644:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4acd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.846651:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3fe00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191887.846655:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4acd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.846663:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4acd6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.846677:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af219b92400) 00010000:00010000:0.0:1784191887.846679:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191887.846684:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4acd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.846724:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4acd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.846740:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4acdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.846746:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4acdd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.846759:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4acdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.846765:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191887.846768:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4acdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.846774:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4acdd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.846782:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdab9809a (ffff8af210dfed00) 00010000:00010000:0.0:1784191887.846784:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191887.846787:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4acdd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.846793:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4acdd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.847025:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4accf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6ee expref: 8 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.847042:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4ace4 lrc: 3/0,0 mode: PR/PR res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6ee expref: 7 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.847049:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0xa:0x0].0x0 (ffff8af210dfe800) 00010000:00010000:0.0:1784191887.847052:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784191887.847054:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3e000, rc 0) 00000100:00100000:0.0:1784191887.847183:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812345856:12345-192.168.204.16@tcp:101:rm.0 Request processed in 2585us (5873us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191887.847203:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 441 00000100:00100000:1.0:1784191887.853787:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191887.854132:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812345984 00000100:00100000:2.0:1784191887.854144:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812345984 00000100:00100000:2.0:1784191887.854247:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 442 00000100:00100000:2.0:1784191887.854259:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812345984:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191887.854313:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191887.854342:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4aceb lrc: 2/0,0 mode: --/CR res: [0x240002343:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b6f5 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.854415:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4acf2 lrc: 3/1,0 mode: --/PR res: [0x240002343:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.854432:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4acf2 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.854444:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4acf2 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191887.854884:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1784191887.854893:0:164531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1784191887.854945:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4aceb lrc: 0/0,0 mode: --/CR res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6f5 expref: 10 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.854965:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4acf2 lrc: 3/0,0 mode: PR/PR res: [0x240002343:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6f5 expref: 9 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.854974:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0xa:0x0].0x0 (ffff8af219b92b00) 00010000:00010000:2.0:1784191887.854977:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784191887.854981:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e400, rc 0) 00000100:00100000:2.0:1784191887.855187:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:123674:x1870858812345984:12345-192.168.204.16@tcp:101:rm.0 Request processed in 928us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191887.855197:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 442 00000100:00100000:2.0:1784191887.859050:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191887.859135:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812346112 00000100:00100000:1.0:1784191887.859146:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812346112 00000100:00100000:1.0:1784191887.859207:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 443 00000100:00100000:1.0:1784191887.859218:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:123674:x1870858812346112:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:1.0:1784191887.859239:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191887.859269:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4acf9 lrc: 2/0,0 mode: --/CR res: [0x240002340:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b6fc expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.859334:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ad00 lrc: 3/1,0 mode: --/PR res: [0x240002340:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.859347:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ad00 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.859360:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ad00 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191887.859416:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002340:0xd:0x0]: returning size 4096 00000004:00200000:1.0:1784191887.859436:0:158666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1784191887.859480:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4acf9 lrc: 0/0,0 mode: --/CR res: [0x240002340:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6fc expref: 11 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.859500:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ad00 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6fc expref: 10 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.859508:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xd:0x0].0x0 (ffff8af23d0d5a00) 00010000:00010000:1.0:1784191887.859511:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784191887.859513:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8600, rc 0) 00000100:00100000:1.0:1784191887.859587:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+10:123674:x1870858812346112:12345-192.168.204.16@tcp:101:rm.0 Request processed in 371us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191887.859595:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 443 00000100:00100000:2.0:1784191887.863442:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191887.863747:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812346240 00000100:00100000:0.0:1784191887.863760:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812346240 00000100:00100000:0.0:1784191887.863839:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 444 00000100:00100000:0.0:1784191887.863851:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812346240:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191887.863877:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191887.863903:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4ad07 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b703 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.863976:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4ad0e lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.864005:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4ad0e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.864018:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4ad0e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191887.864078:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xd:0x0]: returning size 4096 00000004:00200000:0.0:1784191887.864084:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1784191887.864131:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4ad07 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b703 expref: 9 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.864154:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4ad0e lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b703 expref: 8 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.864163:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xd:0x0].0x0 (ffff8af210dfed00) 00010000:00010000:0.0:1784191887.864166:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784191887.864178:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3fe00, rc 0) 00000100:00100000:0.0:1784191887.864259:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812346240:12345-192.168.204.16@tcp:101:rm.0 Request processed in 409us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191887.864268:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 444 00000100:00100000:0.0:1784191887.871496:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191887.871618:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812346496 00000100:00100000:2.0:1784191887.871638:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812346496 00000100:00100000:2.0:1784191887.871747:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 445 00000100:00100000:2.0:1784191887.871758:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+10:123674:x1870858812346496:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191887.871782:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191887.871820:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4ad15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b70a expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191887.872040:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1784191887.872157:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4ad15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b70a expref: 12 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.872173:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af219b92700) 00010000:00010000:2.0:1784191887.872177:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191887.872182:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4ad15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b70a expref: 12 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.872203:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f200, rc 0) 00000100:00100000:2.0:1784191887.872281:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:123674:x1870858812346496:12345-192.168.204.16@tcp:101:rm.0 Request processed in 524us (796us total) trans 25769803780 rc 301/301 00000100:00100000:2.0:1784191887.872288:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 445 00000100:00100000:0.0:1784191887.884140:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784191887.884169:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827933184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784191887.884244:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191887.884519:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827933184 00000100:00100000:3.0:1784191887.884527:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827933184 00000100:00100000:3.0:1784191887.884607:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1784191887.884617:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827933184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784191887.884660:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71184384 avail 64016384 00000100:00100000:3.0:1784191887.884750:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827933184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191887.884775:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1784191887.884842:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827933184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784191887.885256:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784191887.885268:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827933312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784191887.885310:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191887.885345:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827933312 00000100:00100000:1.0:1784191887.885349:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827933312 00000100:00100000:1.0:1784191887.885378:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1784191887.885385:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827933312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784191887.885405:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71049216 avail 63881216 00000100:00100000:1.0:1784191887.885440:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827933312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191887.885446:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1784191887.885481:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827933312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784191887.885731:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784191887.885742:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827933440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784191887.885778:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191887.885883:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784191887.885891:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827933568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784191887.885921:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191887.885952:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827933568 00000100:00100000:3.0:1784191887.885957:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827933568 00000100:00100000:3.0:1784191887.885985:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1784191887.886005:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827933568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784191887.886019:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 71184384 avail 64016384 00000100:00100000:3.0:1784191887.886053:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827933568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191887.886059:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1784191887.886089:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827933568:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784191887.886805:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784191887.886811:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784191887.887964:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191887.888108:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812346624 00000100:00100000:3.0:1784191887.888116:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812346624 00000100:00100000:3.0:1784191887.888165:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 107 00000100:00100000:3.0:1784191887.888175:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:123674:x1870858812346624:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:2.0:1784191887.889609:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827933440 00000100:00100000:2.0:1784191887.889622:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827933440 00000100:00100000:2.0:1784191887.889714:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1784191887.889723:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:106499:x1870858827933440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784191887.889770:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42479616 avail 36347904 00000100:00100000:2.0:1784191887.889868:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:106499:x1870858827933440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (4088us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191887.889882:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:3.0:1784191887.890184:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827933440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191887.895261:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:123674:x1870858812346624:12345-192.168.204.16@tcp:37:rm.0 Request processed in 7073us (7288us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191887.895276:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 107 00000100:00100000:0.0:1784191887.909670:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191887.909989:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812346752 00000100:00100000:1.0:1784191887.909998:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812346752 00000100:00100000:1.0:1784191887.910056:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 108 00000100:00100000:1.0:1784191887.910066:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1099f4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812346752:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:0.0:1784191887.921028:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1099f4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812346752:12345-192.168.204.16@tcp:37:rm.0 Request processed in 10947us (11351us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191887.921047:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 108 00000100:00100000:2.0:1784191887.929091:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191887.929199:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812347008 00000100:00100000:3.0:1784191887.929209:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812347008 00000100:00100000:3.0:1784191887.929274:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 109 00000100:00100000:3.0:1784191887.929285:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:123674:x1870858812347008:12345-192.168.204.16@tcp:35:rm.0 00000100:00100000:3.0:1784191887.929544:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:123674:x1870858812347008:12345-192.168.204.16@tcp:35:rm.0 Request processed in 258us (463us total) trans 25769803781 rc 0/0 00000100:00100000:3.0:1784191887.932010:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 109 00000100:00100000:2.0:1784191887.934010:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191887.934051:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191887.934242:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812347136 00000100:00100000:3.0:1784191887.934253:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812347136 00000100:00100000:3.0:1784191887.934319:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 61 00000100:00100000:3.0:1784191887.934330:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:69110:x1870858812347136:12345-192.168.204.16@tcp:103:rm.0 00010000:00010000:3.0:1784191887.934350:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191887.934375:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4ace4 lrc: 0/0,0 mode: --/PR res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6ee expref: 8 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.934399:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0xa:0x0].0x0 (ffff8af210dfe800) 00010000:00010000:3.0:1784191887.934409:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191887.934473:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69110:x1870858812347136:12345-192.168.204.16@tcp:103:rm.0 Request processed in 144us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191887.934480:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 61 00000100:00100000:1.0:1784191887.934830:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812347392 00000100:00100000:1.0:1784191887.934836:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812347392 00000100:00100000:1.0:1784191887.934881:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 446 00000100:00100000:1.0:1784191887.934889:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:123674:x1870858812347392:12345-192.168.204.16@tcp:36:rm.0 00010000:00010000:1.0:1784191887.934943:0:158665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191887.934958:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4acf2 lrc: 0/0,0 mode: --/PR res: [0x240002343:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6f5 expref: 12 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.934972:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0xa:0x0].0x0 (ffff8af219b92b00) 00010000:00010000:1.0:1784191887.934979:0:158665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784191887.935042:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.935052:0:158665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.935063:0:158665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191887.935085:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e62d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827933696:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1784191887.935304:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191887.935333:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784191887.935428:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827933696 00000100:00100000:3.0:1784191887.935433:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827933696 00000100:00100000:3.0:1784191887.935471:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1784191887.935478:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:158665:x1870858827933696:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1784191887.935488:0:161739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191887.935502:0:161739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4ad2a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4ad23 expref: -99 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.935523:0:161739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4acc8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6e7 expref: 6 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.935533:0:161739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4ad2a lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad23 expref: 8 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.935790:0:161739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4acc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6e7 expref: 6 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.935805:0:161739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4acc8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6e7 expref: 6 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191887.935818:0:161739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827933824:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191887.935871:0:161739:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35240 going to sleep for 11 seconds 00000100:00100000:3.0:1784191887.946246:0:161739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827933824:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191887.946295:0:161739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4ad2a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad23 expref: 8 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.946310:0:161739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af219b92400) 00010000:00010000:3.0:1784191887.946313:0:161739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191887.946317:0:161739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4ad2a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad23 expref: 8 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.946327:0:161739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db2e00, rc 0) 00000100:00100000:3.0:1784191887.946395:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:158665:x1870858827933696:12345-0@lo:101:mdt00_000.0 Request processed in 10916us (11089us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191887.946404:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:1.0:1784191887.946510:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e62d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827933696:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1784191887.946531:0:158665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ad2a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.946543:0:158665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ad2a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191887.946789:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191887.948379:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812347520 00000100:00100000:1.0:1784191887.948394:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812347520 00010000:00010000:2.0:1784191887.948538:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4acc8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6e7 expref: 7 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191887.948884:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 104 00000100:00100000:2.0:1784191887.948896:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69110:x1870858812347520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191887.948914:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191887.948922:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4acc8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6e7 expref: 7 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.948937:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4acc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6e7 expref: 7 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.948960:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4acc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6e7 expref: 7 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.948977:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af219b92400) 00010000:00010000:2.0:1784191887.948985:0:158650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4ad2a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad23 expref: 7 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.949031:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4ad2a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad23 expref: 7 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.949040:0:158650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4ad2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad23 expref: 7 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.949080:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4ad2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad23 expref: 7 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191887.949106:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:158650:1870858827933952:0@lo:105: 00000100:00100000:2.0:1784191887.949179:0:158650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191887.949228:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e2180 going to sleep for 11 seconds 00000100:00100000:0.0:1784191887.949423:0:158648:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784191887.949435:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827933952 00000100:00100000:0.0:1784191887.949440:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827933952 00000100:00100000:0.0:1784191887.949477:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784191887.949485:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f7b6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158650:x1870858827933952:12345-0@lo:105: 00010000:00010000:0.0:1784191887.949497:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ad2a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.949507:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ad2a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.949515:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ad2a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.949534:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4ad2a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.949540:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4ad2a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.949559:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4ad2a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.949593:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af1115b9200) 00000100:00100000:0.0:1784191887.949645:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f7b6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158650:x1870858827933952:12345-0@lo:105: Request processed in 161us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191887.949653:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1784191887.949789:0:158665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ad2a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.949809:0:158665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ad2a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191887.949837:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784191887.949879:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8000/0xfeec3c2dc5a4ad31 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.949887:0:158665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8000/0xfeec3c2dc5a4ad31 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.949896:0:158665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8000/0xfeec3c2dc5a4ad31 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191887.949913:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e62d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827934080:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1784191887.949943:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191887.949976:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784191887.950274:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827934080 00000100:00100000:0.0:1784191887.950280:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827934080 00000100:00100000:0.0:1784191887.950316:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:0.0:1784191887.950323:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:158665:x1870858827934080:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1784191887.950341:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191887.950359:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4ad38 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4ad31 expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.950380:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4ad38 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad31 expref: 9 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.950394:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4ad38 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad31 expref: 9 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.950415:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdab9809a (ffff8af210dfe900) 00010000:00010000:0.0:1784191887.950418:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191887.950421:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3e400, rc 0) 00000100:00100000:0.0:1784191887.950456:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:158665:x1870858827934080:12345-0@lo:101:mdt00_000.0 Request processed in 133us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191887.950463:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:1.0:1784191887.950545:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e62d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827934080:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1784191887.950584:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8000/0xfeec3c2dc5a4ad31 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ad38 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.950596:0:158665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8000/0xfeec3c2dc5a4ad31 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ad38 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191887.950612:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1784191887.950664:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e62d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827934208:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784191887.950727:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191887.950744:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191887.950761:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827934208 00000100:00100000:1.0:1784191887.950765:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827934208 00000100:00100000:1.0:1784191887.950809:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:1.0:1784191887.950817:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:158665:x1870858827934208:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784191887.950876:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:158665:x1870858827934208:12345-0@lo:1000:mdt00_000.0 Request processed in 60us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191887.950883:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:1.0:1784191887.950909:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e62d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827934208:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784191887.950964:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827934336:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784191887.950986:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191887.951001:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191887.951013:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827934336 00000100:00100000:1.0:1784191887.951016:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827934336 00000100:00100000:1.0:1784191887.951035:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:1.0:1784191887.951041:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:158665:x1870858827934336:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784191887.951112:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:158665:x1870858827934336:12345-0@lo:1000:mdt00_000.0 Request processed in 71us (125us total) trans 0 rc 1/1 00000100:00100000:1.0:1784191887.951125:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:1.0:1784191887.951150:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827934336:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1784191887.951197:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8c00/0xfeec3c2dc5a4ad3f lrc: 3/0,1 mode: --/EX res: [0x240002343:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.951205:0:158665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8c00/0xfeec3c2dc5a4ad3f lrc: 3/0,1 mode: --/EX res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.951213:0:158665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8c00/0xfeec3c2dc5a4ad3f lrc: 3/0,1 mode: --/EX res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191887.951225:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827934464:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1784191887.951247:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191887.951260:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784191887.951270:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827934464 00000100:00100000:1.0:1784191887.951273:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827934464 00000100:00100000:1.0:1784191887.951290:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:1.0:1784191887.951296:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:158665:x1870858827934464:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1784191887.951304:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191887.951316:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4ad46 lrc: 2/0,0 mode: --/EX res: [0x240002343:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4ad3f expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.951332:0:158671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4ad46 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad3f expref: 10 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.951344:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4ad46 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad3f expref: 10 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.951363:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0xa:0x0].0x0 (ffff8af23d0d5e00) 00010000:00010000:1.0:1784191887.951366:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784191887.951369:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8e00, rc 0) 00000100:00100000:1.0:1784191887.951414:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:158665:x1870858827934464:12345-0@lo:101:mdt00_000.0 Request processed in 117us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191887.951421:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:1.0:1784191887.951445:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827934464:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1784191887.951455:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8c00/0xfeec3c2dc5a4ad3f lrc: 4/0,1 mode: EX/EX res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ad46 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.951464:0:158665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8c00/0xfeec3c2dc5a4ad3f lrc: 4/0,1 mode: EX/EX res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ad46 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.951487:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4ad4d lrc: 3/0,1 mode: --/EX res: [0x240002343:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.951496:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4ad4d lrc: 3/0,1 mode: EX/EX res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.951504:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4ad4d lrc: 3/0,1 mode: EX/EX res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.951603:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ad54 lrc: 3/0,1 mode: --/EX res: [0x240002340:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.951615:0:158665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ad00 lrc: 2/0,0 mode: PR/PR res: [0x240002340:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6fc expref: 11 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.951646:0:158665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ad54 lrc: 4/0,1 mode: --/EX res: [0x240002340:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.951670:0:158665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ad00 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6fc expref: 11 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.951684:0:158665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ad00 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6fc expref: 11 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191887.951717:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:158665:1870858827934592:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191887.951777:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784191887.953138:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:158650:1870858827933952:0@lo:105: 00010000:00010000:2.0:1784191887.953161:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191887.953218:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69110:x1870858812347520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4322us (7234us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191887.953230:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 104 00000100:00100000:0.0:1784191887.958024:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191887.958067:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812347648 00000100:00100000:0.0:1784191887.958076:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812347648 00010000:00010000:0.0:1784191887.958117:0:165501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ad00 lrc: 5/0,0 mode: PR/PR res: [0x240002340:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6fc expref: 12 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191887.958157:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 105 00000100:00100000:0.0:1784191887.958166:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23d2c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:69112:x1870858812347648:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191887.958181:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191887.958188:0:165501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ad00 lrc: 5/0,0 mode: PR/PR res: [0x240002340:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6fc expref: 12 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.958204:0:165501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ad00 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6fc expref: 12 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.958229:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xd:0x0].0x0 (ffff8af23d0d5a00) 00010000:00010000:0.0:1784191887.958234:0:165501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ad54 lrc: 3/0,1 mode: --/EX res: [0x240002340:0xd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.958244:0:165501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ad54 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0xd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.958267:0:165501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ad54 lrc: 4/0,1 mode: EX/EX res: [0x240002340:0xd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.958289:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191887.958343:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23d2c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:69112:x1870858812347648:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 178us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191887.958350:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 105 00010000:00010000:1.0:1784191887.959527:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ad00 lrc: 0/0,0 mode: --/PR res: [0x240002340:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6fc expref: 11 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191887.959555:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:158665:1870858827934592:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191887.959590:0:158665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ad54 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.959599:0:158665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ad54 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.959605:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ad54 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.959664:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.959672:0:158665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.959717:0:158665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191887.959739:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827934720:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1784191887.959813:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191887.959849:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784191887.959873:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827934720 00000100:00100000:1.0:1784191887.959879:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827934720 00000100:00100000:1.0:1784191887.959922:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:1.0:1784191887.959930:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:158665:x1870858827934720:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1784191887.959946:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191887.959960:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4ad62 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4ad5b expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.959987:0:158671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4ad0e lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b703 expref: 5 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.959997:0:158671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4ad62 lrc: 4/0,0 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad5b expref: 11 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.960021:0:158671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4ad0e lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b703 expref: 5 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.960035:0:158671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4ad0e lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b703 expref: 5 pid: 158667 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191887.960046:0:158671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016be680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827934848:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191887.960120:0:158671:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191887.966209:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191887.966300:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812347776 00000100:00100000:2.0:1784191887.966310:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812347776 00010000:00010000:2.0:1784191887.966359:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4ad0e lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b703 expref: 6 pid: 158667 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191887.966401:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 106 00000100:00100000:2.0:1784191887.966411:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812347776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191887.966426:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191887.966448:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4ad0e lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b703 expref: 6 pid: 158667 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.966463:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4ad0e lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b703 expref: 6 pid: 158667 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.966487:0:160189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xd:0x0].0x0 (ffff8af210dfed00) 00010000:00010000:2.0:1784191887.966494:0:160189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4ad62 lrc: 3/0,0 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad5b expref: 11 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.966505:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4ad62 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad5b expref: 11 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.966513:0:160189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4ad62 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad5b expref: 11 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.966548:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4ad62 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad5b expref: 11 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191887.966562:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:160189:1870858827934976:0@lo:105: 00000100:00100000:2.0:1784191887.966622:0:160189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191887.966676:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e2180 going to sleep for 11 seconds 00010000:00010000:1.0:1784191887.969118:0:158671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4ad0e lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b703 expref: 6 pid: 158667 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191887.969152:0:158671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016be680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827934848:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191887.969187:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4ad62 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad5b expref: 11 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.969197:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xd:0x0].0x0 (ffff8af210dfed00) 00010000:00010000:1.0:1784191887.969199:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784191887.969203:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8a00, rc 0) 00000100:00100000:1.0:1784191887.969289:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:158665:x1870858827934720:12345-0@lo:101:mdt00_000.0 Request processed in 9359us (9475us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191887.969300:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:1.0:1784191887.969356:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827934720:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1784191887.969375:0:158665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ad62 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.969386:0:158665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ad62 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191887.970132:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827934976 00000100:00100000:0.0:1784191887.970144:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827934976 00000100:00100000:0.0:1784191887.970207:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784191887.970217:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:160189:x1870858827934976:12345-0@lo:105: 00010000:00010000:0.0:1784191887.970230:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 5/0,1 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ad62 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.970240:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 5/0,1 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ad62 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.970249:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 5/0,1 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ad62 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.970257:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 5/0,1 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4ad62 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.970265:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 6/0,1 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4ad62 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.970273:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 6/0,1 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4ad62 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.970315:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af1115b9400) 00000100:00100000:0.0:1784191887.970373:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:160189:x1870858827934976:12345-0@lo:105: Request processed in 158us (3750us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191887.970381:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784191887.970477:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:160189:1870858827934976:0@lo:105: 00010000:00010000:2.0:1784191887.970496:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191887.970548:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69112:x1870858812347776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4137us (4350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191887.970556:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 106 00010000:00010000:1.0:1784191887.971100:0:158665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ad62 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.971112:0:158665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ad62 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191887.973512:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827935104:0@lo:403:mdt00_000.0 00000100:00100000:1.0:1784191887.974768:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191887.975226:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784191887.977303:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827935104 00000100:00100000:0.0:1784191887.977317:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827935104 00000100:00100000:0.0:1784191887.977440:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:0.0:1784191887.977452:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:158665:x1870858827935104:12345-0@lo:403:mdt00_000.0 00000100:00100000:0.0:1784191887.979390:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:158665:x1870858827935104:12345-0@lo:403:mdt00_000.0 Request processed in 1934us (4624us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191887.979403:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1784191887.979547:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827935104:0@lo:403:mdt00_000.0 00000040:00080000:1.0:1784191887.980609:0:158665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002b10:0x2:0x0].2, 944 off34656 00000100:00100000:1.0:1784191887.980897:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827935232:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784191887.980962:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191887.985190:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f000 going to sleep for 11 seconds 00000100:00100000:3.0:1784191887.985337:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827935232 00000100:00100000:3.0:1784191887.985347:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827935232 00000100:00100000:2.0:1784191887.985560:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:2.0:1784191887.985598:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:158665:x1870858827935232:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784191887.985813:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:158665:x1870858827935232:12345-0@lo:1000:mdt00_000.0 Request processed in 218us (4850us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191887.985822:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:3.0:1784191887.986142:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827935232:0@lo:1000:mdt00_000.0 00000040:00080000:3.0:1784191887.986199:0:158665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab4:0x2:0x0].2, 1024 off34816 00000004:00080000:3.0:1784191887.986219:0:158665:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af10f20fd80 with version 9 00000004:00080000:0.0:1784191887.986280:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 9 rpc_version 9 00000020:00100000:0.0:1784191887.986314:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784191887.986322:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af10ec82300 x1870858827935488/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784191887.986348:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec82300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827935488:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784191887.986393:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191887.986420:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e738d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784191887.986775:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827935488 00000100:00100000:3.0:1784191887.986782:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827935488 00000100:00100000:3.0:1784191887.986894:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1784191887.986903:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:165486:x1870858827935488:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784191887.987364:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:165486:x1870858827935488:12345-0@lo:1000:osp_up0-1.0 Request processed in 461us (969us total) trans 34359738641 rc 0/0 00000100:00100000:3.0:1784191887.987374:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:0.0:1784191887.988086:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec82300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827935488:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1784191887.988285:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1784191887.988314:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ad54 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.988324:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ad54 lrc: 2/0,0 mode: EX/EX res: [0x240002340:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.988332:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ad54 lrc: 3/0,0 mode: EX/EX res: [0x240002340:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.988338:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191887.988343:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ad54 lrc: 3/0,0 mode: EX/EX res: [0x240002340:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.988351:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ad54 lrc: 4/0,0 mode: EX/EX res: [0x240002340:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.988367:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xd:0x0].0x0 (ffff8af23d0d5a00) 00010000:00010000:3.0:1784191887.988370:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784191887.988375:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ad54 lrc: 2/0,0 mode: --/EX res: [0x240002340:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.988381:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ad54 lrc: 0/0,0 mode: --/EX res: [0x240002340:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.988418:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ad62 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.988426:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4ad62 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.988432:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4ad62 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.988485:0:158665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1784191887.988495:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0xd:0x0] 00010000:00010000:3.0:1784191887.988505:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4ad4d lrc: 3/0,1 mode: EX/EX res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.988512:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4ad4d lrc: 2/0,0 mode: EX/EX res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.988518:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4ad4d lrc: 3/0,0 mode: EX/EX res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.988523:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191887.988526:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4ad4d lrc: 3/0,0 mode: EX/EX res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.988532:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4ad4d lrc: 4/0,0 mode: EX/EX res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.988539:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0xa:0x0].0x0 (ffff8af23d0d5b00) 00010000:00010000:3.0:1784191887.988541:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191887.988553:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4ad4d lrc: 2/0,0 mode: --/EX res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.988559:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4ad4d lrc: 0/0,0 mode: --/EX res: [0x240002343:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.988584:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8c00/0xfeec3c2dc5a4ad3f lrc: 4/0,1 mode: EX/EX res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ad46 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.988592:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8c00/0xfeec3c2dc5a4ad3f lrc: 4/0,1 mode: EX/EX res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4ad46 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191887.988598:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8c00/0xfeec3c2dc5a4ad3f lrc: 3/0,0 mode: EX/EX res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4ad46 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.988902:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784191887.988911:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4ad62 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.988918:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9400 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:1.0:1784191887.988923:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4ad62 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191887.988930:0:158654:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4ad62 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.988967:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ad62 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.988973:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191887.989016:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 1/0,0 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ad62 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.989036:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ad5b lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ad62 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.989051:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191887.989054:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8c00/0xfeec3c2dc5a4ad3f lrc: 4/0,0 mode: EX/EX res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4ad46 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.989060:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8c00 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:1.0:1784191887.989063:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8c00/0xfeec3c2dc5a4ad3f lrc: 5/0,0 mode: EX/EX res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4ad46 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191887.989069:0:158654:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8c00/0xfeec3c2dc5a4ad3f lrc: 5/0,0 mode: EX/EX res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4ad46 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.989086:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8c00/0xfeec3c2dc5a4ad3f lrc: 4/0,0 mode: --/EX res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ad46 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.989092:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191887.989108:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8c00/0xfeec3c2dc5a4ad3f lrc: 3/0,0 mode: --/EX res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ad46 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.989116:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191887.989118:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191887.989120:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191887.989129:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784191887.989147:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827935744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191887.989217:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191887.989281:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827935744 00000100:00100000:1.0:1784191887.989287:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827935744 00000100:00100000:1.0:1784191887.989335:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784191887.989344:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+12:106500:x1870858827935744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191887.989358:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191887.989376:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4ad46 lrc: 0/0,0 mode: --/EX res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad3f expref: 12 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.989389:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0xa:0x0].0x0 (ffff8af23d0d5e00) 00010000:00010000:1.0:1784191887.989396:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191887.989427:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:106500:x1870858827935744:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191887.989434:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784191887.989470:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827935744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784191887.989527:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827935616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784191887.989558:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191887.992838:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827935616 00000100:00100000:1.0:1784191887.992858:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827935616 00000100:00100000:1.0:1784191887.992937:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784191887.992948:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:106502:x1870858827935616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191887.992965:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191887.992991:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4ad62 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad5b expref: 11 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.993011:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xd:0x0].0x0 (ffff8af210dfed00) 00010000:00010000:1.0:1784191887.993022:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191887.993105:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:106502:x1870858827935616:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (3545us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191887.993113:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784191887.993189:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827935616:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784191887.994734:0:158665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784191887.994750:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8c00/0xfeec3c2dc5a4ad3f lrc: 0/0,0 mode: --/EX res: [0x240002343:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ad46 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191887.994872:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1784191887.995026:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191887.995039:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ad2a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.995051:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4ad2a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.995059:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4ad2a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.995085:0:158665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1784191887.995092:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1784191887.995098:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8000/0xfeec3c2dc5a4ad31 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ad38 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191887.995106:0:158665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8000/0xfeec3c2dc5a4ad31 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ad38 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191887.995225:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:123674:x1870858812347392:12345-192.168.204.16@tcp:36:rm.0 Request processed in 60332us (61230us total) trans 25769803782 rc 0/0 00000100:00100000:2.0:1784191887.995235:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 446 00010000:00010000:1.0:1784191887.995815:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191887.995824:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4ad2a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.995834:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9200 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:1.0:1784191887.995840:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4ad2a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191887.995849:0:160901:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4ad2a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.995890:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ad2a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.995897:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191887.995932:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ad2a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.995940:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4ad23 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ad2a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191887.995958:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191887.995960:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191887.995962:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191887.996042:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784191887.996060:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827935872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191887.996115:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191887.996322:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827935872 00000100:00100000:0.0:1784191887.996331:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827935872 00000100:00100000:0.0:1784191887.996385:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784191887.996394:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:106499:x1870858827935872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784191887.996407:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191887.996426:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4ad2a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad23 expref: 10 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191887.996450:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af219b92400) 00010000:00010000:0.0:1784191887.996459:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191887.996504:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:106499:x1870858827935872:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191887.996512:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784191887.996593:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827935872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191888.014236:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.014400:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812347904 00000100:00100000:2.0:1784191888.014411:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812347904 00000100:00100000:2.0:1784191888.014477:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 447 00000100:00100000:2.0:1784191888.014487:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:123674:x1870858812347904:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191888.014510:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.014538:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4ad69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b711 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.014761:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ad70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.014777:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ad70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.014789:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ad70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191888.014837:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191888.014841:0:161504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191888.014863:0:161504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ad70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.014889:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4ad69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b711 expref: 7 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.014907:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ad70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b711 expref: 6 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.014916:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af219b92700) 00010000:00010000:2.0:1784191888.014919:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191888.014935:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ec00, rc 0) 00000100:00100000:2.0:1784191888.015064:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812347904:12345-192.168.204.16@tcp:101:rm.0 Request processed in 577us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.015071:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 447 00000100:00100000:0.0:1784191888.020445:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.020590:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812348032 00000100:00100000:1.0:1784191888.020603:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812348032 00000100:00100000:1.0:1784191888.020676:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 448 00000100:00100000:1.0:1784191888.020724:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812348032:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:1.0:1784191888.020762:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191888.020784:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4ad77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b718 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.020859:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4ad7e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.020874:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4ad7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.020886:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4ad7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.020900:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4ad85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.020908:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4ad85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.020914:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4ad85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.021240:0:158666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db45880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:158666:1870858827936000:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784191888.021295:0:158666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.021330:0:158666:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f900 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.021418:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827936000 00000100:00100000:2.0:1784191888.021424:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827936000 00000100:00100000:2.0:1784191888.021462:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:2.0:1784191888.021469:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:158666:x1870858827936000:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784191888.021544:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:158666:x1870858827936000:12345-0@lo:1000:mdt00_001.0 Request processed in 75us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.021551:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:1.0:1784191888.021824:0:158666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db45880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:158666:1870858827936000:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1784191888.021868:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ad8c lrc: 3/1,0 mode: --/PR res: [0x240002343:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.021880:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ad8c lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.021897:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ad8c lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191888.021919:0:158666:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ad8c lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.021933:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4ad7e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.021940:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4ad7e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.021947:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4ad7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.021954:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4ad7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.021960:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191888.021965:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4ad7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.021972:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4ad7e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.021984:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af219b92700) 00010000:00010000:1.0:1784191888.022170:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191888.022177:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4ad7e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.022184:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4ad7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.022207:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4ad85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.022214:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4ad85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.022220:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4ad85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.022226:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191888.022229:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4ad85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.022235:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4ad85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.022244:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x30d22c80 (ffff8af23d0d5900) 00010000:00010000:1.0:1784191888.022246:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191888.022249:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4ad85 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.022255:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4ad85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.022293:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4ad77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b718 expref: 8 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.022308:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ad8c lrc: 3/0,0 mode: PR/PR res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b718 expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.022329:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x2:0x0].0x0 (ffff8af23d0d5e00) 00010000:00010000:1.0:1784191888.022332:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784191888.022334:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9400, rc 0) 00000100:00100000:1.0:1784191888.022782:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812348032:12345-192.168.204.16@tcp:101:rm.0 Request processed in 2095us (2345us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.022790:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 448 00000100:00100000:0.0:1784191888.028970:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.029241:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812348160 00000100:00100000:2.0:1784191888.029253:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812348160 00000100:00100000:2.0:1784191888.029319:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 449 00000100:00100000:2.0:1784191888.029330:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:123674:x1870858812348160:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191888.029356:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.029379:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4ad93 lrc: 2/0,0 mode: --/CR res: [0x240002343:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b71f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.029442:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4ad9a lrc: 3/1,0 mode: --/PR res: [0x240002343:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.029457:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4ad9a lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.029469:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4ad9a lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191888.029592:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1784191888.029612:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1784191888.029666:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4ad93 lrc: 0/0,0 mode: --/CR res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b71f expref: 13 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.029750:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4ad9a lrc: 3/0,0 mode: PR/PR res: [0x240002343:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b71f expref: 12 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.029761:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x2:0x0].0x0 (ffff8af219b92f00) 00010000:00010000:2.0:1784191888.029765:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784191888.029768:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e600, rc 0) 00000100:00100000:2.0:1784191888.030191:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:123674:x1870858812348160:12345-192.168.204.16@tcp:101:rm.0 Request processed in 860us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.030199:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 449 00000100:00100000:2.0:1784191888.039835:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.039999:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812348288 00000100:00100000:0.0:1784191888.040011:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812348288 00000100:00100000:0.0:1784191888.040078:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 450 00000100:00100000:0.0:1784191888.040088:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:123674:x1870858812348288:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191888.040113:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.040140:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ada1 lrc: 2/0,0 mode: --/CR res: [0x240002340:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b726 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.040211:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ada8 lrc: 3/1,0 mode: --/PR res: [0x240002340:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.040226:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ada8 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.040237:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ada8 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191888.040291:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002340:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1784191888.040297:0:161504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1784191888.040352:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ada1 lrc: 0/0,0 mode: --/CR res: [0x240002340:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b726 expref: 14 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.040388:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ada8 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b726 expref: 13 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.040397:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x5:0x0].0x0 (ffff8af210dfee00) 00010000:00010000:0.0:1784191888.040400:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784191888.040403:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3ec00, rc 0) 00000100:00100000:0.0:1784191888.040761:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:123674:x1870858812348288:12345-192.168.204.16@tcp:101:rm.0 Request processed in 672us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.040770:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 450 00000100:00100000:0.0:1784191888.047234:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.047330:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812348416 00000100:00100000:1.0:1784191888.047341:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812348416 00000100:00100000:1.0:1784191888.047405:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 451 00000100:00100000:1.0:1784191888.047416:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812348416:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:1.0:1784191888.047439:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191888.047466:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4adaf lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b72d expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.047540:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4adb6 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.047554:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4adb6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.047578:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4adb6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191888.047648:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1784191888.047655:0:158666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1784191888.047721:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4adaf lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b72d expref: 9 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.047758:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4adb6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b72d expref: 8 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.047767:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff8af23d0d5900) 00010000:00010000:1.0:1784191888.047770:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784191888.047773:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8a00, rc 0) 00000100:00100000:1.0:1784191888.047884:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812348416:12345-192.168.204.16@tcp:101:rm.0 Request processed in 469us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.047891:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 451 00000100:00100000:1.0:1784191888.055156:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.055251:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812348672 00000100:00100000:2.0:1784191888.055261:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812348672 00000100:00100000:2.0:1784191888.055326:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 452 00000100:00100000:2.0:1784191888.055338:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:123674:x1870858812348672:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191888.055361:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.055385:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4adbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b734 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191888.055549:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1784191888.055729:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4adbd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b734 expref: 15 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.055748:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af219b92e00) 00010000:00010000:2.0:1784191888.055751:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191888.055773:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4adbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b734 expref: 15 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.055794:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ea00, rc 0) 00000100:00100000:2.0:1784191888.055867:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:123674:x1870858812348672:12345-192.168.204.16@tcp:101:rm.0 Request processed in 531us (722us total) trans 25769803783 rc 301/301 00000100:00100000:2.0:1784191888.055874:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 452 00000100:00100000:0.0:1784191888.063171:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.063270:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812348800 00000100:00100000:1.0:1784191888.063281:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812348800 00000100:00100000:1.0:1784191888.063347:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 110 00000100:00100000:1.0:1784191888.063358:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:123674:x1870858812348800:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:0.0:1784191888.067981:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:123674:x1870858812348800:12345-192.168.204.16@tcp:37:rm.0 Request processed in 4609us (4805us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.067999:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 110 00000100:00100000:0.0:1784191888.083313:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.083478:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812348928 00000100:00100000:2.0:1784191888.083489:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812348928 00000100:00100000:2.0:1784191888.083574:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 111 00000100:00100000:2.0:1784191888.083587:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812348928:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:1.0:1784191888.091975:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812348928:12345-192.168.204.16@tcp:37:rm.0 Request processed in 8376us (8658us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.091993:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 111 00000100:00100000:1.0:1784191888.097250:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.097513:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812349184 00000100:00100000:0.0:1784191888.097523:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812349184 00000100:00100000:0.0:1784191888.097742:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 112 00000100:00100000:0.0:1784191888.097754:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:123674:x1870858812349184:12345-192.168.204.16@tcp:35:rm.0 00000100:00100000:0.0:1784191888.098022:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:123674:x1870858812349184:12345-192.168.204.16@tcp:35:rm.0 Request processed in 269us (786us total) trans 25769803784 rc 0/0 00000100:00100000:0.0:1784191888.098029:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 112 00000100:00100000:1.0:1784191888.101465:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.103879:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812349312 00000100:00100000:3.0:1784191888.103899:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812349312 00000100:00100000:3.0:1784191888.104071:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 65 00000100:00100000:3.0:1784191888.104084:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:69110:x1870858812349312:12345-192.168.204.16@tcp:103:rm.0 00010000:00010000:3.0:1784191888.104101:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191888.104146:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ad8c lrc: 0/0,0 mode: --/PR res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b718 expref: 8 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.104168:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x2:0x0].0x0 (ffff8af23d0d5e00) 00010000:00010000:3.0:1784191888.104179:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191888.104239:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69110:x1870858812349312:12345-192.168.204.16@tcp:103:rm.0 Request processed in 159us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.104247:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 65 00000100:00100000:0.0:1784191888.104612:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.105227:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812349568 00000100:00100000:1.0:1784191888.105235:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812349568 00000100:00100000:1.0:1784191888.105277:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 453 00000100:00100000:1.0:1784191888.105285:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:123674:x1870858812349568:12345-192.168.204.16@tcp:36:rm.0 00010000:00010000:1.0:1784191888.105366:0:161504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.105388:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4ad9a lrc: 0/0,0 mode: --/PR res: [0x240002343:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b71f expref: 15 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.105418:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x2:0x0].0x0 (ffff8af219b92f00) 00010000:00010000:1.0:1784191888.105428:0:161504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784191888.105480:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4adcb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.105488:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4adcb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.105498:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4adcb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.105521:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827936128:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1784191888.105574:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.105612:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827936128 00000100:00100000:1.0:1784191888.105616:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827936128 00000100:00100000:1.0:1784191888.105675:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:1.0:1784191888.105681:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:161504:x1870858827936128:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191888.105726:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191888.105740:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4add2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4adcb expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.105763:0:158671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ad70 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b711 expref: 6 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.105771:0:158671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4add2 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4adcb expref: 10 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.105804:0:158671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ad70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b711 expref: 6 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.105827:0:158671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ad70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b711 expref: 6 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.105839:0:158671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db45f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827936256:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191888.105898:0:158671:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.105917:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.110221:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.110532:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812349696 00000100:00100000:0.0:1784191888.110542:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812349696 00010000:00010000:0.0:1784191888.110611:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ad70 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b711 expref: 7 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.110685:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 107 00000100:00100000:0.0:1784191888.110720:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69109:x1870858812349696:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191888.110737:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191888.110746:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ad70 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b711 expref: 7 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.110761:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ad70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b711 expref: 7 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.110791:0:160189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af219b92700) 00010000:00010000:0.0:1784191888.110798:0:160189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4add2 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4adcb expref: 10 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.110812:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4add2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4adcb expref: 10 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.110822:0:160189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4add2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4adcb expref: 10 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.110859:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4add2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4adcb expref: 10 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.110876:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:160189:1870858827936384:0@lo:105: 00000100:00100000:0.0:1784191888.110930:0:160189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.110980:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e738c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.111065:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827936384 00000100:00100000:1.0:1784191888.111070:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827936384 00000100:00100000:1.0:1784191888.111115:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784191888.111128:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:160189:x1870858827936384:12345-0@lo:105: 00010000:00010000:1.0:1784191888.111138:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4adcb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4add2 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.111148:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4adcb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4add2 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.111156:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4adcb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4add2 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.111163:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4adcb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4add2 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.111169:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4adcb lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4add2 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.111189:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4adcb lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4add2 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.111202:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af1115b9800) 00000100:00100000:1.0:1784191888.111240:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:160189:x1870858827936384:12345-0@lo:105: Request processed in 119us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.111248:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:2.0:1784191888.111570:0:158671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ad70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b711 expref: 7 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.111588:0:158671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db45f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827936256:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191888.111612:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4add2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4adcb expref: 10 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.111620:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af219b92700) 00010000:00010000:2.0:1784191888.111633:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191888.111636:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9a00, rc 0) 00000100:00100000:2.0:1784191888.111722:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:161504:x1870858827936128:12345-0@lo:101:mdt00_003.0 Request processed in 6041us (6147us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.111729:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:0.0:1784191888.111852:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:160189:1870858827936384:0@lo:105: 00010000:00010000:0.0:1784191888.111865:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191888.111913:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812349696:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1196us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.111921:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 107 00000100:00100000:1.0:1784191888.113408:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827936128:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191888.113438:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4adcb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4add2 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191888.113468:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784191888.113513:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8400/0xfeec3c2dc5a4add9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.113521:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8400/0xfeec3c2dc5a4add9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.113530:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8400/0xfeec3c2dc5a4add9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.113550:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827936512:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1784191888.113614:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.113654:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.113790:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827936512 00000100:00100000:0.0:1784191888.113799:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827936512 00000100:00100000:0.0:1784191888.113849:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:0.0:1784191888.113858:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:161504:x1870858827936512:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1784191888.113876:0:159636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.113893:0:159636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4ade0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4add9 expref: -99 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.113919:0:159636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4ade0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4add9 expref: 11 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.113934:0:159636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4ade0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4add9 expref: 11 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.113941:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x30d22c80 (ffff8af210dfec00) 00010000:00010000:0.0:1784191888.113944:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191888.113948:0:159636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3fe00, rc 0) 00000100:00100000:0.0:1784191888.113989:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:161504:x1870858827936512:12345-0@lo:101:mdt00_003.0 Request processed in 132us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.113996:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:1.0:1784191888.114013:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827936512:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191888.114024:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8400/0xfeec3c2dc5a4add9 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ade0 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.114053:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8400/0xfeec3c2dc5a4add9 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ade0 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191888.114066:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1784191888.114098:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827936640:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191888.114123:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.114149:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f900 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.114446:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827936640 00000100:00100000:0.0:1784191888.114451:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827936640 00000100:00100000:0.0:1784191888.114499:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:0.0:1784191888.114505:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:161504:x1870858827936640:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191888.114594:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:161504:x1870858827936640:12345-0@lo:1000:mdt00_003.0 Request processed in 88us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.114603:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:3.0:1784191888.115025:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827936640:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191888.115091:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827936768:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784191888.115132:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191888.115153:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.115213:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827936768 00000100:00100000:0.0:1784191888.115218:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827936768 00000100:00100000:0.0:1784191888.115254:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:0.0:1784191888.115261:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:161504:x1870858827936768:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784191888.115357:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:161504:x1870858827936768:12345-0@lo:1000:mdt00_003.0 Request processed in 96us (224us total) trans 0 rc 1/1 00000100:00100000:0.0:1784191888.115364:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:3.0:1784191888.115461:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827936768:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1784191888.115516:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4ade7 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.115527:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4ade7 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.115537:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4ade7 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.115550:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827936896:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1784191888.115588:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191888.115610:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.116014:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827936896 00000100:00100000:1.0:1784191888.116019:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827936896 00000100:00100000:1.0:1784191888.116052:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:1.0:1784191888.116059:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:161504:x1870858827936896:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784191888.116071:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191888.116090:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4adee lrc: 2/0,0 mode: --/EX res: [0x240002343:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4ade7 expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.116116:0:158671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4adee lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ade7 expref: 12 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.116131:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4adee lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ade7 expref: 12 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.116140:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x2:0x0].0x0 (ffff8af23d0d5800) 00010000:00010000:1.0:1784191888.116143:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784191888.116147:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9400, rc 0) 00000100:00100000:1.0:1784191888.116189:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:161504:x1870858827936896:12345-0@lo:101:mdt00_003.0 Request processed in 130us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.116213:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:3.0:1784191888.116412:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827936896:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1784191888.116427:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4ade7 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4adee expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.116444:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4ade7 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4adee expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.116472:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4adf5 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.116481:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4adf5 lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.116488:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4adf5 lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.116613:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4adfc lrc: 3/0,1 mode: --/EX res: [0x240002340:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.116635:0:161504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ada8 lrc: 2/0,0 mode: PR/PR res: [0x240002340:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b726 expref: 14 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.116645:0:161504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4adfc lrc: 4/0,1 mode: --/EX res: [0x240002340:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.116825:0:161504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ada8 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b726 expref: 14 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.116844:0:161504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ada8 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b726 expref: 14 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.116858:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:161504:1870858827937024:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191888.116975:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784191888.123940:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:161504:1870858827937024:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191888.123976:0:161504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4adfc lrc: 3/0,1 mode: --/EX res: [0x240002340:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.126124:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.126591:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812349824 00000100:00100000:1.0:1784191888.126602:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812349824 00010000:00010000:1.0:1784191888.126654:0:165501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ada8 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b726 expref: 15 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.126946:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 108 00000100:00100000:1.0:1784191888.126959:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23d2c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:69111:x1870858812349824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.126977:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.126985:0:165501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ada8 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b726 expref: 15 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.127000:0:165501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ada8 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b726 expref: 15 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.127027:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ada8 lrc: 0/0,0 mode: --/PR res: [0x240002340:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b726 expref: 15 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.127046:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x5:0x0].0x0 (ffff8af210dfee00) 00010000:00010000:1.0:1784191888.127052:0:165501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4adfc lrc: 3/0,1 mode: --/EX res: [0x240002340:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.127062:0:165501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4adfc lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.127070:0:165501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4adfc lrc: 4/0,1 mode: EX/EX res: [0x240002340:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.127200:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191888.127272:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23d2c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:69111:x1870858812349824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 314us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.127282:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 108 00010000:00010000:0.0:1784191888.133193:0:161504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4adfc lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.133213:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4adfc lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.133294:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f600/0xfeec3c2dc5a4ae03 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.133303:0:161504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f600/0xfeec3c2dc5a4ae03 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.133315:0:161504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f600/0xfeec3c2dc5a4ae03 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.133345:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827937152:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1784191888.133421:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.134203:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e738c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.137815:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827937152 00000100:00100000:2.0:1784191888.137837:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827937152 00000100:00100000:2.0:1784191888.137946:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:2.0:1784191888.137957:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:161504:x1870858827937152:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1784191888.137981:0:159636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.138310:0:159636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ae0a lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4ae03 expref: -99 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.138351:0:159636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4adb6 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b72d expref: 5 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.138361:0:159636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ae0a lrc: 4/0,0 mode: --/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae03 expref: 13 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.138400:0:159636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4adb6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b72d expref: 5 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.138414:0:159636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4adb6 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b72d expref: 5 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.138429:0:159636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de47480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:159636:1870858827937280:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191888.138543:0:159636:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.144964:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.145208:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812349952 00000100:00100000:3.0:1784191888.145218:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812349952 00010000:00010000:3.0:1784191888.145261:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4adb6 lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b72d expref: 6 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.145361:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 109 00000100:00100000:3.0:1784191888.145372:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812349952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191888.145387:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191888.145394:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4adb6 lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b72d expref: 6 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.145409:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4adb6 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b72d expref: 6 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.145432:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff8af23d0d5900) 00010000:00010000:3.0:1784191888.145439:0:158651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ae0a lrc: 3/0,0 mode: --/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae03 expref: 13 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.145449:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ae0a lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae03 expref: 13 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.145458:0:158651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ae0a lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae03 expref: 13 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.145515:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ae0a lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae03 expref: 13 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.145531:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:158651:1870858827937408:0@lo:105: 00000100:00100000:3.0:1784191888.145591:0:158651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191888.145648:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35e40 going to sleep for 11 seconds 00010000:00010000:0.0:1784191888.148153:0:159636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4adb6 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b72d expref: 6 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.148180:0:159636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de47480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:159636:1870858827937280:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191888.148214:0:159636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ae0a lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae03 expref: 13 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.148224:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff8af23d0d5900) 00010000:00010000:0.0:1784191888.148227:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784191888.148230:0:159636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ec00, rc 0) 00000100:00100000:0.0:1784191888.148321:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:161504:x1870858827937152:12345-0@lo:101:mdt00_003.0 Request processed in 10365us (14898us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.148330:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:2.0:1784191888.149101:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827937408 00000100:00100000:2.0:1784191888.149112:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827937408 00000100:00100000:2.0:1784191888.149168:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784191888.149178:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158651:x1870858827937408:12345-0@lo:105: 00010000:00010000:2.0:1784191888.149191:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f600/0xfeec3c2dc5a4ae03 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ae0a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.149225:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f600/0xfeec3c2dc5a4ae03 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ae0a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.149234:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f600/0xfeec3c2dc5a4ae03 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ae0a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.149244:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f600/0xfeec3c2dc5a4ae03 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4ae0a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.149252:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f600/0xfeec3c2dc5a4ae03 lrc: 5/0,1 mode: EX/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4ae0a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.149261:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f600/0xfeec3c2dc5a4ae03 lrc: 5/0,1 mode: EX/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4ae0a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.149280:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af10de3f600) 00000100:00100000:2.0:1784191888.149354:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158651:x1870858827937408:12345-0@lo:105: Request processed in 176us (3761us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.149361:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784191888.149399:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:158651:1870858827937408:0@lo:105: 00010000:00010000:2.0:1784191888.149421:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191888.149466:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69112:x1870858812349952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4094us (4511us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.149475:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 109 00000100:00100000:3.0:1784191888.149786:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827937152:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1784191888.149811:0:161504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f600/0xfeec3c2dc5a4ae03 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ae0a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.150492:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827937536:0@lo:403:mdt00_003.0 00000100:00100000:3.0:1784191888.150548:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191888.150593:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827937536 00000100:00100000:3.0:1784191888.150598:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827937536 00000100:00100000:3.0:1784191888.150651:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1784191888.150660:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:161504:x1870858827937536:12345-0@lo:403:mdt00_003.0 00000100:00100000:3.0:1784191888.152454:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:161504:x1870858827937536:12345-0@lo:403:mdt00_003.0 Request processed in 1788us (1897us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.152467:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1784191888.152509:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191888.152538:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:161504:1870858827937536:0@lo:403:mdt00_003.0 00000040:00080000:0.0:1784191888.158030:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002b10:0x2:0x0].3, 944 off35600 00000040:00080000:0.0:1784191888.158202:0:161504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab4:0x2:0x0].3, 1024 off35840 00000004:00080000:0.0:1784191888.158208:0:161504:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af23e738c00 with version 10 00000004:00080000:1.0:1784191888.158301:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 10 rpc_version 10 00000020:00100000:1.0:1784191888.158337:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784191888.158680:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af10db47800 x1870858827937792/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2608/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784191888.158945:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db47800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827937792:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784191888.159027:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.159110:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.159161:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827937792 00000100:00100000:2.0:1784191888.159171:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827937792 00000100:00100000:2.0:1784191888.159277:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:2.0:1784191888.159288:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:165486:x1870858827937792:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784191888.160146:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:165486:x1870858827937792:12345-0@lo:1000:osp_up0-1.0 Request processed in 857us (1115us total) trans 34359738642 rc 0/0 00000100:00100000:2.0:1784191888.160157:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:1.0:1784191888.160524:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db47800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827937792:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1784191888.160661:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1784191888.160709:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4adfc lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.160722:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4adfc lrc: 2/0,0 mode: EX/EX res: [0x240002340:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.160732:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4adfc lrc: 3/0,0 mode: EX/EX res: [0x240002340:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.160738:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af110db2c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191888.160744:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4adfc lrc: 3/0,0 mode: EX/EX res: [0x240002340:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.160768:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4adfc lrc: 4/0,0 mode: EX/EX res: [0x240002340:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.160785:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x5:0x0].0x0 (ffff8af210dfee00) 00010000:00010000:0.0:1784191888.160788:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784191888.160805:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4adfc lrc: 2/0,0 mode: --/EX res: [0x240002340:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.160812:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4adfc lrc: 0/0,0 mode: --/EX res: [0x240002340:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.160834:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f600/0xfeec3c2dc5a4ae03 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ae0a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.160842:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f600/0xfeec3c2dc5a4ae03 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4ae0a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.160848:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f600/0xfeec3c2dc5a4ae03 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4ae0a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.160882:0:161504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1784191888.160893:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0x5:0x0] 00010000:00010000:0.0:1784191888.160905:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4adf5 lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.160910:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4adf5 lrc: 2/0,0 mode: EX/EX res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.160916:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4adf5 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.160931:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af110db2e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191888.160935:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4adf5 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.160941:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4adf5 lrc: 4/0,0 mode: EX/EX res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.160949:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x2:0x0].0x0 (ffff8af110071e00) 00010000:00010000:0.0:1784191888.160952:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191888.160955:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4adf5 lrc: 2/0,0 mode: --/EX res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.160960:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4adf5 lrc: 0/0,0 mode: --/EX res: [0x240002343:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.160973:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4ade7 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4adee expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.160980:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4ade7 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4adee expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.160987:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4ade7 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4adee expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.161009:0:161504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1784191888.161021:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784191888.161026:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4adcb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4add2 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.161044:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4adcb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4add2 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.161052:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4adcb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4add2 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.161066:0:161504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:0.0:1784191888.161071:0:161504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784191888.161076:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8400/0xfeec3c2dc5a4add9 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ade0 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.161084:0:161504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8400/0xfeec3c2dc5a4add9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ade0 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.161164:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:123674:x1870858812349568:12345-192.168.204.16@tcp:36:rm.0 Request processed in 55876us (56551us total) trans 25769803785 rc 0/0 00000100:00100000:0.0:1784191888.161172:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 453 00010000:00010000:3.0:1784191888.161328:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784191888.161336:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f600/0xfeec3c2dc5a4ae03 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4ae0a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.161367:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3f600 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:3.0:1784191888.161372:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f600/0xfeec3c2dc5a4ae03 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4ae0a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191888.161380:0:158654:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f600/0xfeec3c2dc5a4ae03 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4ae0a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.161415:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f600/0xfeec3c2dc5a4ae03 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ae0a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.161421:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784191888.161451:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f600/0xfeec3c2dc5a4ae03 lrc: 1/0,0 mode: --/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ae0a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.161459:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3f600/0xfeec3c2dc5a4ae03 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ae0a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.161475:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784191888.161479:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4ade7 lrc: 2/0,0 mode: EX/EX res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4adee expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.161485:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af110db3a00 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:3.0:1784191888.161489:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4ade7 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4adee expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191888.161496:0:158654:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4ade7 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4adee expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.161525:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4ade7 lrc: 2/0,0 mode: --/EX res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4adee expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.161531:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784191888.161538:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4ade7 lrc: 1/0,0 mode: --/EX res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4adee expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.161557:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4ade7 lrc: 0/0,0 mode: --/EX res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4adee expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.161570:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784191888.161573:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4adcb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4add2 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.161579:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9800 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:3.0:1784191888.161584:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4adcb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4add2 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191888.161591:0:158654:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4adcb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4add2 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.161606:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4adcb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4add2 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.161611:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784191888.161641:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4adcb lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4add2 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.161659:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4adcb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4add2 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.161672:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191888.161674:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191888.161675:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191888.161684:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784191888.161729:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827938176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191888.161787:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191888.162046:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827938176 00000100:00100000:3.0:1784191888.162053:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827938176 00000100:00100000:3.0:1784191888.162093:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784191888.162101:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+14:106500:x1870858827938176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784191888.162115:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191888.162135:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4add2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4adcb expref: 14 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.162149:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af219b92700) 00010000:00010000:3.0:1784191888.162157:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191888.162190:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+13:106500:x1870858827938176:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.162196:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784191888.162232:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827938176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191888.162320:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827937920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191888.162369:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.162397:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784191888.162403:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827938048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191888.162425:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784191888.162553:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191888.162568:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827937920 00000100:00100000:1.0:1784191888.162572:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827937920 00000100:00100000:1.0:1784191888.162606:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827938048 00000100:00100000:1.0:1784191888.162610:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827938048 00000100:00100000:1.0:1784191888.162642:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784191888.162650:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+14:106501:x1870858827937920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.162660:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.162673:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4ae0a lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae03 expref: 14 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.162685:0:160189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x5:0x0].0x0 (ffff8af23d0d5900) 00010000:00010000:1.0:1784191888.162712:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191888.162746:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+13:106501:x1870858827937920:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.162762:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784191888.162777:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784191888.162784:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:106501:x1870858827938048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.162975:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.162989:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4adee lrc: 0/0,0 mode: --/EX res: [0x240002343:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ade7 expref: 12 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.163000:0:160189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x2:0x0].0x0 (ffff8af23d0d5800) 00010000:00010000:1.0:1784191888.163006:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191888.163031:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:106501:x1870858827938048:12345-0@lo:103:ldlm_bl.0 Request processed in 248us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.163038:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784191888.163067:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827938048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191888.163076:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827937920:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191888.166638:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191888.167966:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.168066:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812350080 00000100:00100000:1.0:1784191888.168075:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812350080 00000100:00100000:1.0:1784191888.168241:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 454 00000100:00100000:1.0:1784191888.168256:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:123674:x1870858812350080:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:1.0:1784191888.168284:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191888.168316:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4ae11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b73b expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.168402:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8c00/0xfeec3c2dc5a4ae18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.168418:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8c00/0xfeec3c2dc5a4ae18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.168452:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8c00/0xfeec3c2dc5a4ae18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191888.168514:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784191888.168519:0:164531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784191888.168655:0:164531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8c00/0xfeec3c2dc5a4ae18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.169084:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4ae11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b73b expref: 7 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.169116:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8c00/0xfeec3c2dc5a4ae18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b73b expref: 6 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.169127:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5500) 00010000:00010000:1.0:1784191888.169130:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784191888.169134:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8c00, rc 0) 00000100:00100000:1.0:1784191888.169218:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812350080:12345-192.168.204.16@tcp:101:rm.0 Request processed in 966us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.169227:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 454 00000100:00100000:1.0:1784191888.172662:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.173003:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812350208 00000100:00100000:0.0:1784191888.173015:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812350208 00000100:00100000:0.0:1784191888.173117:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 455 00000100:00100000:0.0:1784191888.173128:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812350208:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191888.173165:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.173186:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4ae1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b742 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.173250:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4ae26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.173266:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4ae26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.173279:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4ae26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.173295:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4ae2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.173301:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4ae2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.173307:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4ae2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.173426:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d636300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:158667:1870858827938304:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784191888.173485:0:158667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.173528:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107aff480 going to sleep for 11 seconds 00000100:00100000:3.0:1784191888.173603:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827938304 00000100:00100000:3.0:1784191888.173608:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827938304 00000100:00100000:3.0:1784191888.173656:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1784191888.173671:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:158667:x1870858827938304:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1784191888.173780:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:158667:x1870858827938304:12345-0@lo:1000:mdt00_002.0 Request processed in 110us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.173789:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:2.0:1784191888.173891:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d636300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:158667:1870858827938304:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1784191888.173934:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4ae34 lrc: 3/1,0 mode: --/PR res: [0x240002343:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.173944:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4ae34 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.173952:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4ae34 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191888.173975:0:158667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4ae34 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.173987:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4ae26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.173994:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4ae26 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.174000:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4ae26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.174005:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191888.174010:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4ae26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.174024:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4ae26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.174037:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5500) 00010000:00010000:2.0:1784191888.174041:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191888.174045:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4ae26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.174050:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4ae26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.174066:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4ae2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.174070:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4ae2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.174075:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4ae2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.174079:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3fa00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191888.174082:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4ae2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.174087:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4ae2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.174093:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc86efa78 (ffff8af210dfeb00) 00010000:00010000:2.0:1784191888.174096:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191888.174098:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4ae2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.174110:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4ae2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.174145:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4ae1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b742 expref: 8 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.174159:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4ae34 lrc: 3/0,0 mode: PR/PR res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b742 expref: 7 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.174166:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x3:0x0].0x0 (ffff8af219b92e00) 00010000:00010000:2.0:1784191888.174169:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191888.174171:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e200, rc 0) 00000100:00100000:2.0:1784191888.174229:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812350208:12345-192.168.204.16@tcp:101:rm.0 Request processed in 1103us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.174236:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 455 00000100:00100000:0.0:1784191888.177004:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.177892:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812350336 00000100:00100000:1.0:1784191888.177903:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812350336 00000100:00100000:1.0:1784191888.177971:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 456 00000100:00100000:1.0:1784191888.177983:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:123674:x1870858812350336:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:1.0:1784191888.178011:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191888.178037:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ae3b lrc: 2/0,0 mode: --/CR res: [0x240002343:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b749 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.178118:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4ae42 lrc: 3/1,0 mode: --/PR res: [0x240002343:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.178134:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4ae42 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.178147:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4ae42 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191888.178247:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1784191888.178252:0:158666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1784191888.178294:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ae3b lrc: 0/0,0 mode: --/CR res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b749 expref: 16 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.178311:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4ae42 lrc: 3/0,0 mode: PR/PR res: [0x240002343:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b749 expref: 15 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.178320:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x3:0x0].0x0 (ffff8af23d0d5800) 00010000:00010000:1.0:1784191888.178323:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784191888.178326:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9000, rc 0) 00000100:00100000:1.0:1784191888.178386:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:123674:x1870858812350336:12345-192.168.204.16@tcp:101:rm.0 Request processed in 405us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.178394:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 456 00000100:00100000:2.0:1784191888.181250:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.181333:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812350464 00000100:00100000:1.0:1784191888.181344:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812350464 00000100:00100000:1.0:1784191888.181431:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 457 00000100:00100000:1.0:1784191888.181442:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:123674:x1870858812350464:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:1.0:1784191888.181481:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191888.181505:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ae49 lrc: 2/0,0 mode: --/CR res: [0x240002340:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b750 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.181585:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4ae50 lrc: 3/1,0 mode: --/PR res: [0x240002340:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.181600:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4ae50 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.181612:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4ae50 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191888.181668:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002340:0x6:0x0]: returning size 4096 00000004:00200000:1.0:1784191888.181673:0:164531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1784191888.181739:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ae49 lrc: 0/0,0 mode: --/CR res: [0x240002340:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b750 expref: 17 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.181756:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4ae50 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b750 expref: 16 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.181765:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x6:0x0].0x0 (ffff8af23d0d5900) 00010000:00010000:1.0:1784191888.181768:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784191888.181772:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9a00, rc 0) 00000100:00100000:1.0:1784191888.181895:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+16:123674:x1870858812350464:12345-192.168.204.16@tcp:101:rm.0 Request processed in 455us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.181904:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 457 00000100:00100000:1.0:1784191888.184530:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.186096:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812350592 00000100:00100000:0.0:1784191888.186110:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812350592 00000100:00100000:0.0:1784191888.186184:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 458 00000100:00100000:0.0:1784191888.186194:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812350592:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191888.186230:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.186255:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4ae57 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b757 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.186327:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ae5e lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.186343:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ae5e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.186355:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ae5e lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191888.186406:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x6:0x0]: returning size 4096 00000004:00200000:0.0:1784191888.186411:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1784191888.186446:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4ae57 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b757 expref: 9 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.186466:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ae5e lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b757 expref: 8 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.186475:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x6:0x0].0x0 (ffff8af210dfee00) 00010000:00010000:0.0:1784191888.186478:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784191888.186481:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3ec00, rc 0) 00000100:00100000:0.0:1784191888.186754:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812350592:12345-192.168.204.16@tcp:101:rm.0 Request processed in 559us (2233us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.186762:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 458 00000100:00100000:0.0:1784191888.190556:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.190645:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812350848 00000100:00100000:1.0:1784191888.190666:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812350848 00000100:00100000:1.0:1784191888.190767:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 459 00000100:00100000:1.0:1784191888.190777:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+16:123674:x1870858812350848:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:1.0:1784191888.190807:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191888.190833:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ae65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b75e expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191888.190982:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1784191888.191079:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ae65 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b75e expref: 18 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.191094:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5400) 00010000:00010000:1.0:1784191888.191097:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784191888.191102:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4ae65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b75e expref: 18 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.191119:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9400, rc 0) 00000100:00100000:1.0:1784191888.191177:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:123674:x1870858812350848:12345-192.168.204.16@tcp:101:rm.0 Request processed in 401us (644us total) trans 25769803786 rc 301/301 00000100:00100000:1.0:1784191888.191184:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 459 00000100:00100000:0.0:1784191888.196204:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.196289:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812350976 00000100:00100000:1.0:1784191888.196299:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812350976 00000100:00100000:1.0:1784191888.196353:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 113 00000100:00100000:1.0:1784191888.196364:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1099f5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:123674:x1870858812350976:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:1.0:1784191888.202035:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1099f5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:123674:x1870858812350976:12345-192.168.204.16@tcp:37:rm.0 Request processed in 5655us (5824us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.202053:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 113 00000100:00100000:2.0:1784191888.207458:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.207644:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812351104 00000100:00100000:0.0:1784191888.207654:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812351104 00000100:00100000:0.0:1784191888.207747:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 114 00000100:00100000:0.0:1784191888.207758:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812351104:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:1.0:1784191888.212493:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812351104:12345-192.168.204.16@tcp:37:rm.0 Request processed in 4725us (5035us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.212509:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 114 00000100:00100000:2.0:1784191888.216251:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.216571:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812351360 00000100:00100000:1.0:1784191888.216581:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812351360 00000100:00100000:1.0:1784191888.216650:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 115 00000100:00100000:1.0:1784191888.216660:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:123674:x1870858812351360:12345-192.168.204.16@tcp:35:rm.0 00000100:00100000:1.0:1784191888.216969:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:123674:x1870858812351360:12345-192.168.204.16@tcp:35:rm.0 Request processed in 308us (729us total) trans 25769803787 rc 0/0 00000100:00100000:1.0:1784191888.216977:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 115 00000100:00100000:2.0:1784191888.225556:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.225603:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.225734:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812351488 00000100:00100000:3.0:1784191888.225745:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812351488 00000100:00100000:3.0:1784191888.225820:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 69 00000100:00100000:3.0:1784191888.225830:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:69109:x1870858812351488:12345-192.168.204.16@tcp:103:rm.0 00010000:00010000:3.0:1784191888.225845:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191888.225871:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4ae34 lrc: 0/0,0 mode: --/PR res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b742 expref: 8 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.225892:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x3:0x0].0x0 (ffff8af219b92e00) 00010000:00010000:3.0:1784191888.225903:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191888.225962:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69109:x1870858812351488:12345-192.168.204.16@tcp:103:rm.0 Request processed in 134us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.225970:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 69 00000100:00100000:1.0:1784191888.226197:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812351744 00000100:00100000:1.0:1784191888.226203:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812351744 00000100:00100000:1.0:1784191888.226249:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 460 00000100:00100000:1.0:1784191888.226258:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:123674:x1870858812351744:12345-192.168.204.16@tcp:36:rm.0 00010000:00010000:1.0:1784191888.226311:0:164531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.226330:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4ae42 lrc: 0/0,0 mode: --/PR res: [0x240002343:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b749 expref: 18 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.226342:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x3:0x0].0x0 (ffff8af23d0d5800) 00010000:00010000:1.0:1784191888.226362:0:164531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784191888.226414:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ae73 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.226424:0:164531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ae73 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.226434:0:164531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ae73 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.226478:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827938432:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1784191888.226525:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.226564:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.226764:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827938432 00000100:00100000:0.0:1784191888.226768:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827938432 00000100:00100000:0.0:1784191888.226813:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:0.0:1784191888.226821:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:164531:x1870858827938432:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1784191888.226835:0:159636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.226847:0:159636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4ae7a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4ae73 expref: -99 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.226870:0:159636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8c00/0xfeec3c2dc5a4ae18 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b73b expref: 6 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.226878:0:159636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4ae7a lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae73 expref: 12 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.226902:0:159636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8c00/0xfeec3c2dc5a4ae18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b73b expref: 6 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.226915:0:159636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8c00/0xfeec3c2dc5a4ae18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b73b expref: 6 pid: 164531 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.226927:0:159636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d637480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:159636:1870858827938560:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191888.226969:0:159636:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107aff540 going to sleep for 11 seconds 00000100:00100000:3.0:1784191888.231125:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.231194:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812351872 00000100:00100000:1.0:1784191888.231202:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812351872 00010000:00010000:1.0:1784191888.231242:0:165501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8c00/0xfeec3c2dc5a4ae18 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b73b expref: 7 pid: 164531 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.231283:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 110 00000100:00100000:1.0:1784191888.231292:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69109:x1870858812351872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.231305:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.231312:0:165501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8c00/0xfeec3c2dc5a4ae18 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b73b expref: 7 pid: 164531 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.231327:0:165501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8c00/0xfeec3c2dc5a4ae18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b73b expref: 7 pid: 164531 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.231357:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5500) 00010000:00010000:1.0:1784191888.231364:0:165501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4ae7a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae73 expref: 12 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.231376:0:165501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4ae7a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae73 expref: 12 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.231385:0:165501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4ae7a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae73 expref: 12 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.231434:0:165501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4ae7a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae73 expref: 12 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.231448:0:165501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:165501:1870858827938688:0@lo:105: 00000100:00100000:1.0:1784191888.231491:0:165501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.231531:0:165501:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f000 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.231647:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827938688 00000100:00100000:2.0:1784191888.231652:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827938688 00000100:00100000:2.0:1784191888.231714:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784191888.231721:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:165501:x1870858827938688:12345-0@lo:105: 00010000:00010000:2.0:1784191888.231732:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ae73 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ae7a expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.231753:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ae73 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ae7a expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.231762:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ae73 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ae7a expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.231769:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ae73 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4ae7a expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.231776:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ae73 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4ae7a expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.231784:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ae73 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4ae7a expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.231806:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af1115b9400) 00000100:00100000:2.0:1784191888.231840:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:165501:x1870858827938688:12345-0@lo:105: Request processed in 120us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.231847:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784191888.231881:0:165501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:165501:1870858827938688:0@lo:105: 00010000:00010000:2.0:1784191888.231899:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191888.231932:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69109:x1870858812351872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 640us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.231939:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 110 00010000:00010000:0.0:1784191888.232998:0:159636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8c00/0xfeec3c2dc5a4ae18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b73b expref: 6 pid: 164531 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.233033:0:159636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d637480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:159636:1870858827938560:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191888.233064:0:159636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4ae7a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae73 expref: 12 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.233073:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5500) 00010000:00010000:0.0:1784191888.233075:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191888.233078:0:159636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3e200, rc 0) 00000100:00100000:0.0:1784191888.233155:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:164531:x1870858827938432:12345-0@lo:101:mdt00_004.0 Request processed in 6334us (6628us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.233163:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:2.0:1784191888.233323:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827938432:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1784191888.233361:0:164531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ae73 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ae7a expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191888.233382:0:164531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1784191888.233419:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e600/0xfeec3c2dc5a4ae81 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.233427:0:164531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e600/0xfeec3c2dc5a4ae81 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.233437:0:164531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e600/0xfeec3c2dc5a4ae81 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.233454:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827938816:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1784191888.233486:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.233515:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e2180 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.233741:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827938816 00000100:00100000:1.0:1784191888.233748:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827938816 00000100:00100000:1.0:1784191888.233802:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:1.0:1784191888.233811:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:164531:x1870858827938816:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1784191888.233828:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191888.233845:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ae88 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4ae81 expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.233867:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ae88 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae81 expref: 13 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.233879:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ae88 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae81 expref: 13 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.233886:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc86efa78 (ffff8af23d0d5f00) 00010000:00010000:1.0:1784191888.233888:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191888.233891:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8800, rc 0) 00000100:00100000:1.0:1784191888.233923:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:164531:x1870858827938816:12345-0@lo:101:mdt00_004.0 Request processed in 113us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.233929:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:2.0:1784191888.234329:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827938816:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1784191888.234344:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e600/0xfeec3c2dc5a4ae81 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ae88 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.234355:0:164531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e600/0xfeec3c2dc5a4ae81 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ae88 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191888.234373:0:164531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1784191888.234406:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827938944:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1784191888.234436:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.234459:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.234513:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827938944 00000100:00100000:1.0:1784191888.234518:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827938944 00000100:00100000:1.0:1784191888.234658:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:1.0:1784191888.234666:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:164531:x1870858827938944:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1784191888.234772:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:164531:x1870858827938944:12345-0@lo:1000:mdt00_004.0 Request processed in 107us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.234780:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:2.0:1784191888.234847:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827938944:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1784191888.234897:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827939072:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1784191888.234921:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.235723:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e2180 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.235921:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827939072 00000100:00100000:0.0:1784191888.235928:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827939072 00000100:00100000:0.0:1784191888.236006:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:0.0:1784191888.236014:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:164531:x1870858827939072:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784191888.236140:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:164531:x1870858827939072:12345-0@lo:1000:mdt00_004.0 Request processed in 126us (1217us total) trans 0 rc 1/1 00000100:00100000:0.0:1784191888.236147:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:2.0:1784191888.236271:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827939072:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1784191888.236339:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e800/0xfeec3c2dc5a4ae8f lrc: 3/0,1 mode: --/EX res: [0x240002343:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.236348:0:164531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e800/0xfeec3c2dc5a4ae8f lrc: 3/0,1 mode: --/EX res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.236358:0:164531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e800/0xfeec3c2dc5a4ae8f lrc: 3/0,1 mode: --/EX res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.236373:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827939200:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1784191888.236401:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.236419:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e2180 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.236431:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827939200 00000100:00100000:2.0:1784191888.236435:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827939200 00000100:00100000:2.0:1784191888.236457:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:2.0:1784191888.236462:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:164531:x1870858827939200:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1784191888.236472:0:161739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.236487:0:161739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4ae96 lrc: 2/0,0 mode: --/EX res: [0x240002343:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4ae8f expref: -99 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.236509:0:161739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4ae96 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae8f expref: 14 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.236522:0:161739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4ae96 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae8f expref: 14 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.236556:0:161739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x3:0x0].0x0 (ffff8af219b92100) 00010000:00010000:2.0:1784191888.236559:0:161739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191888.236562:0:161739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ea00, rc 0) 00000100:00100000:2.0:1784191888.236593:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:164531:x1870858827939200:12345-0@lo:101:mdt00_004.0 Request processed in 129us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.236599:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:2.0:1784191888.236636:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827939200:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1784191888.236648:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e800/0xfeec3c2dc5a4ae8f lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ae96 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.236658:0:164531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e800/0xfeec3c2dc5a4ae8f lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ae96 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.236684:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4ae9d lrc: 3/0,1 mode: --/EX res: [0x240002343:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.236710:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4ae9d lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.236717:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4ae9d lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.237091:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4aea4 lrc: 3/0,1 mode: --/EX res: [0x240002340:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.237105:0:164531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4ae50 lrc: 2/0,0 mode: PR/PR res: [0x240002340:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b750 expref: 17 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.237128:0:164531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4aea4 lrc: 4/0,1 mode: --/EX res: [0x240002340:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.237153:0:164531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4ae50 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b750 expref: 17 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.237168:0:164531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4ae50 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b750 expref: 17 pid: 164531 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.237179:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:164531:1870858827939328:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191888.237246:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e2180 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.240580:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.240655:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812352000 00000100:00100000:1.0:1784191888.240664:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812352000 00010000:00010000:1.0:1784191888.240750:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4ae50 lrc: 5/0,0 mode: PR/PR res: [0x240002340:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b750 expref: 18 pid: 164531 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.240782:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 111 00000100:00100000:1.0:1784191888.240804:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23d2c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:69112:x1870858812352000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.240818:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.240825:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4ae50 lrc: 5/0,0 mode: PR/PR res: [0x240002340:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b750 expref: 18 pid: 164531 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.240840:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4ae50 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b750 expref: 18 pid: 164531 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.240864:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x6:0x0].0x0 (ffff8af23d0d5900) 00010000:00010000:1.0:1784191888.240869:0:158651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4aea4 lrc: 3/0,1 mode: --/EX res: [0x240002340:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.240878:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4aea4 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.240885:0:158651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4aea4 lrc: 4/0,1 mode: EX/EX res: [0x240002340:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.240922:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784191888.241118:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4ae50 lrc: 0/0,0 mode: --/PR res: [0x240002340:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b750 expref: 18 pid: 164531 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.241135:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:164531:1870858827939328:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191888.241160:0:164531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4aea4 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.241170:0:164531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4aea4 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.241188:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4aea4 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.241234:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4aeab lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.241241:0:164531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4aeab lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.241250:0:164531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4aeab lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.241270:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827939456:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1784191888.241313:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191888.241339:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191888.241660:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827939456 00000100:00100000:3.0:1784191888.241666:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827939456 00000100:00100000:3.0:1784191888.241731:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1784191888.241739:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:164531:x1870858827939456:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1784191888.241755:0:161739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191888.241770:0:161739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3400/0xfeec3c2dc5a4aeb2 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4aeab expref: -99 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.241909:0:161739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ae5e lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b757 expref: 5 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.241920:0:161739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3400/0xfeec3c2dc5a4aeb2 lrc: 4/0,0 mode: --/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4aeab expref: 15 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.241961:0:161739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ae5e lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b757 expref: 5 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.241974:0:161739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ae5e lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b757 expref: 5 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.241985:0:161739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101685f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827939584:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191888.242258:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23d2c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:69112:x1870858812352000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1464us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.242267:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 111 00000100:00100000:3.0:1784191888.242384:0:161739:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35240 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.245675:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.245911:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812352128 00000100:00100000:0.0:1784191888.245921:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812352128 00010000:00010000:0.0:1784191888.245962:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ae5e lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b757 expref: 6 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.246039:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 112 00000100:00100000:0.0:1784191888.246049:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812352128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191888.246080:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191888.246088:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ae5e lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b757 expref: 6 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.246115:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ae5e lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b757 expref: 6 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.246141:0:160189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x6:0x0].0x0 (ffff8af210dfee00) 00010000:00010000:0.0:1784191888.246148:0:160189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3400/0xfeec3c2dc5a4aeb2 lrc: 3/0,0 mode: --/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4aeab expref: 15 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.246160:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3400/0xfeec3c2dc5a4aeb2 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4aeab expref: 15 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.246169:0:160189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3400/0xfeec3c2dc5a4aeb2 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4aeab expref: 15 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.246206:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3400/0xfeec3c2dc5a4aeb2 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4aeab expref: 15 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.246221:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d637480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:160189:1870858827939712:0@lo:105: 00000100:00100000:0.0:1784191888.246270:0:160189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.246313:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107aff540 going to sleep for 11 seconds 00010000:00010000:3.0:1784191888.246454:0:161739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ae5e lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b757 expref: 6 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.246473:0:161739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101685f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827939584:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191888.246498:0:161739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3400/0xfeec3c2dc5a4aeb2 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4aeab expref: 15 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.246505:0:161739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x6:0x0].0x0 (ffff8af210dfee00) 00010000:00010000:3.0:1784191888.246508:0:161739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784191888.246510:0:161739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3400, rc 0) 00000100:00100000:1.0:1784191888.246719:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827939712 00000100:00100000:1.0:1784191888.246724:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827939712 00000100:00100000:1.0:1784191888.246764:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784191888.246772:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:160189:x1870858827939712:12345-0@lo:105: 00010000:00010000:1.0:1784191888.246784:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4aeab lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4aeb2 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.246804:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4aeab lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4aeb2 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.246812:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4aeab lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4aeb2 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.246820:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4aeab lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4aeb2 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.246827:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4aeab lrc: 5/0,1 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4aeb2 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.246834:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4aeab lrc: 5/0,1 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4aeb2 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.246861:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af110db3a00) 00000100:00100000:1.0:1784191888.246906:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:160189:x1870858827939712:12345-0@lo:105: Request processed in 134us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.246912:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784191888.247056:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d637480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:160189:1870858827939712:0@lo:105: 00010000:00010000:3.0:1784191888.247071:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191888.247125:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69112:x1870858812352128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1077us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.247134:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 112 00000100:00100000:2.0:1784191888.249641:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:164531:x1870858827939456:12345-0@lo:101:mdt00_004.0 Request processed in 7882us (8306us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.249654:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:0.0:1784191888.249949:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827939456:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1784191888.249976:0:164531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4aeab lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4aeb2 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.251026:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d637480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827939840:0@lo:403:mdt00_004.0 00000100:00100000:0.0:1784191888.251196:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.251277:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107aff540 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.251490:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827939840 00000100:00100000:1.0:1784191888.251498:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827939840 00000100:00100000:1.0:1784191888.251646:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:1.0:1784191888.251656:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:164531:x1870858827939840:12345-0@lo:403:mdt00_004.0 00000100:00100000:1.0:1784191888.255825:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:164531:x1870858827939840:12345-0@lo:403:mdt00_004.0 Request processed in 4160us (4618us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.255844:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:0.0:1784191888.255989:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d637480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827939840:0@lo:403:mdt00_004.0 00000040:00080000:0.0:1784191888.257423:0:164531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002b10:0x2:0x0].4, 944 off36544 00000040:00080000:0.0:1784191888.258060:0:164531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab4:0x2:0x0].4, 1024 off36864 00000004:00080000:0.0:1784191888.258068:0:164531:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af107aff540 with version 11 00000004:00080000:1.0:1784191888.258148:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 11 rpc_version 11 00000020:00100000:1.0:1784191888.258185:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784191888.258194:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af1016bdf80 x1870858827940096/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784191888.258221:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bdf80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827940096:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784191888.258291:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.258362:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.258412:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827940096 00000100:00100000:2.0:1784191888.258420:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827940096 00000100:00100000:2.0:1784191888.258649:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:2.0:1784191888.258661:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af205710c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:165486:x1870858827940096:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784191888.259142:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af205710c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:165486:x1870858827940096:12345-0@lo:1000:osp_up0-1.0 Request processed in 483us (850us total) trans 34359738643 rc 0/0 00000100:00100000:2.0:1784191888.259151:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:1.0:1784191888.259633:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bdf80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827940096:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1784191888.259714:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784191888.259736:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4aea4 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259745:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4aea4 lrc: 2/0,0 mode: EX/EX res: [0x240002340:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259753:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4aea4 lrc: 3/0,0 mode: EX/EX res: [0x240002340:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259759:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191888.259764:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4aea4 lrc: 3/0,0 mode: EX/EX res: [0x240002340:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259771:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4aea4 lrc: 4/0,0 mode: EX/EX res: [0x240002340:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259788:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x6:0x0].0x0 (ffff8af23d0d5900) 00010000:00010000:0.0:1784191888.259791:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784191888.259804:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4aea4 lrc: 2/0,0 mode: --/EX res: [0x240002340:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259825:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4aea4 lrc: 0/0,0 mode: --/EX res: [0x240002340:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259846:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4aeab lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4aeb2 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259854:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4aeab lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4aeb2 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259860:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4aeab lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4aeb2 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259884:0:164531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1784191888.259893:0:164531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0x6:0x0] 00010000:00010000:0.0:1784191888.259903:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4ae9d lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259909:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4ae9d lrc: 2/0,0 mode: EX/EX res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259915:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4ae9d lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259920:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ee00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191888.259923:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4ae9d lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259929:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4ae9d lrc: 4/0,0 mode: EX/EX res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259947:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x3:0x0].0x0 (ffff8af219b92300) 00010000:00010000:0.0:1784191888.259949:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191888.259952:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4ae9d lrc: 2/0,0 mode: --/EX res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259958:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4ae9d lrc: 0/0,0 mode: --/EX res: [0x240002343:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259970:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e800/0xfeec3c2dc5a4ae8f lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ae96 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259978:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e800/0xfeec3c2dc5a4ae8f lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4ae96 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259984:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e800/0xfeec3c2dc5a4ae8f lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4ae96 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.259996:0:164531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1784191888.260006:0:164531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784191888.260010:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ae73 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4ae7a expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.260016:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ae73 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4ae7a expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.260022:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ae73 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4ae7a expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.260040:0:164531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:0.0:1784191888.260052:0:164531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784191888.260057:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e600/0xfeec3c2dc5a4ae81 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ae88 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.260063:0:164531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e600/0xfeec3c2dc5a4ae81 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4ae88 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.260139:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:123674:x1870858812351744:12345-192.168.204.16@tcp:36:rm.0 Request processed in 33880us (34604us total) trans 25769803788 rc 0/0 00000100:00100000:0.0:1784191888.260146:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 460 00010000:00010000:3.0:1784191888.260275:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784191888.260283:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4aeab lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4aeb2 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.260297:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af110db3a00 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:3.0:1784191888.260302:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4aeab lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4aeb2 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191888.260309:0:158654:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4aeab lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4aeb2 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.260341:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4aeab lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4aeb2 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.260347:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784191888.260376:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4aeab lrc: 1/0,0 mode: --/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4aeb2 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.260384:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3a00/0xfeec3c2dc5a4aeab lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4aeb2 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.260400:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784191888.260403:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e800/0xfeec3c2dc5a4ae8f lrc: 2/0,0 mode: EX/EX res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4ae96 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.260409:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e800 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:3.0:1784191888.260413:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e800/0xfeec3c2dc5a4ae8f lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4ae96 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191888.260419:0:158654:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e800/0xfeec3c2dc5a4ae8f lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4ae96 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.260459:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e800/0xfeec3c2dc5a4ae8f lrc: 2/0,0 mode: --/EX res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ae96 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.260467:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784191888.260484:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e800/0xfeec3c2dc5a4ae8f lrc: 1/0,0 mode: --/EX res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ae96 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.260492:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e800/0xfeec3c2dc5a4ae8f lrc: 0/0,0 mode: --/EX res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ae96 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.260506:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784191888.260509:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ae73 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4ae7a expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.260515:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9400 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:3.0:1784191888.260518:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ae73 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4ae7a expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191888.260525:0:158654:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ae73 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4ae7a expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.260540:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ae73 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ae7a expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.260558:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784191888.260565:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ae73 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ae7a expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.260583:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4ae73 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ae7a expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.260596:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191888.260598:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191888.260599:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191888.260608:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784191888.260632:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827940224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191888.260680:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191888.260747:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827940352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191888.260769:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191888.260788:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784191888.260806:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827940480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191888.260827:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191888.260859:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827940224 00000100:00100000:3.0:1784191888.260864:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827940224 00000100:00100000:3.0:1784191888.260900:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827940352 00000100:00100000:3.0:1784191888.260903:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827940352 00000100:00100000:3.0:1784191888.260921:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827940480 00000100:00100000:3.0:1784191888.260924:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827940480 00000100:00100000:3.0:1784191888.260940:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784191888.260947:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101686300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+18:106499:x1870858827940224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784191888.260959:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191888.260976:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3400/0xfeec3c2dc5a4aeb2 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4aeab expref: 18 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.260989:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x6:0x0].0x0 (ffff8af210dfee00) 00010000:00010000:3.0:1784191888.261002:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191888.261031:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101686300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+17:106499:x1870858827940224:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.261039:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784191888.261053:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784191888.261059:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101684380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+16:106501:x1870858827940352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784191888.261066:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191888.261077:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4ae96 lrc: 0/0,0 mode: --/EX res: [0x240002343:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae8f expref: 16 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.261088:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x3:0x0].0x0 (ffff8af219b92100) 00010000:00010000:3.0:1784191888.261094:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191888.261117:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101684380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+15:106501:x1870858827940352:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.261123:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784191888.261135:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784191888.261141:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+14:106501:x1870858827940480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784191888.261150:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191888.261161:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4ae7a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae73 expref: 14 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.261173:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5500) 00010000:00010000:3.0:1784191888.261179:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191888.261199:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+13:106501:x1870858827940480:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.261205:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784191888.261235:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827940480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191888.261252:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827940352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191888.261275:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827940224:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.261669:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191888.261742:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191888.264780:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.264941:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812352256 00000100:00100000:0.0:1784191888.264953:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812352256 00000100:00100000:0.0:1784191888.265008:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 461 00000100:00100000:0.0:1784191888.265019:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:123674:x1870858812352256:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191888.265044:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.265070:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4aeb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b765 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.265216:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4aec0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.265231:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4aec0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.265242:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4aec0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191888.265293:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784191888.265310:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784191888.265333:0:158665:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4aec0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.265357:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4aeb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b765 expref: 7 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.265377:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4aec0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b765 expref: 6 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.265385:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af210dfef00) 00010000:00010000:0.0:1784191888.265388:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784191888.265391:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3e600, rc 0) 00000100:00100000:0.0:1784191888.265957:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812352256:12345-192.168.204.16@tcp:101:rm.0 Request processed in 937us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.265966:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 461 00000100:00100000:0.0:1784191888.270173:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.270271:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812352384 00000100:00100000:2.0:1784191888.270282:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812352384 00000100:00100000:2.0:1784191888.270570:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 462 00000100:00100000:2.0:1784191888.270581:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812352384:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191888.270619:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.270653:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4aec7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b76c expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.270746:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4aece lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.270762:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4aece lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.270773:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4aece lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.270788:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4aed5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.270805:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4aed5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.270813:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4aed5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.270938:0:158666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:158666:1870858827940608:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784191888.270996:0:158666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.271025:0:158666:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2057feb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.271338:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827940608 00000100:00100000:0.0:1784191888.271346:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827940608 00000100:00100000:0.0:1784191888.271384:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:0.0:1784191888.271391:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:158666:x1870858827940608:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784191888.271673:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:158666:x1870858827940608:12345-0@lo:1000:mdt00_001.0 Request processed in 281us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.271682:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:2.0:1784191888.271889:0:158666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:158666:1870858827940608:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1784191888.271951:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4aedc lrc: 3/1,0 mode: --/PR res: [0x240002343:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.271966:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4aedc lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.271990:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4aedc lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191888.272015:0:158666:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4aedc lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.272032:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4aece lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.272038:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4aece lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.272044:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4aece lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.272050:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4aece lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.272056:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191888.272060:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4aece lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.272067:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4aece lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.272080:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af210dfef00) 00010000:00010000:2.0:1784191888.272083:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191888.272087:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4aece lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.272361:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4aece lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.272386:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4aed5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.272393:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4aed5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.272400:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4aed5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.272406:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7fc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191888.272409:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4aed5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.272416:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4aed5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.272426:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4c99ad (ffff8af219b92c00) 00010000:00010000:2.0:1784191888.272428:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191888.272508:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4aed5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.272516:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4aed5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.272654:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4aec7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b76c expref: 8 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.273117:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4aedc lrc: 3/0,0 mode: PR/PR res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b76c expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.273141:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x4:0x0].0x0 (ffff8af219b92600) 00010000:00010000:2.0:1784191888.273144:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191888.273146:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e200, rc 0) 00000100:00100000:2.0:1784191888.273277:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812352384:12345-192.168.204.16@tcp:101:rm.0 Request processed in 2696us (3187us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.273285:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 462 00000100:00100000:1.0:1784191888.281971:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.282100:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812352512 00000100:00100000:3.0:1784191888.282117:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812352512 00000100:00100000:3.0:1784191888.282191:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 463 00000100:00100000:3.0:1784191888.282201:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:123674:x1870858812352512:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:3.0:1784191888.282229:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191888.282255:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db3400/0xfeec3c2dc5a4aee3 lrc: 2/0,0 mode: --/CR res: [0x240002343:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b773 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.282325:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db3a00/0xfeec3c2dc5a4aeea lrc: 3/1,0 mode: --/PR res: [0x240002343:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.282339:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db3a00/0xfeec3c2dc5a4aeea lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.282351:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db3a00/0xfeec3c2dc5a4aeea lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191888.282461:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x4:0x0]: returning size 4096 00000004:00200000:3.0:1784191888.282467:0:164531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1784191888.282507:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db3400/0xfeec3c2dc5a4aee3 lrc: 0/0,0 mode: --/CR res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b773 expref: 19 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.282525:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db3a00/0xfeec3c2dc5a4aeea lrc: 3/0,0 mode: PR/PR res: [0x240002343:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b773 expref: 18 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.282533:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x4:0x0].0x0 (ffff8af110071200) 00010000:00010000:3.0:1784191888.282680:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784191888.282685:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3a00, rc 0) 00000100:00100000:3.0:1784191888.282973:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:123674:x1870858812352512:12345-192.168.204.16@tcp:101:rm.0 Request processed in 772us (6701us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.282981:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 463 00000100:00100000:1.0:1784191888.286256:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.286333:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812352640 00000100:00100000:0.0:1784191888.286344:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812352640 00000100:00100000:0.0:1784191888.286404:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 464 00000100:00100000:0.0:1784191888.286414:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:123674:x1870858812352640:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191888.286453:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.286478:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4aef1 lrc: 2/0,0 mode: --/CR res: [0x240002340:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b77a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.286541:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aef8 lrc: 3/1,0 mode: --/PR res: [0x240002340:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.286568:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aef8 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.286580:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aef8 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191888.286641:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002340:0x7:0x0]: returning size 4096 00000004:00200000:0.0:1784191888.286647:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1784191888.286974:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4aef1 lrc: 0/0,0 mode: --/CR res: [0x240002340:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b77a expref: 20 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.287000:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aef8 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b77a expref: 19 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.287008:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x7:0x0].0x0 (ffff8af210dfe100) 00010000:00010000:0.0:1784191888.287011:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784191888.287015:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3e200, rc 0) 00000100:00100000:0.0:1784191888.287099:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:123674:x1870858812352640:12345-192.168.204.16@tcp:101:rm.0 Request processed in 665us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.287106:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 464 00000100:00100000:2.0:1784191888.290182:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.290262:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812352768 00000100:00100000:0.0:1784191888.290271:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812352768 00000100:00100000:0.0:1784191888.290355:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 465 00000100:00100000:0.0:1784191888.290366:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812352768:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191888.290389:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.290411:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4aeff lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b781 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.290478:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4af06 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.290493:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4af06 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.290505:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4af06 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191888.290561:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x7:0x0]: returning size 4096 00000004:00200000:0.0:1784191888.290566:0:158666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1784191888.290605:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4aeff lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b781 expref: 9 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.290637:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4af06 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b781 expref: 8 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.290647:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x7:0x0].0x0 (ffff8af210dfe500) 00010000:00010000:0.0:1784191888.290650:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784191888.290654:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3ec00, rc 0) 00000100:00100000:0.0:1784191888.290747:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812352768:12345-192.168.204.16@tcp:101:rm.0 Request processed in 381us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.290934:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 465 00000100:00100000:1.0:1784191888.295264:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.295347:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812353024 00000100:00100000:3.0:1784191888.295358:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812353024 00000100:00100000:3.0:1784191888.295419:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 466 00000100:00100000:3.0:1784191888.295429:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:123674:x1870858812353024:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:3.0:1784191888.295449:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191888.295474:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db3400/0xfeec3c2dc5a4af0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b788 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191888.295653:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1784191888.296031:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db3400/0xfeec3c2dc5a4af0d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b788 expref: 21 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.296046:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af110071400) 00010000:00010000:3.0:1784191888.296049:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784191888.296053:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db3400/0xfeec3c2dc5a4af0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b788 expref: 21 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.296070:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3400, rc 0) 00000100:00100000:3.0:1784191888.296134:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+20:123674:x1870858812353024:12345-192.168.204.16@tcp:101:rm.0 Request processed in 707us (883us total) trans 25769803789 rc 301/301 00000100:00100000:3.0:1784191888.296142:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 466 00000100:00100000:2.0:1784191888.300839:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.301023:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812353152 00000100:00100000:1.0:1784191888.301047:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812353152 00000100:00100000:1.0:1784191888.301113:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 116 00000100:00100000:1.0:1784191888.301123:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+20:123674:x1870858812353152:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:2.0:1784191888.306304:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+20:123674:x1870858812353152:12345-192.168.204.16@tcp:37:rm.0 Request processed in 5171us (5462us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.306320:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 116 00000100:00100000:1.0:1784191888.312017:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.312111:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812353280 00000100:00100000:0.0:1784191888.312124:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812353280 00000100:00100000:0.0:1784191888.312188:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 117 00000100:00100000:0.0:1784191888.312198:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812353280:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:1.0:1784191888.320992:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812353280:12345-192.168.204.16@tcp:37:rm.0 Request processed in 8782us (8975us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.321008:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 117 00000100:00100000:1.0:1784191888.325616:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.325888:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812353536 00000100:00100000:2.0:1784191888.325898:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812353536 00000100:00100000:2.0:1784191888.325998:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 118 00000100:00100000:2.0:1784191888.326008:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1099f5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+20:123674:x1870858812353536:12345-192.168.204.16@tcp:35:rm.0 00000100:00100000:2.0:1784191888.326262:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1099f5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:123674:x1870858812353536:12345-192.168.204.16@tcp:35:rm.0 Request processed in 254us (717us total) trans 25769803790 rc 0/0 00000100:00100000:2.0:1784191888.326271:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 118 00000100:00100000:0.0:1784191888.330140:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.330185:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.330274:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812353664 00000100:00100000:3.0:1784191888.330299:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812353664 00000100:00100000:3.0:1784191888.330367:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 73 00000100:00100000:3.0:1784191888.330378:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:69110:x1870858812353664:12345-192.168.204.16@tcp:103:rm.0 00010000:00010000:3.0:1784191888.330394:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191888.330421:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4aedc lrc: 0/0,0 mode: --/PR res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b76c expref: 8 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.330443:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x4:0x0].0x0 (ffff8af219b92600) 00010000:00010000:3.0:1784191888.330456:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191888.330511:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69110:x1870858812353664:12345-192.168.204.16@tcp:103:rm.0 Request processed in 134us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.330519:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 73 00000100:00100000:1.0:1784191888.330660:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812353920 00000100:00100000:1.0:1784191888.330665:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812353920 00000100:00100000:1.0:1784191888.330741:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 467 00000100:00100000:1.0:1784191888.330758:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:123674:x1870858812353920:12345-192.168.204.16@tcp:36:rm.0 00010000:00010000:1.0:1784191888.330830:0:158665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.330847:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db3a00/0xfeec3c2dc5a4aeea lrc: 0/0,0 mode: --/PR res: [0x240002343:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b773 expref: 21 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.330860:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x4:0x0].0x0 (ffff8af110071200) 00010000:00010000:1.0:1784191888.330867:0:158665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784191888.330926:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4af1b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.330934:0:158665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4af1b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.330943:0:158665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4af1b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.330965:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016be680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827940736:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1784191888.331032:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.331060:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.331963:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827940736 00000100:00100000:0.0:1784191888.331971:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827940736 00000100:00100000:0.0:1784191888.332013:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:0.0:1784191888.332022:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:158665:x1870858827940736:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1784191888.332039:0:161739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.332056:0:161739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4af22 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4af1b expref: -99 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.332083:0:161739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4aec0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b765 expref: 6 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.332095:0:161739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4af22 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af1b expref: 14 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.332123:0:161739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4aec0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b765 expref: 6 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.332136:0:161739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4aec0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b765 expref: 6 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.332149:0:161739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d635880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827940864:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191888.332463:0:161739:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107aff300 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.337612:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.337711:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812354048 00000100:00100000:3.0:1784191888.337721:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812354048 00010000:00010000:3.0:1784191888.337782:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4aec0 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b765 expref: 7 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.337832:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 113 00000100:00100000:3.0:1784191888.337842:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69109:x1870858812354048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191888.337857:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191888.337864:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4aec0 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b765 expref: 7 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.337878:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4aec0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b765 expref: 7 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.337902:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af210dfef00) 00010000:00010000:3.0:1784191888.337924:0:158652:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4af22 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af1b expref: 14 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.337935:0:158652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4af22 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af1b expref: 14 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.337943:0:158652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4af22 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af1b expref: 14 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.337955:0:161739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4aec0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b765 expref: 7 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.337973:0:161739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d635880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827940864:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191888.337979:0:158652:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4af22 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af1b expref: 14 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.337993:0:158652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:158652:1870858827940992:0@lo:105: 00010000:00010000:2.0:1784191888.338004:0:161739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4af22 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af1b expref: 14 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.338021:0:161739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af210dfef00) 00010000:00010000:2.0:1784191888.338024:0:161739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191888.338026:0:161739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3ea00, rc 0) 00000100:00100000:3.0:1784191888.338040:0:158652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191888.338210:0:158652:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.338522:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827940992 00000100:00100000:1.0:1784191888.338527:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827940992 00000100:00100000:1.0:1784191888.338568:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784191888.338576:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158652:x1870858827940992:12345-0@lo:105: 00010000:00010000:1.0:1784191888.338588:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4af1b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4af22 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.338597:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4af1b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4af22 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.338606:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4af1b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4af22 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.338614:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4af1b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4af22 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.338631:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4af1b lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4af22 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.338639:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4af1b lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4af22 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.338654:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af1115b8600) 00000100:00100000:3.0:1784191888.338870:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016be680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827940736:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1784191888.338886:0:158665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4af1b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4af22 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191888.338910:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1784191888.338944:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4af29 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.338952:0:158665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4af29 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.338960:0:158665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4af29 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.338975:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827941120:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1784191888.343108:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:158665:x1870858827940736:12345-0@lo:101:mdt00_000.0 Request processed in 11075us (12063us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.343180:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:1.0:1784191888.343853:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158652:x1870858827940992:12345-0@lo:105: Request processed in 5274us (5807us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.343864:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784191888.343958:0:158652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:158652:1870858827940992:0@lo:105: 00010000:00010000:2.0:1784191888.343981:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191888.344072:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812354048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6228us (6468us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.344082:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 113 00000100:00100000:0.0:1784191888.345505:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.345648:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827941120 00000100:00100000:1.0:1784191888.345658:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827941120 00000100:00100000:0.0:1784191888.345873:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35540 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.346629:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:1.0:1784191888.346644:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:158665:x1870858827941120:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1784191888.346679:0:159636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191888.346720:0:159636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8c00/0xfeec3c2dc5a4af30 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4af29 expref: -99 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.346901:0:159636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8c00/0xfeec3c2dc5a4af30 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af29 expref: 15 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.346918:0:159636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8c00/0xfeec3c2dc5a4af30 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af29 expref: 15 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.346928:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4c99ad (ffff8af23d0d5e00) 00010000:00010000:1.0:1784191888.346931:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191888.346936:0:159636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8c00, rc 0) 00000100:00100000:1.0:1784191888.347014:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:158665:x1870858827941120:12345-0@lo:101:mdt00_000.0 Request processed in 375us (1581us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.347021:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:0.0:1784191888.347170:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827941120:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1784191888.347186:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4af29 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4af30 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.347195:0:158665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4af29 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4af30 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191888.347214:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1784191888.347257:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827941248:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784191888.347286:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.347308:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107aff480 going to sleep for 11 seconds 00000100:00100000:3.0:1784191888.347348:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827941248 00000100:00100000:3.0:1784191888.347353:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827941248 00000100:00100000:3.0:1784191888.347383:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:3.0:1784191888.347388:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:158665:x1870858827941248:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784191888.347449:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:158665:x1870858827941248:12345-0@lo:1000:mdt00_000.0 Request processed in 60us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.347455:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:0.0:1784191888.347534:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827941248:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784191888.347638:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827941376:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784191888.347666:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.347999:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827941376 00000100:00100000:1.0:1784191888.348005:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827941376 00000100:00100000:1.0:1784191888.348077:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:1.0:1784191888.348085:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:158665:x1870858827941376:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784191888.348176:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:158665:x1870858827941376:12345-0@lo:1000:mdt00_000.0 Request processed in 92us (509us total) trans 0 rc 1/1 00000100:00100000:1.0:1784191888.348183:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:0.0:1784191888.348242:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107aff480 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.348260:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827941376:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1784191888.348321:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e000/0xfeec3c2dc5a4af37 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.348332:0:158665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e000/0xfeec3c2dc5a4af37 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.348341:0:158665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e000/0xfeec3c2dc5a4af37 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.348371:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827941504:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1784191888.348397:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.348469:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107aff300 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.349438:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827941504 00000100:00100000:2.0:1784191888.349449:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827941504 00000100:00100000:2.0:1784191888.349497:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:2.0:1784191888.349505:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:158665:x1870858827941504:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1784191888.349522:0:159636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.350327:0:159636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4af3e lrc: 2/0,0 mode: --/EX res: [0x240002343:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4af37 expref: -99 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.350365:0:159636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4af3e lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af37 expref: 16 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.350380:0:159636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4af3e lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af37 expref: 16 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.350388:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x4:0x0].0x0 (ffff8af219b92c00) 00010000:00010000:2.0:1784191888.350403:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191888.350408:0:159636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7fc00, rc 0) 00000100:00100000:2.0:1784191888.350500:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:158665:x1870858827941504:12345-0@lo:101:mdt00_000.0 Request processed in 995us (2100us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.350508:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:0.0:1784191888.350678:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827941504:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1784191888.350715:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e000/0xfeec3c2dc5a4af37 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4af3e expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.350728:0:158665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e000/0xfeec3c2dc5a4af37 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4af3e expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.350766:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4af45 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.350774:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4af45 lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.350783:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4af45 lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.350908:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4af4c lrc: 3/0,1 mode: --/EX res: [0x240002340:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.350918:0:158665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aef8 lrc: 2/0,0 mode: PR/PR res: [0x240002340:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b77a expref: 20 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.350924:0:158665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4af4c lrc: 4/0,1 mode: --/EX res: [0x240002340:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.350952:0:158665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aef8 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b77a expref: 20 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.350971:0:158665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aef8 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b77a expref: 20 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.350981:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:158665:1870858827941632:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191888.351048:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107aff300 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.353959:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.353993:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:158665:1870858827941632:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191888.354035:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812354176 00000100:00100000:2.0:1784191888.354043:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812354176 00010000:00010000:1.0:1784191888.354048:0:158665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4af4c lrc: 3/0,1 mode: --/EX res: [0x240002340:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.354077:0:165501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aef8 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b77a expref: 21 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.354165:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 114 00000100:00100000:2.0:1784191888.354176:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23d2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:69112:x1870858812354176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191888.354192:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191888.354199:0:165501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aef8 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b77a expref: 21 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.354212:0:165501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aef8 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b77a expref: 21 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.354235:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4aef8 lrc: 0/0,0 mode: --/PR res: [0x240002340:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b77a expref: 21 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.354252:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x7:0x0].0x0 (ffff8af210dfe100) 00010000:00010000:2.0:1784191888.354257:0:165501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4af4c lrc: 3/0,1 mode: --/EX res: [0x240002340:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.354266:0:165501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4af4c lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.354285:0:165501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4af4c lrc: 4/0,1 mode: EX/EX res: [0x240002340:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.354313:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191888.354373:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23d2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+20:69112:x1870858812354176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 198us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.354382:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 114 00010000:00010000:1.0:1784191888.354463:0:158665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4af4c lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.354470:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4af4c lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.354513:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.354521:0:158665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.354530:0:158665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.354549:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827941760:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1784191888.354587:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.354632:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f000 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.354762:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827941760 00000100:00100000:0.0:1784191888.354767:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827941760 00000100:00100000:0.0:1784191888.354802:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:0.0:1784191888.354810:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+16:158665:x1870858827941760:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1784191888.354827:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.354842:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4af5a lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4af53 expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.354863:0:158671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4af06 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b781 expref: 5 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.354871:0:158671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4af5a lrc: 4/0,0 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af53 expref: 17 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.354894:0:158671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4af06 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b781 expref: 5 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.354906:0:158671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4af06 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b781 expref: 5 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.354931:0:158671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827941888:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191888.354983:0:158671:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107aff480 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.359057:0:158671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827941888:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191888.359113:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4af5a lrc: 3/0,0 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af53 expref: 17 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.359126:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x7:0x0].0x0 (ffff8af210dfe500) 00010000:00010000:1.0:1784191888.359129:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784191888.359133:0:158671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4af5a lrc: 3/0,0 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af53 expref: 17 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.359166:0:158671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4af5a lrc: 3/0,0 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af53 expref: 17 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.359174:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3f600, rc 0) 00000100:00100000:1.0:1784191888.359248:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:158665:x1870858827941760:12345-0@lo:101:mdt00_000.0 Request processed in 4439us (4659us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.359257:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:2.0:1784191888.359343:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827941760:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1784191888.359359:0:158665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4af5a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.359366:0:158665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4af5a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.359513:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.359586:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812354304 00000100:00100000:1.0:1784191888.359595:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812354304 00010000:00010000:1.0:1784191888.359639:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4af06 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b781 expref: 6 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.359862:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 115 00000100:00100000:1.0:1784191888.359873:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812354304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.359889:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.359897:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4af06 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b781 expref: 6 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.359910:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4af06 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b781 expref: 6 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.359931:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4af06 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b781 expref: 6 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.359949:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x7:0x0].0x0 (ffff8af210dfe500) 00010000:00010000:1.0:1784191888.359954:0:158650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4af5a lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af53 expref: 16 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.359972:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4af5a lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af53 expref: 16 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.359979:0:158650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4af5a lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af53 expref: 16 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.360012:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4af5a lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af53 expref: 16 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.360026:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:158650:1870858827942016:0@lo:105: 00000100:00100000:1.0:1784191888.360067:0:158650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.360106:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f000 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.360664:0:158649:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784191888.360682:0:158649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827942016 00000100:00100000:0.0:1784191888.360715:0:158649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827942016 00000100:00100000:0.0:1784191888.360758:0:158649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784191888.360766:0:158649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:158650:x1870858827942016:12345-0@lo:105: 00010000:00010000:0.0:1784191888.360779:0:158649:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 5/0,1 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4af5a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.360801:0:158649:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 5/0,1 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4af5a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.360810:0:158649:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 5/0,1 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4af5a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.360819:0:158649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 5/0,1 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4af5a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.360827:0:158649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 6/0,1 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4af5a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.360837:0:158649:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 6/0,1 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4af5a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.360874:0:158649:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af1115b9800) 00000100:00100000:0.0:1784191888.360931:0:158649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:158650:x1870858827942016:12345-0@lo:105: Request processed in 166us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.360938:0:158649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784191888.360953:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:158650:1870858827942016:0@lo:105: 00010000:00010000:1.0:1784191888.360979:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191888.361025:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812354304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1153us (1511us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.361032:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 115 00010000:00010000:2.0:1784191888.361113:0:158665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4af5a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.361124:0:158665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4af5a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.361915:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827942144:0@lo:403:mdt00_000.0 00000100:00100000:2.0:1784191888.361973:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.362011:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.362077:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827942144 00000100:00100000:1.0:1784191888.362083:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827942144 00000100:00100000:1.0:1784191888.362139:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:1.0:1784191888.362147:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+17:158665:x1870858827942144:12345-0@lo:403:mdt00_000.0 00000100:00100000:1.0:1784191888.365946:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+17:158665:x1870858827942144:12345-0@lo:403:mdt00_000.0 Request processed in 3789us (3961us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.365962:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:2.0:1784191888.366001:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827942144:0@lo:403:mdt00_000.0 00000040:00080000:2.0:1784191888.367081:0:158665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002b10:0x2:0x0].5, 944 off37488 00000040:00080000:2.0:1784191888.367267:0:158665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab4:0x2:0x0].5, 1024 off37888 00000004:00080000:2.0:1784191888.367283:0:158665:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af23d0e2c00 with version 12 00000004:00080000:1.0:1784191888.368557:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 12 rpc_version 12 00000020:00100000:1.0:1784191888.368616:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784191888.368639:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af210f4df80 x1870858827942400/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784191888.368827:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827942400:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784191888.368903:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.368949:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f000 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.369008:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827942400 00000100:00100000:2.0:1784191888.369016:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827942400 00000100:00100000:2.0:1784191888.369098:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:2.0:1784191888.369108:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:165486:x1870858827942400:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784191888.371651:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:165486:x1870858827942400:12345-0@lo:1000:osp_up0-1.0 Request processed in 2533us (2736us total) trans 34359738644 rc 0/0 00000100:00100000:2.0:1784191888.371667:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:1.0:1784191888.373258:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827942400:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1784191888.373323:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1784191888.373353:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4af4c lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.373365:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4af4c lrc: 2/0,0 mode: EX/EX res: [0x240002340:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.373372:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4af4c lrc: 3/0,0 mode: EX/EX res: [0x240002340:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.373378:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191888.373383:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4af4c lrc: 3/0,0 mode: EX/EX res: [0x240002340:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.373391:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4af4c lrc: 4/0,0 mode: EX/EX res: [0x240002340:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.373408:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x7:0x0].0x0 (ffff8af210dfe100) 00010000:00010000:2.0:1784191888.373412:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784191888.373416:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4af4c lrc: 2/0,0 mode: --/EX res: [0x240002340:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.373421:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4af4c lrc: 0/0,0 mode: --/EX res: [0x240002340:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.373472:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4af5a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.373480:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4af5a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.373487:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4af5a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.373646:0:158665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1784191888.373657:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0x7:0x0] 00010000:00010000:2.0:1784191888.373668:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4af45 lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.373674:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4af45 lrc: 2/0,0 mode: EX/EX res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.373680:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4af45 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.373685:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3fa00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191888.374550:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784191888.374562:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4af5a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.374572:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9800 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:3.0:1784191888.374578:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4af5a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191888.374587:0:158654:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4af5a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.374647:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4af5a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.374854:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784191888.374944:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827942528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191888.375022:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.375110:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827942528 00000100:00100000:1.0:1784191888.375118:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827942528 00000100:00100000:1.0:1784191888.375184:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784191888.375194:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+18:106499:x1870858827942528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.375207:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.375226:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4af5a lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af53 expref: 18 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.375247:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x7:0x0].0x0 (ffff8af210dfe500) 00010000:00010000:1.0:1784191888.375257:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784191888.375385:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 1/0,0 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4af5a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.375393:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4af53 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4af5a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.375427:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191888.375441:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191888.375443:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191888.375632:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+17:106499:x1870858827942528:12345-0@lo:103:ldlm_bl.0 Request processed in 438us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.375640:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:2.0:1784191888.375653:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4af45 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.375662:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4af45 lrc: 4/0,0 mode: EX/EX res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.375674:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x4:0x0].0x0 (ffff8af210dfe300) 00010000:00010000:2.0:1784191888.375677:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191888.375704:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4af45 lrc: 2/0,0 mode: --/EX res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.375712:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4af45 lrc: 0/0,0 mode: --/EX res: [0x240002343:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.375732:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e000/0xfeec3c2dc5a4af37 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4af3e expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.375740:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e000/0xfeec3c2dc5a4af37 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4af3e expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.375747:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e000/0xfeec3c2dc5a4af37 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4af3e expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.376627:0:158665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1784191888.376651:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1784191888.376660:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4af1b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4af22 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.376672:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4af1b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4af22 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.376680:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4af1b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4af22 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.378361:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784191888.378376:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e000/0xfeec3c2dc5a4af37 lrc: 2/0,0 mode: EX/EX res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4af3e expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.378389:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e000 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:3.0:1784191888.378396:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e000/0xfeec3c2dc5a4af37 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4af3e expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191888.378406:0:160901:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e000/0xfeec3c2dc5a4af37 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4af3e expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.378457:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e000/0xfeec3c2dc5a4af37 lrc: 2/0,0 mode: --/EX res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4af3e expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.378463:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784191888.378479:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e000/0xfeec3c2dc5a4af37 lrc: 1/0,0 mode: --/EX res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4af3e expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.378487:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e000/0xfeec3c2dc5a4af37 lrc: 0/0,0 mode: --/EX res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4af3e expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.378512:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784191888.378516:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4af1b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4af22 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.378608:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8600 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:3.0:1784191888.378612:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4af1b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4af22 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191888.378628:0:160901:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4af1b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4af22 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.378646:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4af1b lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4af22 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.378652:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784191888.378675:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4af1b lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4af22 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.378685:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191888.378686:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191888.378703:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191888.378730:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827942784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191888.378903:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784191888.379028:0:158665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784191888.379036:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4af1b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4af22 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191888.379068:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1784191888.379082:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827942784 00000100:00100000:2.0:1784191888.379088:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827942784 00000100:00100000:2.0:1784191888.379140:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784191888.379148:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+17:106501:x1870858827942784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191888.379159:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191888.379177:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4af22 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af1b expref: 17 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.379193:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af210dfef00) 00010000:00010000:2.0:1784191888.379201:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191888.379233:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+16:106501:x1870858827942784:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.379240:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1784191888.379261:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4af29 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4af30 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.379269:0:158665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4af29 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4af30 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.379330:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+20:123674:x1870858812353920:12345-192.168.204.16@tcp:36:rm.0 Request processed in 48581us (49142us total) trans 25769803791 rc 0/0 00000100:00100000:2.0:1784191888.379336:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 467 00010000:00010000:3.0:1784191888.379387:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191888.379415:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827942784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191888.379966:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827942528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191888.379980:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784191888.380010:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827942656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191888.380045:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.383163:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827942656 00000100:00100000:2.0:1784191888.383180:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827942656 00000100:00100000:0.0:1784191888.383209:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.383254:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784191888.383280:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+16:106499:x1870858827942656:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191888.383284:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812354432 00000100:00100000:1.0:1784191888.383289:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812354432 00010000:00010000:2.0:1784191888.383296:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191888.383324:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4af3e lrc: 0/0,0 mode: --/EX res: [0x240002343:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af37 expref: 16 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.383330:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 468 00000100:00100000:1.0:1784191888.383338:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:123674:x1870858812354432:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191888.383343:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x4:0x0].0x0 (ffff8af219b92c00) 00010000:00010000:2.0:1784191888.383355:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784191888.383356:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191888.383374:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4af61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b78f expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.383406:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+15:106499:x1870858827942656:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (3360us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.383413:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:1.0:1784191888.383472:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4af68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.383487:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4af68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.383498:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4af68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191888.383546:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784191888.383551:0:158666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784191888.383574:0:158666:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4af68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.383597:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4af61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b78f expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.383613:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4af68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b78f expref: 6 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.383631:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5b00) 00010000:00010000:1.0:1784191888.383633:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784191888.383636:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9a00, rc 0) 00000100:00100000:1.0:1784191888.383718:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812354432:12345-192.168.204.16@tcp:101:rm.0 Request processed in 380us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.383725:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 468 00000100:00100000:0.0:1784191888.384165:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827942656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191888.385944:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.386027:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812354560 00000100:00100000:2.0:1784191888.386036:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812354560 00000100:00100000:2.0:1784191888.386108:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 469 00000100:00100000:2.0:1784191888.386119:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812354560:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191888.386145:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.386168:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4af6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b796 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.386240:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4af76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.386255:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4af76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.386266:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4af76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.386284:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4af7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.386303:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4af7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.386310:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4af7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.386441:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:158667:1870858827942912:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784191888.386497:0:158667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.386530:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2030de0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.386676:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827942912 00000100:00100000:1.0:1784191888.386682:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827942912 00000100:00100000:1.0:1784191888.386761:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:1.0:1784191888.386769:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:158667:x1870858827942912:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1784191888.386849:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:158667:x1870858827942912:12345-0@lo:1000:mdt00_002.0 Request processed in 80us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.386856:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1784191888.387575:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:158667:1870858827942912:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1784191888.387644:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4af84 lrc: 3/1,0 mode: --/PR res: [0x240002343:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.387668:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4af84 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.387677:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4af84 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191888.387734:0:158667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4af84 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.387863:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4af76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.387872:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4af76 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.387879:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4af76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.387899:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191888.387903:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4af76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.387910:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4af76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.387923:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5b00) 00010000:00010000:2.0:1784191888.387926:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191888.387930:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4af76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.387936:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4af76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.387950:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4af7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.387956:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4af7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.387962:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4af7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.387967:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191888.387970:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4af7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.387976:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4af7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.387995:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x96709776 (ffff8af219b92600) 00010000:00010000:2.0:1784191888.387997:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191888.388000:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4af7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.388006:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4af7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.388044:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4af6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b796 expref: 8 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.388058:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4af84 lrc: 3/0,0 mode: PR/PR res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b796 expref: 7 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.388066:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x5:0x0].0x0 (ffff8af219b92100) 00010000:00010000:2.0:1784191888.388069:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191888.388071:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e200, rc 0) 00000100:00100000:2.0:1784191888.388137:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812354560:12345-192.168.204.16@tcp:101:rm.0 Request processed in 2020us (2206us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.388145:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 469 00000100:00100000:2.0:1784191888.393406:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.393494:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812354688 00000100:00100000:1.0:1784191888.393504:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812354688 00000100:00100000:1.0:1784191888.393559:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 470 00000100:00100000:1.0:1784191888.393568:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+20:123674:x1870858812354688:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:1.0:1784191888.393597:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191888.393631:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4af8b lrc: 2/0,0 mode: --/CR res: [0x240002343:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b79d expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.393737:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4af92 lrc: 3/1,0 mode: --/PR res: [0x240002343:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.393760:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4af92 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.393773:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4af92 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191888.393884:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1784191888.393890:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1784191888.393930:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4af8b lrc: 0/0,0 mode: --/CR res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b79d expref: 22 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.393948:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4af92 lrc: 3/0,0 mode: PR/PR res: [0x240002343:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b79d expref: 21 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.393984:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x5:0x0].0x0 (ffff8af23d0d5a00) 00010000:00010000:1.0:1784191888.393987:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784191888.393990:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9400, rc 0) 00000100:00100000:1.0:1784191888.394061:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:123674:x1870858812354688:12345-192.168.204.16@tcp:101:rm.0 Request processed in 493us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.394068:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 470 00000100:00100000:3.0:1784191888.396252:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827943040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784191888.396334:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.396423:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827943040 00000100:00100000:2.0:1784191888.396443:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827943040 00000100:00100000:2.0:1784191888.396506:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1784191888.396516:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827943040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784191888.396562:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42590208 avail 36458496 00000100:00100000:2.0:1784191888.400128:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827943040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3599us (3780us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.400160:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:0.0:1784191888.401024:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827943296:0@lo:400:kworker.0 00000100:00100000:0.0:1784191888.401101:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.401139:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858827943808:0@lo:400:kworker.0 00000100:00100000:0.0:1784191888.401167:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.401190:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784191888.401197:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827943168:0@lo:400:kworker.0 00000100:00100000:0.0:1784191888.401225:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.401256:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858827943680:0@lo:400:kworker.0 00000100:00100000:0.0:1784191888.401280:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.401406:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827943808 00000100:00100000:0.0:1784191888.401424:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827943808 00000100:00080000:0.0:1784191888.401449:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784191888.401482:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827943680 00000100:00100000:0.0:1784191888.401486:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827943680 00000100:00080000:0.0:1784191888.401498:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784191888.401529:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1784191888.401538:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858827943808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191888.401589:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858827943808:12345-0@lo:400:kworker.0 Request processed in 54us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.401597:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1784191888.401647:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858827943808:0@lo:400:kworker.0 00000100:00100000:0.0:1784191888.401675:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1784191888.401681:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858827943680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191888.401740:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858827943680:12345-0@lo:400:kworker.0 Request processed in 59us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.401745:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1784191888.401909:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858827943680:0@lo:400:kworker.0 00000100:00100000:1.0:1784191888.402407:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827943296 00000100:00100000:1.0:1784191888.402413:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827943296 00000100:00100000:2.0:1784191888.403314:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827943168 00000100:00100000:2.0:1784191888.403324:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827943168 00000100:00100000:2.0:1784191888.403370:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1784191888.403379:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106500:x1870858827943168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191888.403465:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106500:x1870858827943168:12345-0@lo:400:kworker.0 Request processed in 87us (2239us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.403473:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1784191888.403513:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827943424:0@lo:400:kworker.0 00000100:00100000:2.0:1784191888.403545:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.403569:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827943936:0@lo:400:kworker.0 00000100:00100000:2.0:1784191888.403591:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.403611:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784191888.403629:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858827943552:0@lo:400:kworker.0 00000100:00100000:2.0:1784191888.403736:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.403828:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827944064:0@lo:400:kworker.0 00000100:00100000:2.0:1784191888.403853:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.403874:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827943424 00000100:00100000:2.0:1784191888.403877:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827943424 00000100:00100000:2.0:1784191888.403899:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827943936 00000100:00100000:2.0:1784191888.403902:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827943936 00000100:00100000:0.0:1784191888.403986:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827943168:0@lo:400:kworker.0 00000100:00100000:0.0:1784191888.404012:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827943552 00000100:00100000:0.0:1784191888.404015:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827943552 00000100:00100000:1.0:1784191888.404095:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784191888.404105:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827943296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191888.404148:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827943296:12345-0@lo:400:kworker.0 Request processed in 46us (3047us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.404155:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784191888.404205:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.404221:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827944064 00000100:00100000:1.0:1784191888.404224:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827944064 00000100:00100000:1.0:1784191888.404240:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812354816 00000100:00100000:1.0:1784191888.404242:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812354816 00000100:00100000:1.0:1784191888.404255:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1784191888.404260:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827943424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191888.404294:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827943424:12345-0@lo:400:kworker.0 Request processed in 34us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.404300:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1784191888.404325:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827943424:0@lo:400:kworker.0 00000100:00100000:1.0:1784191888.404349:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1784191888.404371:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827944064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191888.404400:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827943040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784191888.404403:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858827944064:12345-0@lo:400:kworker.0 Request processed in 34us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.404409:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1784191888.404430:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827944064:0@lo:400:kworker.0 00000100:00100000:1.0:1784191888.404447:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 471 00000100:00100000:1.0:1784191888.404454:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:123674:x1870858812354816:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:1.0:1784191888.404465:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191888.404488:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4af99 lrc: 2/0,0 mode: --/CR res: [0x240002340:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b7a4 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.404547:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4afa0 lrc: 3/1,0 mode: --/PR res: [0x240002340:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.404562:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4afa0 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.404574:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4afa0 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191888.404645:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002340:0x8:0x0]: returning size 4096 00000004:00200000:1.0:1784191888.404651:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:2.0:1784191888.404848:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1784191888.404855:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827943936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191888.404902:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827943936:12345-0@lo:400:kworker.0 Request processed in 48us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.404920:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1784191888.405016:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1784191888.405023:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858827943552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191888.405056:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858827943552:12345-0@lo:400:kworker.0 Request processed in 34us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.405062:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00080000:0.0:1784191888.405080:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784191888.405089:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784191888.405092:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191888.405118:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827943296:0@lo:400:kworker.0 00000100:00100000:1.0:1784191888.405291:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858827943552:0@lo:400:kworker.0 00000100:00100000:1.0:1784191888.405302:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827943936:0@lo:400:kworker.0 00010000:00010000:1.0:1784191888.405363:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4af99 lrc: 0/0,0 mode: --/CR res: [0x240002340:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7a4 expref: 23 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.405394:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4afa0 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7a4 expref: 22 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.405404:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x8:0x0].0x0 (ffff8af23d0d5200) 00010000:00010000:1.0:1784191888.405407:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784191888.405411:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8e00, rc 0) 00000100:00100000:1.0:1784191888.405491:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+22:123674:x1870858812354816:12345-192.168.204.16@tcp:101:rm.0 Request processed in 1037us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.405498:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 471 00000100:00100000:2.0:1784191888.408505:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.408674:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812354944 00000100:00100000:0.0:1784191888.408685:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812354944 00000100:00100000:0.0:1784191888.409007:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 472 00000100:00100000:0.0:1784191888.409019:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812354944:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191888.409043:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.409068:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4afa7 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b7ab expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.409139:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4afae lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.409154:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4afae lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.409165:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4afae lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191888.409216:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x8:0x0]: returning size 4096 00000004:00200000:0.0:1784191888.409222:0:158666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1784191888.409262:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4afa7 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ab expref: 9 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.409285:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4afae lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ab expref: 8 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.409293:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x8:0x0].0x0 (ffff8af210dfe000) 00010000:00010000:0.0:1784191888.409311:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784191888.409315:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3e600, rc 0) 00000100:00100000:0.0:1784191888.409389:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812354944:12345-192.168.204.16@tcp:101:rm.0 Request processed in 373us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.409396:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 472 00000100:00100000:2.0:1784191888.415154:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.415238:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812355200 00000100:00100000:0.0:1784191888.415248:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812355200 00000100:00100000:0.0:1784191888.415320:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 473 00000100:00100000:0.0:1784191888.415331:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+22:123674:x1870858812355200:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191888.415356:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.415387:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4afb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b7b2 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191888.415574:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x5:0x0]: returning size 4096 00010000:00010000:0.0:1784191888.416464:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4afb5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7b2 expref: 24 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.416482:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af210dfea00) 00010000:00010000:0.0:1784191888.416484:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784191888.416489:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4afb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7b2 expref: 24 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.416918:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3e000, rc 0) 00000100:00100000:0.0:1784191888.417244:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:123674:x1870858812355200:12345-192.168.204.16@tcp:101:rm.0 Request processed in 1910us (2095us total) trans 25769803792 rc 301/301 00000100:00100000:0.0:1784191888.417253:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 473 00000100:00100000:1.0:1784191888.423362:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.423930:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812355328 00000100:00100000:2.0:1784191888.423943:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812355328 00000100:00100000:2.0:1784191888.424013:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 119 00000100:00100000:2.0:1784191888.424025:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:123674:x1870858812355328:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:1.0:1784191888.430086:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:123674:x1870858812355328:12345-192.168.204.16@tcp:37:rm.0 Request processed in 6048us (6723us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.430103:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 119 00000100:00100000:0.0:1784191888.438146:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.438287:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812355456 00000100:00100000:2.0:1784191888.438299:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812355456 00000100:00100000:2.0:1784191888.438374:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 120 00000100:00100000:2.0:1784191888.438386:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812355456:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:2.0:1784191888.445221:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812355456:12345-192.168.204.16@tcp:37:rm.0 Request processed in 6825us (7079us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.445236:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 120 00000100:00100000:0.0:1784191888.450206:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.450371:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812355712 00000100:00100000:1.0:1784191888.450383:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812355712 00000100:00100000:1.0:1784191888.450445:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 121 00000100:00100000:1.0:1784191888.450456:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:123674:x1870858812355712:12345-192.168.204.16@tcp:35:rm.0 00000100:00100000:1.0:1784191888.451426:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:123674:x1870858812355712:12345-192.168.204.16@tcp:35:rm.0 Request processed in 965us (1225us total) trans 25769803793 rc 0/0 00000100:00100000:1.0:1784191888.451437:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 121 00000100:00100000:0.0:1784191888.455518:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.455777:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.455999:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812355840 00000100:00100000:3.0:1784191888.456028:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812355840 00000100:00100000:3.0:1784191888.456110:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 77 00000100:00100000:3.0:1784191888.456121:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:69110:x1870858812355840:12345-192.168.204.16@tcp:103:rm.0 00010000:00010000:3.0:1784191888.456136:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191888.456168:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4af84 lrc: 0/0,0 mode: --/PR res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b796 expref: 8 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.456190:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x5:0x0].0x0 (ffff8af219b92100) 00010000:00010000:3.0:1784191888.456202:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191888.456260:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69110:x1870858812355840:12345-192.168.204.16@tcp:103:rm.0 Request processed in 140us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.456268:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 77 00000100:00100000:1.0:1784191888.458674:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812356096 00000100:00100000:1.0:1784191888.458704:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812356096 00000100:00100000:1.0:1784191888.458843:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 474 00000100:00100000:1.0:1784191888.458855:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:123674:x1870858812356096:12345-192.168.204.16@tcp:36:rm.0 00010000:00010000:1.0:1784191888.458939:0:158665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.458966:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4af92 lrc: 0/0,0 mode: --/PR res: [0x240002343:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b79d expref: 24 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.458988:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x5:0x0].0x0 (ffff8af23d0d5a00) 00010000:00010000:1.0:1784191888.458999:0:158665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784191888.459059:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4afc3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.459068:0:158665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4afc3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.459077:0:158665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4afc3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.459116:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827944192:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1784191888.459182:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.459228:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.459531:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827944192 00000100:00100000:0.0:1784191888.459546:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827944192 00000100:00100000:0.0:1784191888.459586:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:0.0:1784191888.459594:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:158665:x1870858827944192:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1784191888.459609:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.459635:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4afca lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4afc3 expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.459657:0:158670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4af68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b78f expref: 6 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.459668:0:158670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4afca lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4afc3 expref: 16 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.459719:0:158670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4af68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b78f expref: 6 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.459734:0:158670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4af68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b78f expref: 6 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.459755:0:158670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:158670:1870858827944320:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191888.459829:0:158670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107affa80 going to sleep for 11 seconds 00010000:00010000:0.0:1784191888.467162:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191888.469222:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.469291:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812356224 00000100:00100000:1.0:1784191888.469303:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812356224 00010000:00010000:1.0:1784191888.469368:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4af68 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b78f expref: 7 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.469415:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 116 00000100:00100000:1.0:1784191888.469426:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69110:x1870858812356224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.469442:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.469449:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4af68 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b78f expref: 7 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.469486:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4af68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b78f expref: 7 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.469515:0:160189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5b00) 00010000:00010000:1.0:1784191888.469522:0:160189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4afca lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4afc3 expref: 16 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.469534:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4afca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4afc3 expref: 16 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.469555:0:160189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4afca lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4afc3 expref: 16 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.469599:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4afca lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4afc3 expref: 16 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.469616:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:160189:1870858827944448:0@lo:105: 00000100:00100000:1.0:1784191888.469678:0:160189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.469739:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f900 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.469748:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827944448 00000100:00100000:0.0:1784191888.469760:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827944448 00000100:00100000:0.0:1784191888.469802:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784191888.469809:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:160189:x1870858827944448:12345-0@lo:105: 00010000:00010000:0.0:1784191888.469820:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4afc3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4afca expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.469830:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4afc3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4afca expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.469839:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4afc3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4afca expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.469847:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4afc3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4afca expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.469855:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4afc3 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4afca expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.469864:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4afc3 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4afca expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.469879:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af1115b9200) 00000100:00100000:0.0:1784191888.469918:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:160189:x1870858827944448:12345-0@lo:105: Request processed in 109us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.469925:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784191888.470337:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:160189:1870858827944448:0@lo:105: 00010000:00010000:1.0:1784191888.470362:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191888.470406:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69110:x1870858812356224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 982us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.470412:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 116 00010000:00010000:3.0:1784191888.470861:0:158670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9a00/0xfeec3c2dc5a4af68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b78f expref: 6 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.470881:0:158670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:158670:1870858827944320:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191888.470901:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4afca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4afc3 expref: 16 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.470909:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5b00) 00010000:00010000:3.0:1784191888.470912:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191888.470915:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3e200, rc 0) 00000100:00100000:3.0:1784191888.470963:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:158665:x1870858827944192:12345-0@lo:101:mdt00_000.0 Request processed in 11370us (11781us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.470971:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:0.0:1784191888.471458:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827944192:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1784191888.471477:0:158665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4afc3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4afca expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191888.471520:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784191888.471574:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4afd1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.471582:0:158665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4afd1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.471591:0:158665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4afd1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.471608:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827944576:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1784191888.471662:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.471733:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107affe40 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.472121:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827944576 00000100:00100000:2.0:1784191888.472130:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827944576 00000100:00100000:2.0:1784191888.472186:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:2.0:1784191888.472195:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+16:158665:x1870858827944576:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1784191888.472213:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.472231:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4afd8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4afd1 expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.472256:0:158671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4afd8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4afd1 expref: 17 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.472269:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4afd8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4afd1 expref: 17 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.472288:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x96709776 (ffff8af207498300) 00010000:00010000:2.0:1784191888.472292:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191888.472295:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f200, rc 0) 00000100:00100000:2.0:1784191888.472368:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:158665:x1870858827944576:12345-0@lo:101:mdt00_000.0 Request processed in 173us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.472375:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:1.0:1784191888.472735:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827944576:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1784191888.472774:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4afd1 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4afd8 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.472785:0:158665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4afd1 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4afd8 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191888.472816:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1784191888.472901:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827944704:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784191888.472943:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.472960:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.473755:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827944704 00000100:00100000:0.0:1784191888.473765:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827944704 00000100:00100000:0.0:1784191888.473825:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1784191888.473835:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:158665:x1870858827944704:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784191888.473935:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:158665:x1870858827944704:12345-0@lo:1000:mdt00_000.0 Request processed in 102us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.473943:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:1.0:1784191888.474362:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827944704:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784191888.474446:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827944832:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784191888.474498:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.474527:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f900 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.474653:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827944832 00000100:00100000:2.0:1784191888.474658:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827944832 00000100:00100000:2.0:1784191888.474724:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1784191888.474732:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:158665:x1870858827944832:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784191888.474847:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:158665:x1870858827944832:12345-0@lo:1000:mdt00_000.0 Request processed in 116us (348us total) trans 0 rc 1/1 00000100:00100000:2.0:1784191888.474859:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:1.0:1784191888.475122:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827944832:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1784191888.475189:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4afdf lrc: 3/0,1 mode: --/EX res: [0x240002343:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.475199:0:158665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4afdf lrc: 3/0,1 mode: --/EX res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.475208:0:158665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4afdf lrc: 3/0,1 mode: --/EX res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.475221:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827944960:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1784191888.475251:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.475278:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f900 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.475548:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827944960 00000100:00100000:2.0:1784191888.475554:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827944960 00000100:00100000:2.0:1784191888.475639:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:2.0:1784191888.475647:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:158665:x1870858827944960:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1784191888.475660:0:159636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.475681:0:159636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4afe6 lrc: 2/0,0 mode: --/EX res: [0x240002343:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4afdf expref: -99 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.475739:0:159636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4afe6 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4afdf expref: 18 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.475766:0:159636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4afe6 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4afdf expref: 18 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.475809:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x5:0x0].0x0 (ffff8af207498700) 00010000:00010000:2.0:1784191888.475811:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191888.475815:0:159636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e000, rc 0) 00000100:00100000:2.0:1784191888.475858:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:158665:x1870858827944960:12345-0@lo:101:mdt00_000.0 Request processed in 211us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.475866:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:1.0:1784191888.475991:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827944960:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1784191888.476012:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4afdf lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4afe6 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.476024:0:158665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4afdf lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4afe6 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.476057:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4afed lrc: 3/0,1 mode: --/EX res: [0x240002343:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.476066:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4afed lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.476074:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4afed lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.476175:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4aff4 lrc: 3/0,1 mode: --/EX res: [0x240002340:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.476188:0:158665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4afa0 lrc: 2/0,0 mode: PR/PR res: [0x240002340:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7a4 expref: 23 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.476196:0:158665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4aff4 lrc: 4/0,1 mode: --/EX res: [0x240002340:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.476222:0:158665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4afa0 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7a4 expref: 23 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.476238:0:158665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4afa0 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7a4 expref: 23 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.476250:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e63100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:158665:1870858827945088:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191888.476342:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f900 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.481381:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.481452:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812356352 00000100:00100000:3.0:1784191888.481464:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812356352 00010000:00010000:3.0:1784191888.481532:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4afa0 lrc: 5/0,0 mode: PR/PR res: [0x240002340:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7a4 expref: 24 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.481592:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 117 00000100:00100000:3.0:1784191888.481603:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23d2c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:69112:x1870858812356352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191888.481631:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191888.481640:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4afa0 lrc: 5/0,0 mode: PR/PR res: [0x240002340:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7a4 expref: 24 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.481655:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4afa0 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7a4 expref: 24 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.481681:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x8:0x0].0x0 (ffff8af23d0d5200) 00010000:00010000:3.0:1784191888.481686:0:158652:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4aff4 lrc: 3/0,1 mode: --/EX res: [0x240002340:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.481731:0:158652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4aff4 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.481740:0:158652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4aff4 lrc: 4/0,1 mode: EX/EX res: [0x240002340:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.481999:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191888.482073:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23d2c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:69112:x1870858812356352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 469us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.482083:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 117 00010000:00010000:1.0:1784191888.482371:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4afa0 lrc: 0/0,0 mode: --/PR res: [0x240002340:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7a4 expref: 23 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.482388:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e63100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:158665:1870858827945088:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191888.482410:0:158665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4aff4 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.482420:0:158665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4aff4 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.482425:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4aff4 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.482470:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9000/0xfeec3c2dc5a4affb lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.482478:0:158665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9000/0xfeec3c2dc5a4affb lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.482488:0:158665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9000/0xfeec3c2dc5a4affb lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.482509:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e63100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827945216:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1784191888.482564:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.482598:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f900 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.482775:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827945216 00000100:00100000:2.0:1784191888.482780:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827945216 00000100:00100000:2.0:1784191888.482834:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:2.0:1784191888.482842:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:158665:x1870858827945216:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1784191888.482860:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.482876:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b002 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4affb expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.482899:0:158671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4afae lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ab expref: 5 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.482908:0:158671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b002 lrc: 4/0,0 mode: --/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4affb expref: 19 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.482934:0:158671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4afae lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ab expref: 5 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.482967:0:158671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4afae lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ab expref: 5 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.482979:0:158671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8ca80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827945344:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191888.483030:0:158671:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2030de600 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.486740:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.487093:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812356480 00000100:00100000:3.0:1784191888.487104:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812356480 00010000:00010000:3.0:1784191888.487146:0:165501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4afae lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ab expref: 6 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.487194:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 118 00000100:00100000:3.0:1784191888.487205:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812356480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191888.487234:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191888.487244:0:165501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4afae lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ab expref: 6 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.487258:0:165501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4afae lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ab expref: 6 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.487280:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x8:0x0].0x0 (ffff8af210dfe000) 00010000:00010000:3.0:1784191888.487288:0:165501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b002 lrc: 3/0,0 mode: --/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4affb expref: 19 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.487299:0:165501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b002 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4affb expref: 19 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.487308:0:165501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b002 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4affb expref: 19 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.487344:0:165501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b002 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4affb expref: 19 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.487359:0:165501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:165501:1870858827945472:0@lo:105: 00000100:00100000:3.0:1784191888.487411:0:165501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191888.487458:0:165501:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.487581:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827945472 00000100:00100000:1.0:1784191888.487586:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827945472 00000100:00100000:1.0:1784191888.487633:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784191888.487641:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:165501:x1870858827945472:12345-0@lo:105: 00010000:00010000:1.0:1784191888.487658:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9000/0xfeec3c2dc5a4affb lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b002 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.487669:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9000/0xfeec3c2dc5a4affb lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b002 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.487676:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9000/0xfeec3c2dc5a4affb lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b002 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.487683:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9000/0xfeec3c2dc5a4affb lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4b002 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.487706:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9000/0xfeec3c2dc5a4affb lrc: 5/0,1 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4b002 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.487715:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9000/0xfeec3c2dc5a4affb lrc: 5/0,1 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4b002 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.487740:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af1115b9000) 00000100:00100000:1.0:1784191888.487805:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:165501:x1870858827945472:12345-0@lo:105: Request processed in 165us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.487813:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784191888.487869:0:165501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:165501:1870858827945472:0@lo:105: 00010000:00010000:1.0:1784191888.487887:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191888.487931:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812356480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 727us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.487938:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 118 00010000:00010000:2.0:1784191888.489636:0:158671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4afae lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ab expref: 5 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.489665:0:158671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8ca80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827945344:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191888.489751:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b002 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4affb expref: 19 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.489762:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x8:0x0].0x0 (ffff8af210dfe000) 00010000:00010000:2.0:1784191888.489765:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784191888.489769:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f400, rc 0) 00000100:00100000:2.0:1784191888.489852:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+19:158665:x1870858827945216:12345-0@lo:101:mdt00_000.0 Request processed in 7010us (7287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.489860:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:1.0:1784191888.490192:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e63100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827945216:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1784191888.490215:0:158665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9000/0xfeec3c2dc5a4affb lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b002 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.491397:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e63100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827945600:0@lo:403:mdt00_000.0 00000100:00100000:1.0:1784191888.491465:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.491561:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f900 going to sleep for 11 seconds 00000100:00100000:3.0:1784191888.493940:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827945600 00000100:00100000:3.0:1784191888.493957:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827945600 00000100:00100000:3.0:1784191888.494078:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1784191888.494101:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:158665:x1870858827945600:12345-0@lo:403:mdt00_000.0 00000100:00100000:3.0:1784191888.497937:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:158665:x1870858827945600:12345-0@lo:403:mdt00_000.0 Request processed in 3835us (6457us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.497955:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:1.0:1784191888.498165:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e63100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827945600:0@lo:403:mdt00_000.0 00000040:00080000:1.0:1784191888.499963:0:158665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002b10:0x2:0x0].6, 944 off38432 00000040:00080000:1.0:1784191888.500140:0:158665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab4:0x2:0x0].6, 1024 off38912 00000004:00080000:1.0:1784191888.500147:0:158665:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af10f20f900 with version 13 00000004:00080000:0.0:1784191888.500252:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 13 rpc_version 13 00000020:00100000:0.0:1784191888.500289:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784191888.500300:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af22dc83480 x1870858827945856/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784191888.500326:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827945856:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784191888.500415:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.500492:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107aff480 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.500627:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827945856 00000100:00100000:2.0:1784191888.500637:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827945856 00000100:00100000:2.0:1784191888.500720:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:2.0:1784191888.500729:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+19:165486:x1870858827945856:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784191888.501246:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:165486:x1870858827945856:12345-0@lo:1000:osp_up0-1.0 Request processed in 517us (829us total) trans 34359738645 rc 0/0 00000100:00100000:2.0:1784191888.501252:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1784191888.501611:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827945856:0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1784191888.502001:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x5:0x0]: returning size 4096 00010000:00010000:1.0:1784191888.502030:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4aff4 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502041:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4aff4 lrc: 2/0,0 mode: EX/EX res: [0x240002340:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502049:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4aff4 lrc: 3/0,0 mode: EX/EX res: [0x240002340:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502056:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191888.502062:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4aff4 lrc: 3/0,0 mode: EX/EX res: [0x240002340:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502071:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4aff4 lrc: 4/0,0 mode: EX/EX res: [0x240002340:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502089:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x8:0x0].0x0 (ffff8af23d0d5200) 00010000:00010000:1.0:1784191888.502102:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784191888.502109:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4aff4 lrc: 2/0,0 mode: --/EX res: [0x240002340:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502115:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4aff4 lrc: 0/0,0 mode: --/EX res: [0x240002340:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502139:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9000/0xfeec3c2dc5a4affb lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b002 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502148:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9000/0xfeec3c2dc5a4affb lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b002 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502155:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9000/0xfeec3c2dc5a4affb lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b002 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502186:0:158665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1784191888.502198:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0x8:0x0] 00010000:00010000:1.0:1784191888.502212:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4afed lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502218:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4afed lrc: 2/0,0 mode: EX/EX res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502224:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4afed lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502229:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191888.502232:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4afed lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502238:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4afed lrc: 4/0,0 mode: EX/EX res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502256:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x5:0x0].0x0 (ffff8af23d0d5300) 00010000:00010000:1.0:1784191888.502258:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191888.502261:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4afed lrc: 2/0,0 mode: --/EX res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502266:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4afed lrc: 0/0,0 mode: --/EX res: [0x240002343:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502280:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4afdf lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4afe6 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502287:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4afdf lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4afe6 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502293:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4afdf lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4afe6 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502351:0:158665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1784191888.502363:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784191888.502368:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4afc3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4afca expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502375:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4afc3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4afca expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.502382:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4afc3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4afca expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.505432:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784191888.505450:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9000/0xfeec3c2dc5a4affb lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4b002 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.505463:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9000 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:0.0:1784191888.505470:0:158653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9000/0xfeec3c2dc5a4affb lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4b002 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191888.505480:0:158653:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9000/0xfeec3c2dc5a4affb lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4b002 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.505549:0:158653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9000/0xfeec3c2dc5a4affb lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b002 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.505556:0:158653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784191888.505591:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9000/0xfeec3c2dc5a4affb lrc: 1/0,0 mode: --/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b002 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.505598:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9000/0xfeec3c2dc5a4affb lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b002 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.505637:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784191888.505642:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4afdf lrc: 2/0,0 mode: EX/EX res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4afe6 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.505647:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9400 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:0.0:1784191888.505669:0:158653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4afdf lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4afe6 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191888.505676:0:158653:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4afdf lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4afe6 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.505710:0:158653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4afdf lrc: 2/0,0 mode: --/EX res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4afe6 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.505716:0:158653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784191888.505723:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4afdf lrc: 1/0,0 mode: --/EX res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4afe6 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.505730:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9400/0xfeec3c2dc5a4afdf lrc: 0/0,0 mode: --/EX res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4afe6 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.505754:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191888.505758:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4afc3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4afca expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.505765:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9200 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:0.0:1784191888.505768:0:158653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4afc3 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4afca expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191888.505775:0:158653:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4afc3 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4afca expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.505803:0:158653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4afc3 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4afca expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.505821:0:158653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784191888.505850:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4afc3 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4afca expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.505859:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191888.505861:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191888.505863:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191888.505891:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827946112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784191888.505974:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191888.505974:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191888.505983:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784191888.505999:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827946240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191888.506015:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784191888.506020:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827945984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191888.506026:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.506176:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827946112 00010000:00010000:1.0:1784191888.506178:0:158665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:2.0:1784191888.506184:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827946112 00010000:00010000:1.0:1784191888.506193:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9200/0xfeec3c2dc5a4afc3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4afca expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191888.506215:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784191888.506230:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4afd1 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4afd8 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.506231:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827946240 00000100:00100000:2.0:1784191888.506234:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827946240 00010000:00010000:1.0:1784191888.506239:0:158665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4afd1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4afd8 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.506255:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784191888.506263:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+21:106500:x1870858827946112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191888.506276:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191888.506296:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4afe6 lrc: 0/0,0 mode: --/EX res: [0x240002343:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4afdf expref: 21 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.506310:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x5:0x0].0x0 (ffff8af207498700) 00000100:00100000:1.0:1784191888.506324:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:123674:x1870858812356096:12345-192.168.204.16@tcp:36:rm.0 Request processed in 47469us (50813us total) trans 25769803794 rc 0/0 00000100:00100000:1.0:1784191888.506332:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 474 00010000:00010000:2.0:1784191888.506334:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191888.506361:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+20:106500:x1870858827946112:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.506368:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784191888.506381:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784191888.506386:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+19:106502:x1870858827946240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191888.506393:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191888.506403:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4afca lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4afc3 expref: 19 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.506416:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5b00) 00010000:00010000:2.0:1784191888.506421:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191888.506445:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+18:106502:x1870858827946240:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.506452:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784191888.506490:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827946240:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784191888.506563:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191888.506635:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.506833:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827946112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191888.506868:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827945984 00000100:00100000:3.0:1784191888.506873:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827945984 00000100:00100000:3.0:1784191888.506915:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784191888.506921:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+18:106500:x1870858827945984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784191888.506930:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191888.506943:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b002 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4affb expref: 18 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.506956:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x8:0x0].0x0 (ffff8af210dfe000) 00010000:00010000:3.0:1784191888.506964:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191888.507012:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+17:106500:x1870858827945984:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.507019:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784191888.509325:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827945984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191888.510108:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.510245:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812356608 00000100:00100000:2.0:1784191888.510271:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812356608 00000100:00100000:2.0:1784191888.510360:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 475 00000100:00100000:2.0:1784191888.510370:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:123674:x1870858812356608:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191888.510390:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.510416:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b009 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b7b9 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.510488:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b010 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.510502:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b010 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.510514:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b010 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191888.510575:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191888.510579:0:158666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191888.510601:0:158666:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b010 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.510637:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b009 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7b9 expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.510658:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b010 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7b9 expref: 6 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.510668:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af207498200) 00010000:00010000:2.0:1784191888.510671:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191888.510675:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e800, rc 0) 00000100:00100000:2.0:1784191888.510974:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812356608:12345-192.168.204.16@tcp:101:rm.0 Request processed in 603us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.510984:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 475 00000100:00100000:1.0:1784191888.513819:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.514027:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812356736 00000100:00100000:0.0:1784191888.514038:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812356736 00000100:00100000:0.0:1784191888.514096:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 476 00000100:00100000:0.0:1784191888.514107:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812356736:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191888.514129:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.514151:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4b017 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b7c0 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.514216:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b01e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.514231:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b01e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.514257:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b01e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.514273:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4b025 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.514280:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4b025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.514286:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4b025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.514417:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:164531:1870858827946368:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784191888.514471:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.514505:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107aff300 going to sleep for 11 seconds 00000100:00100000:3.0:1784191888.514953:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827946368 00000100:00100000:3.0:1784191888.514959:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827946368 00000100:00100000:3.0:1784191888.515003:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:3.0:1784191888.515012:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:164531:x1870858827946368:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784191888.515112:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:164531:x1870858827946368:12345-0@lo:1000:mdt00_004.0 Request processed in 100us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.515131:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:1.0:1784191888.515260:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:164531:1870858827946368:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1784191888.515316:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b02c lrc: 3/1,0 mode: --/PR res: [0x240002343:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515328:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b02c lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515338:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b02c lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191888.515359:0:164531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b02c lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515372:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b01e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515386:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b01e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515393:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b01e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515400:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b01e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515406:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3fa00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191888.515411:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b01e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515419:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b01e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515431:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af207498200) 00010000:00010000:1.0:1784191888.515435:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191888.515440:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b01e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515447:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b01e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515462:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4b025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515469:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4b025 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515475:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4b025 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515486:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3ea00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191888.515489:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4b025 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515495:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4b025 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515504:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a253ddb (ffff8af210dfe200) 00010000:00010000:1.0:1784191888.515506:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191888.515509:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4b025 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515515:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4b025 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515549:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4b017 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7c0 expref: 8 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515563:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b02c lrc: 3/0,0 mode: PR/PR res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7c0 expref: 7 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.515571:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x6:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191888.515574:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784191888.515576:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9200, rc 0) 00000100:00100000:1.0:1784191888.515645:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812356736:12345-192.168.204.16@tcp:101:rm.0 Request processed in 1539us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.515652:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 476 00000100:00100000:1.0:1784191888.518382:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.518483:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812356864 00000100:00100000:0.0:1784191888.518495:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812356864 00000100:00100000:0.0:1784191888.518597:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 477 00000100:00100000:0.0:1784191888.518624:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:123674:x1870858812356864:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191888.518654:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.518681:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4b033 lrc: 2/0,0 mode: --/CR res: [0x240002343:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b7c7 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.518786:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4b03a lrc: 3/1,0 mode: --/PR res: [0x240002343:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.518812:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4b03a lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.518838:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4b03a lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191888.518950:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x6:0x0]: returning size 4096 00000004:00200000:0.0:1784191888.518956:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1784191888.518994:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4b033 lrc: 0/0,0 mode: --/CR res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7c7 expref: 25 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.519017:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4b03a lrc: 3/0,0 mode: PR/PR res: [0x240002343:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7c7 expref: 24 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.519025:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x6:0x0].0x0 (ffff8af210dfe000) 00010000:00010000:0.0:1784191888.519028:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784191888.519031:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3f000, rc 0) 00000100:00100000:0.0:1784191888.519095:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:123674:x1870858812356864:12345-192.168.204.16@tcp:101:rm.0 Request processed in 489us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.519102:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 477 00000100:00100000:0.0:1784191888.522476:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.522576:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812356992 00000100:00100000:1.0:1784191888.522587:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812356992 00000100:00100000:1.0:1784191888.522659:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 478 00000100:00100000:1.0:1784191888.522672:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:123674:x1870858812356992:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:1.0:1784191888.522722:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191888.522914:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b041 lrc: 2/0,0 mode: --/CR res: [0x240002340:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b7ce expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.522996:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b048 lrc: 3/1,0 mode: --/PR res: [0x240002340:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.523012:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b048 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.523025:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b048 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191888.523079:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002340:0x9:0x0]: returning size 4096 00000004:00200000:1.0:1784191888.523085:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1784191888.523130:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b041 lrc: 0/0,0 mode: --/CR res: [0x240002340:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ce expref: 26 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.523149:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b048 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ce expref: 25 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.523158:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x9:0x0].0x0 (ffff8af23d0d5300) 00010000:00010000:1.0:1784191888.523161:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784191888.523165:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8a00, rc 0) 00000100:00100000:1.0:1784191888.523275:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+25:123674:x1870858812356992:12345-192.168.204.16@tcp:101:rm.0 Request processed in 604us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.523302:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 478 00000100:00100000:1.0:1784191888.527233:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.527318:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812357120 00000100:00100000:0.0:1784191888.527330:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812357120 00000100:00100000:0.0:1784191888.527385:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 479 00000100:00100000:0.0:1784191888.527395:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812357120:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191888.527418:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.527444:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4b04f lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b7d5 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.527516:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4b056 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.527560:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4b056 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.527573:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4b056 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191888.527651:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0x9:0x0]: returning size 4096 00000004:00200000:0.0:1784191888.527657:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1784191888.527731:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4b04f lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7d5 expref: 9 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.527768:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4b056 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7d5 expref: 8 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.527778:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x9:0x0].0x0 (ffff8af210dfe700) 00010000:00010000:0.0:1784191888.527782:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784191888.528068:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3f600, rc 0) 00000100:00100000:0.0:1784191888.528139:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812357120:12345-192.168.204.16@tcp:101:rm.0 Request processed in 743us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.528146:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 479 00000100:00100000:0.0:1784191888.533156:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.533282:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812357376 00000100:00100000:3.0:1784191888.533294:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812357376 00000100:00100000:3.0:1784191888.533371:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 480 00000100:00100000:3.0:1784191888.533383:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+25:123674:x1870858812357376:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:3.0:1784191888.533408:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191888.533432:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2600/0xfeec3c2dc5a4b05d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b7dc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191888.533643:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x6:0x0]: returning size 4096 00010000:00010000:2.0:1784191888.534176:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2600/0xfeec3c2dc5a4b05d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7dc expref: 27 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.534196:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af110071f00) 00010000:00010000:2.0:1784191888.534199:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191888.534204:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af110db2600/0xfeec3c2dc5a4b05d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7dc expref: 27 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.534223:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db2600, rc 0) 00000100:00100000:2.0:1784191888.534304:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:123674:x1870858812357376:12345-192.168.204.16@tcp:101:rm.0 Request processed in 922us (1161us total) trans 25769803795 rc 301/301 00000100:00100000:2.0:1784191888.534312:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 480 00000100:00100000:1.0:1784191888.540499:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.540600:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812357504 00000100:00100000:2.0:1784191888.540613:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812357504 00000100:00100000:2.0:1784191888.540756:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 122 00000100:00100000:2.0:1784191888.540770:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:123674:x1870858812357504:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:2.0:1784191888.547010:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:123674:x1870858812357504:12345-192.168.204.16@tcp:37:rm.0 Request processed in 6225us (6508us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.547031:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 122 00000100:00100000:0.0:1784191888.551060:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.551166:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812357632 00000100:00100000:1.0:1784191888.551179:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812357632 00000100:00100000:1.0:1784191888.551296:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 123 00000100:00100000:1.0:1784191888.551308:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1099f7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812357632:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:3.0:1784191888.555168:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1099f7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812357632:12345-192.168.204.16@tcp:37:rm.0 Request processed in 3849us (4105us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.555187:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 123 00000100:00100000:1.0:1784191888.559089:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.559201:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812357888 00000100:00100000:2.0:1784191888.559212:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812357888 00000100:00100000:2.0:1784191888.559306:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 124 00000100:00100000:2.0:1784191888.559317:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:123674:x1870858812357888:12345-192.168.204.16@tcp:35:rm.0 00000100:00100000:2.0:1784191888.559763:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:123674:x1870858812357888:12345-192.168.204.16@tcp:35:rm.0 Request processed in 446us (684us total) trans 25769803796 rc 0/0 00000100:00100000:2.0:1784191888.559772:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 124 00000100:00100000:0.0:1784191888.564613:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.564674:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.564912:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812358016 00000100:00100000:2.0:1784191888.564921:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812358016 00000100:00100000:1.0:1784191888.564955:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812358272 00000100:00100000:1.0:1784191888.564960:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812358272 00000100:00100000:1.0:1784191888.565011:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 481 00000100:00100000:1.0:1784191888.565022:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:123674:x1870858812358272:12345-192.168.204.16@tcp:36:rm.0 00000100:00100000:2.0:1784191888.565045:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 81 00000100:00100000:2.0:1784191888.565053:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:69109:x1870858812358016:12345-192.168.204.16@tcp:103:rm.0 00010000:00010000:2.0:1784191888.565066:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.565079:0:158667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191888.565089:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b02c lrc: 0/0,0 mode: --/PR res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7c0 expref: 8 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.565092:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4b03a lrc: 0/0,0 mode: --/PR res: [0x240002343:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7c7 expref: 27 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.565108:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x6:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191888.565108:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x6:0x0].0x0 (ffff8af210dfe000) 00010000:00010000:2.0:1784191888.565117:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784191888.565117:0:158667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784191888.565168:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b06b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.565176:0:158667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b06b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.565186:0:158667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b06b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.565210:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e62d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827946496:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1784191888.565275:0:158667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.565312:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af22379a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191888.565433:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827946496 00000100:00100000:3.0:1784191888.565437:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827946496 00000100:00100000:3.0:1784191888.565483:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:3.0:1784191888.565491:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:158667:x1870858827946496:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1784191888.565517:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191888.565532:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b072 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4b06b expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.565554:0:158671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b010 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7b9 expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.565573:0:158671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b072 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b06b expref: 18 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.565610:0:158671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b010 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7b9 expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.565635:0:158671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b010 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7b9 expref: 7 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.565649:0:158671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827946624:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191888.565730:0:158671:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35900 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.565945:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69109:x1870858812358016:12345-192.168.204.16@tcp:103:rm.0 Request processed in 891us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.565953:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 81 00000100:00100000:1.0:1784191888.568985:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.569099:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812358400 00000100:00100000:0.0:1784191888.569109:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812358400 00010000:00010000:0.0:1784191888.569152:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b010 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7b9 expref: 7 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.569212:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 119 00000100:00100000:0.0:1784191888.569222:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69109:x1870858812358400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191888.569239:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191888.569246:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b010 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7b9 expref: 7 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.569260:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b010 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7b9 expref: 7 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.569286:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af207498200) 00010000:00010000:0.0:1784191888.569293:0:158651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b072 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b06b expref: 18 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.569305:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b072 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b06b expref: 18 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.569314:0:158651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b072 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b06b expref: 18 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.569349:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b072 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b06b expref: 18 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.569362:0:158671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b010 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7b9 expref: 7 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.569362:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5cbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:158651:1870858827946752:0@lo:105: 00000100:00100000:3.0:1784191888.569378:0:158671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827946624:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191888.569403:0:158651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784191888.569405:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b072 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b06b expref: 18 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.569413:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af207498200) 00010000:00010000:3.0:1784191888.569416:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191888.569419:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3600, rc 0) 00000100:00100000:0.0:1784191888.569451:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107affa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784191888.569461:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:158667:x1870858827946496:12345-0@lo:101:mdt00_002.0 Request processed in 3972us (4186us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.569468:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:1.0:1784191888.569684:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827946752 00000100:00100000:1.0:1784191888.569705:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827946752 00000100:00100000:1.0:1784191888.569753:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784191888.569762:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158651:x1870858827946752:12345-0@lo:105: 00010000:00010000:1.0:1784191888.569773:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b06b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b072 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.569783:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b06b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b072 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.569801:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b06b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b072 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.569808:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b06b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4b072 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.569814:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b06b lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4b072 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.569822:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b06b lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4b072 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.569838:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af1115b8e00) 00000100:00100000:1.0:1784191888.569872:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158651:x1870858827946752:12345-0@lo:105: Request processed in 112us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.569888:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784191888.569925:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e62d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827946496:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1784191888.569944:0:158667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b06b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b072 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191888.569972:0:158667:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784191888.570013:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9a00/0xfeec3c2dc5a4b079 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.570020:0:158667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9a00/0xfeec3c2dc5a4b079 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.570030:0:158667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9a00/0xfeec3c2dc5a4b079 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.570045:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827946880:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1784191888.570071:0:158667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191888.570160:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827946880 00000100:00100000:3.0:1784191888.570165:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827946880 00000100:00100000:3.0:1784191888.570202:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1784191888.570209:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:158667:x1870858827946880:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1784191888.570233:0:159636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191888.570251:0:159636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2a00/0xfeec3c2dc5a4b080 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4b079 expref: -99 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.570273:0:159636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2a00/0xfeec3c2dc5a4b080 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b079 expref: 19 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.570273:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2030de600 going to sleep for 11 seconds 00010000:00010000:3.0:1784191888.570284:0:159636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2a00/0xfeec3c2dc5a4b080 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b079 expref: 19 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.570292:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a253ddb (ffff8af110071d00) 00010000:00010000:3.0:1784191888.570295:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191888.570297:0:159636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db2a00, rc 0) 00000100:00100000:0.0:1784191888.570371:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5cbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:158651:1870858827946752:0@lo:105: 00010000:00010000:0.0:1784191888.570386:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191888.570529:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:158667:x1870858827946880:12345-0@lo:101:mdt00_002.0 Request processed in 319us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.570535:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1784191888.571475:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827946880:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1784191888.571497:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9a00/0xfeec3c2dc5a4b079 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b080 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.571510:0:158667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9a00/0xfeec3c2dc5a4b079 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b080 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191888.571545:0:158667:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1784191888.571598:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827947008:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1784191888.571701:0:158667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.571734:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af22379a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.571754:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827947008 00000100:00100000:2.0:1784191888.571768:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827947008 00000100:00100000:2.0:1784191888.571808:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:2.0:1784191888.571817:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+19:158667:x1870858827947008:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784191888.571905:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+19:158667:x1870858827947008:12345-0@lo:1000:mdt00_002.0 Request processed in 89us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.571912:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1784191888.572023:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827947008:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1784191888.572077:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827947136:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1784191888.572113:0:158667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.572136:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2030de600 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.572192:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827947136 00000100:00100000:2.0:1784191888.572197:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827947136 00000100:00100000:2.0:1784191888.572233:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:2.0:1784191888.572248:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:158667:x1870858827947136:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784191888.572371:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812358400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3147us (3394us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.572380:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 119 00000100:00100000:1.0:1784191888.572514:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827947136:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1784191888.572581:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b087 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.572590:0:158667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b087 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.572600:0:158667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b087 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.572612:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827947264:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1784191888.577736:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:158667:x1870858827947136:12345-0@lo:1000:mdt00_002.0 Request processed in 5478us (5611us total) trans 0 rc 1/1 00000100:00100000:2.0:1784191888.577752:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:1.0:1784191888.579093:0:158667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.579144:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af22379a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.579230:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827947264 00000100:00100000:2.0:1784191888.579240:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827947264 00000100:00100000:2.0:1784191888.579301:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:2.0:1784191888.579312:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+19:158667:x1870858827947264:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1784191888.579336:0:161739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.579367:0:161739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b08e lrc: 2/0,0 mode: --/EX res: [0x240002343:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4b087 expref: -99 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.579399:0:161739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b08e lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b087 expref: 20 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.579415:0:161739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b08e lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b087 expref: 20 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.579532:0:161739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x6:0x0].0x0 (ffff8af207498700) 00010000:00010000:2.0:1784191888.579605:0:161739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191888.579611:0:161739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ea00, rc 0) 00000100:00100000:2.0:1784191888.580024:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:158667:x1870858827947264:12345-0@lo:101:mdt00_002.0 Request processed in 712us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.580032:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1784191888.580115:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827947264:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1784191888.580136:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b087 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b08e expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.580148:0:158667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b087 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b08e expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.580193:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b095 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.580216:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b095 lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.580226:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b095 lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.580339:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b09c lrc: 3/0,1 mode: --/EX res: [0x240002340:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.580355:0:158667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b048 lrc: 2/0,0 mode: PR/PR res: [0x240002340:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ce expref: 26 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.580365:0:158667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b09c lrc: 4/0,1 mode: --/EX res: [0x240002340:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.580399:0:158667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b048 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ce expref: 26 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.580416:0:158667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b048 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ce expref: 26 pid: 158667 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.580507:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:158667:1870858827947392:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191888.580999:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af22379a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.584344:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.584488:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:158667:1870858827947392:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191888.584526:0:158667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b09c lrc: 3/0,1 mode: --/EX res: [0x240002340:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.585646:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812358528 00000100:00100000:0.0:1784191888.585733:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812358528 00010000:00010000:0.0:1784191888.585783:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b048 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ce expref: 27 pid: 158667 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.585833:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 120 00000100:00100000:0.0:1784191888.585845:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23d2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:69111:x1870858812358528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191888.585866:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191888.585874:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b048 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ce expref: 27 pid: 158667 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.585888:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b048 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ce expref: 27 pid: 158667 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.585913:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b048 lrc: 0/0,0 mode: --/PR res: [0x240002340:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ce expref: 27 pid: 158667 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.585933:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x9:0x0].0x0 (ffff8af23d0d5300) 00010000:00010000:0.0:1784191888.585938:0:158650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b09c lrc: 3/0,1 mode: --/EX res: [0x240002340:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.585948:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b09c lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.585971:0:158650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b09c lrc: 4/0,1 mode: EX/EX res: [0x240002340:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.586891:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784191888.586909:0:158667:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b09c lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.586919:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b09c lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.586980:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.586989:0:158667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.586999:0:158667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.587024:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827947520:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1784191888.587083:0:158667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.587305:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23d2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:69111:x1870858812358528:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1128us (2639us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.587317:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 120 00000100:00100000:2.0:1784191888.587328:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af106955b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784191888.588640:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827947520 00000100:00100000:3.0:1784191888.588660:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827947520 00000100:00100000:0.0:1784191888.589204:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:0.0:1784191888.589216:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:158667:x1870858827947520:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1784191888.589240:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.589265:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4b0aa lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4b0a3 expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.589299:0:158671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4b056 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7d5 expref: 5 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.589310:0:158671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4b0aa lrc: 4/0,0 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b0a3 expref: 21 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.589345:0:158671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4b056 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7d5 expref: 5 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.589361:0:158671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4b056 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7d5 expref: 5 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.589375:0:158671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827947648:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191888.589493:0:158671:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107aff480 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.592545:0:158671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827947648:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191888.592663:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4b0aa lrc: 3/0,0 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b0a3 expref: 21 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.592679:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x9:0x0].0x0 (ffff8af210dfe700) 00010000:00010000:0.0:1784191888.592682:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784191888.592718:0:158671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4b0aa lrc: 3/0,0 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b0a3 expref: 21 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.592731:0:158671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4b0aa lrc: 3/0,0 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b0a3 expref: 21 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.592738:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3ec00, rc 0) 00000100:00100000:1.0:1784191888.594169:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:158667:x1870858827947520:12345-0@lo:101:mdt00_002.0 Request processed in 4944us (7074us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.594184:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:2.0:1784191888.594303:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827947520:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1784191888.594327:0:158667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b0aa expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.594338:0:158667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b0aa expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.595283:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.595387:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812358656 00000100:00100000:2.0:1784191888.595395:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812358656 00010000:00010000:2.0:1784191888.595443:0:165501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4b056 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7d5 expref: 6 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.595500:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 121 00000100:00100000:2.0:1784191888.595511:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812358656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191888.595530:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191888.595547:0:165501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4b056 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7d5 expref: 6 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.595561:0:165501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4b056 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7d5 expref: 6 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.595584:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4b056 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7d5 expref: 6 pid: 158665 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.595604:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x9:0x0].0x0 (ffff8af210dfe700) 00010000:00010000:2.0:1784191888.595610:0:165501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4b0aa lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b0a3 expref: 20 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.595632:0:165501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4b0aa lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b0a3 expref: 20 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.595641:0:165501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4b0aa lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b0a3 expref: 20 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.595674:0:165501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4b0aa lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b0a3 expref: 20 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.595876:0:165501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:165501:1870858827947776:0@lo:105: 00000100:00100000:2.0:1784191888.595933:0:165501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.595974:0:165501:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af106955b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.596244:0:158649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827947776 00000100:00100000:1.0:1784191888.596251:0:158649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827947776 00000100:00100000:1.0:1784191888.596295:0:158649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784191888.596302:0:158649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:165501:x1870858827947776:12345-0@lo:105: 00010000:00010000:1.0:1784191888.596555:0:158649:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 5/0,1 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b0aa expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.596566:0:158649:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 5/0,1 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b0aa expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.596575:0:158649:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 5/0,1 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b0aa expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.596584:0:158649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 5/0,1 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4b0aa expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.596591:0:158649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 6/0,1 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4b0aa expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.596599:0:158649:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 6/0,1 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4b0aa expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.596637:0:158649:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af20cd7ee00) 00010000:00010000:0.0:1784191888.596709:0:158667:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b0aa expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.596713:0:158649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:165501:x1870858827947776:12345-0@lo:105: Request processed in 411us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.596720:0:158649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:0.0:1784191888.596720:0:158667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b0aa expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.596758:0:165501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:165501:1870858827947776:0@lo:105: 00010000:00010000:1.0:1784191888.596773:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191888.596846:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69112:x1870858812358656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1335us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.596853:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 121 00000100:00100000:0.0:1784191888.597495:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827947904:0@lo:403:mdt00_002.0 00000100:00100000:0.0:1784191888.597545:0:158667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.597591:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af107aff480 going to sleep for 11 seconds 00000100:00100000:3.0:1784191888.599026:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827947904 00000100:00100000:3.0:1784191888.599041:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827947904 00000100:00100000:3.0:1784191888.599134:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1784191888.599145:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:158667:x1870858827947904:12345-0@lo:403:mdt00_002.0 00000100:00100000:0.0:1784191888.603438:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:158667:x1870858827947904:12345-0@lo:403:mdt00_002.0 Request processed in 4285us (5881us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.603453:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:2.0:1784191888.603675:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827947904:0@lo:403:mdt00_002.0 00000040:00080000:0.0:1784191888.605894:0:158667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002b10:0x2:0x0].7, 944 off39376 00000040:00080000:0.0:1784191888.607924:0:158667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab4:0x2:0x0].7, 1024 off39936 00000004:00080000:0.0:1784191888.607941:0:158667:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af107aff300 with version 14 00000004:00080000:1.0:1784191888.609438:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 14 rpc_version 14 00000020:00100000:1.0:1784191888.609495:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784191888.609508:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af10ec87480 x1870858827948160/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784191888.609538:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec87480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827948160:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784191888.609956:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.610149:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af22379a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.611788:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827948160 00000100:00100000:0.0:1784191888.611808:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827948160 00000100:00100000:0.0:1784191888.611891:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1784191888.611904:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:165486:x1870858827948160:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784191888.612607:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:165486:x1870858827948160:12345-0@lo:1000:osp_up0-1.0 Request processed in 702us (2648us total) trans 34359738646 rc 0/0 00000100:00100000:0.0:1784191888.612626:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:2.0:1784191888.613098:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec87480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827948160:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1784191888.613306:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x6:0x0]: returning size 4096 00010000:00010000:0.0:1784191888.613334:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b09c lrc: 3/0,1 mode: EX/EX res: [0x240002340:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613345:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b09c lrc: 2/0,0 mode: EX/EX res: [0x240002340:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613352:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b09c lrc: 3/0,0 mode: EX/EX res: [0x240002340:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613359:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191888.613364:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b09c lrc: 3/0,0 mode: EX/EX res: [0x240002340:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613371:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b09c lrc: 4/0,0 mode: EX/EX res: [0x240002340:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613387:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0x9:0x0].0x0 (ffff8af23d0d5300) 00010000:00010000:0.0:1784191888.613391:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784191888.613395:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b09c lrc: 2/0,0 mode: --/EX res: [0x240002340:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613422:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b09c lrc: 0/0,0 mode: --/EX res: [0x240002340:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613444:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b0aa expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613452:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b0aa expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613459:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b0aa expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613487:0:158667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1784191888.613497:0:158667:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0x9:0x0] 00010000:00010000:0.0:1784191888.613506:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b095 lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613513:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b095 lrc: 2/0,0 mode: EX/EX res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613518:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b095 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613523:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191888.613526:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b095 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613532:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b095 lrc: 4/0,0 mode: EX/EX res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613552:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x6:0x0].0x0 (ffff8af23d0d5900) 00010000:00010000:0.0:1784191888.613555:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191888.613558:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b095 lrc: 2/0,0 mode: --/EX res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613564:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b095 lrc: 0/0,0 mode: --/EX res: [0x240002343:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613577:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b087 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b08e expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613585:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b087 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b08e expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613592:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b087 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b08e expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613754:0:158667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1784191888.613767:0:158667:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784191888.613773:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b06b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b072 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613780:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b06b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b072 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.613787:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b06b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b072 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.615702:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784191888.615719:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4b0aa expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.615730:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ee00 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:1.0:1784191888.615737:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4b0aa expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191888.615755:0:160901:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4b0aa expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.615811:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b0aa expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.615818:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191888.615858:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 1/0,0 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b0aa expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.615866:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0a3 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b0aa expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.615914:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784191888.615937:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827948288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191888.616022:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.616078:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827948288 00000100:00100000:1.0:1784191888.616085:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827948288 00000100:00100000:1.0:1784191888.616136:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784191888.616145:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+22:106501:x1870858827948288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.616158:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.616432:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4b0aa lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b0a3 expref: 22 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.616453:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0x9:0x0].0x0 (ffff8af210dfe700) 00010000:00010000:1.0:1784191888.616462:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191888.616510:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+21:106501:x1870858827948288:12345-0@lo:103:ldlm_bl.0 Request processed in 365us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.616518:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:1.0:1784191888.616544:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784191888.616549:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b087 lrc: 2/0,0 mode: EX/EX res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4b08e expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.616556:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9800 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:1.0:1784191888.616561:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b087 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4b08e expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191888.616567:0:160901:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b087 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4b08e expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.616604:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b087 lrc: 2/0,0 mode: --/EX res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b08e expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.616611:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191888.616637:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b087 lrc: 1/0,0 mode: --/EX res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b08e expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.616644:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b087 lrc: 0/0,0 mode: --/EX res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b08e expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.616670:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827948416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191888.616730:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784191888.616830:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191888.616835:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b06b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4b072 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.616841:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8e00 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:1.0:1784191888.616845:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b06b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4b072 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191888.616852:0:160901:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b06b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4b072 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.616873:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b06b lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b072 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.616878:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191888.616896:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b06b lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b072 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.616911:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827948544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191888.616937:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.616968:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827948416 00000100:00100000:1.0:1784191888.617034:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827948416 00000100:00100000:1.0:1784191888.617068:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827948544 00000100:00100000:1.0:1784191888.617071:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827948544 00000100:00100000:1.0:1784191888.617088:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784191888.617095:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+22:106499:x1870858827948416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.617105:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.617118:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b08e lrc: 0/0,0 mode: --/EX res: [0x240002343:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b087 expref: 22 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.617130:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x6:0x0].0x0 (ffff8af207498700) 00010000:00010000:1.0:1784191888.617137:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191888.617163:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+21:106499:x1870858827948416:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.617295:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827948288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191888.617345:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784191888.617362:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784191888.617369:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+20:106500:x1870858827948544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.617377:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.617389:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b072 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b06b expref: 20 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.617399:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af207498200) 00010000:00010000:1.0:1784191888.617406:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191888.617483:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+19:106500:x1870858827948544:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.617490:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784191888.617518:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827948416:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.617538:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191888.617540:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191888.617542:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191888.617626:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191888.617876:0:158667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784191888.617891:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b06b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b072 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191888.617912:0:158667:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784191888.617930:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9a00/0xfeec3c2dc5a4b079 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b080 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.617938:0:158667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9a00/0xfeec3c2dc5a4b079 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b080 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.618148:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827948544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191888.618268:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:123674:x1870858812358272:12345-192.168.204.16@tcp:36:rm.0 Request processed in 53245us (53663us total) trans 25769803797 rc 0/0 00000100:00100000:0.0:1784191888.618275:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 481 00010000:00010000:3.0:1784191888.618316:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191888.624563:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.625926:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812358784 00000100:00100000:2.0:1784191888.625944:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812358784 00000100:00100000:2.0:1784191888.626032:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 482 00000100:00100000:2.0:1784191888.626043:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:123674:x1870858812358784:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191888.626068:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.626100:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b0b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b7e3 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.628426:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4b0b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.628466:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4b0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.628480:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4b0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191888.628538:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191888.628543:0:158666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191888.628568:0:158666:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4b0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.628638:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b0b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7e3 expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.628910:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4b0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7e3 expref: 6 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.628919:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af207498900) 00010000:00010000:2.0:1784191888.628922:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191888.628925:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e000, rc 0) 00000100:00100000:2.0:1784191888.629049:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812358784:12345-192.168.204.16@tcp:101:rm.0 Request processed in 3004us (4495us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.629058:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 482 00000100:00100000:1.0:1784191888.635185:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.635407:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812358912 00000100:00100000:2.0:1784191888.635417:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812358912 00000100:00100000:2.0:1784191888.635537:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 483 00000100:00100000:2.0:1784191888.635549:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812358912:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191888.635572:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.635595:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b0bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b7ea expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.635735:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b0c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.635766:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b0c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.635780:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b0c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.635804:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b0cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.635813:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b0cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.635820:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b0cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.635939:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:161504:1870858827948672:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784191888.636000:0:161504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.636041:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af22379a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.636181:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827948672 00000100:00100000:1.0:1784191888.636187:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827948672 00000100:00100000:1.0:1784191888.636220:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1784191888.636228:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:161504:x1870858827948672:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784191888.636324:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:161504:x1870858827948672:12345-0@lo:1000:mdt00_003.0 Request processed in 96us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.636331:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:2.0:1784191888.636464:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:161504:1870858827948672:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1784191888.636515:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b0d4 lrc: 3/1,0 mode: --/PR res: [0x240002343:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636526:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b0d4 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636534:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b0d4 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191888.636557:0:161504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b0d4 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636569:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b0c6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636576:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b0c6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636592:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b0c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636598:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b0c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636604:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191888.636608:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b0c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636627:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b0c6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636639:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af207498900) 00010000:00010000:2.0:1784191888.636642:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191888.636648:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b0c6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636655:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b0c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636669:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b0cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636676:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b0cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636682:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b0cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636727:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191888.636737:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b0cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636753:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b0cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636762:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcaaa8ec3 (ffff8af207498f00) 00010000:00010000:2.0:1784191888.636764:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191888.636767:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b0cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636772:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b0cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636809:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b0bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ea expref: 8 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636821:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b0d4 lrc: 3/0,0 mode: PR/PR res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ea expref: 7 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.636828:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x7:0x0].0x0 (ffff8af207498100) 00010000:00010000:2.0:1784191888.636830:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191888.636833:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ec00, rc 0) 00000100:00100000:2.0:1784191888.636876:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812358912:12345-192.168.204.16@tcp:101:rm.0 Request processed in 1330us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.636884:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 483 00000100:00100000:0.0:1784191888.641114:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.641543:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812359040 00000100:00100000:2.0:1784191888.641553:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812359040 00000100:00100000:2.0:1784191888.641608:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 484 00000100:00100000:2.0:1784191888.641630:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:123674:x1870858812359040:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191888.641675:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.641728:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b0db lrc: 2/0,0 mode: --/CR res: [0x240002343:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b7f1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.641822:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b0e2 lrc: 3/1,0 mode: --/PR res: [0x240002343:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.641838:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b0e2 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.641850:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b0e2 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191888.641947:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x7:0x0]: returning size 4096 00000004:00200000:2.0:1784191888.641953:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1784191888.641990:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b0db lrc: 0/0,0 mode: --/CR res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7f1 expref: 28 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.642008:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b0e2 lrc: 3/0,0 mode: PR/PR res: [0x240002343:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7f1 expref: 27 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.642018:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x7:0x0].0x0 (ffff8af207498000) 00010000:00010000:2.0:1784191888.642021:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784191888.642024:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7fa00, rc 0) 00000100:00100000:2.0:1784191888.642075:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:123674:x1870858812359040:12345-192.168.204.16@tcp:101:rm.0 Request processed in 449us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.642082:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 484 00000100:00100000:1.0:1784191888.646826:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.647027:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812359168 00000100:00100000:2.0:1784191888.647038:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812359168 00000100:00100000:2.0:1784191888.647117:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 485 00000100:00100000:2.0:1784191888.647141:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:123674:x1870858812359168:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191888.647177:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.647205:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b0e9 lrc: 2/0,0 mode: --/CR res: [0x240002340:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b7f8 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.647273:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b0f0 lrc: 3/1,0 mode: --/PR res: [0x240002340:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.647286:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b0f0 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.647298:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b0f0 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191888.647348:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002340:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1784191888.647353:0:158666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1784191888.647388:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b0e9 lrc: 0/0,0 mode: --/CR res: [0x240002340:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7f8 expref: 29 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.647409:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b0f0 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7f8 expref: 28 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.647417:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xa:0x0].0x0 (ffff8af207498400) 00010000:00010000:2.0:1784191888.647420:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784191888.647424:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ea00, rc 0) 00000100:00100000:2.0:1784191888.647481:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:123674:x1870858812359168:12345-192.168.204.16@tcp:101:rm.0 Request processed in 344us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.647489:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 485 00000100:00100000:1.0:1784191888.651423:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.651498:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812359296 00000100:00100000:2.0:1784191888.651509:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812359296 00000100:00100000:2.0:1784191888.651575:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 486 00000100:00100000:2.0:1784191888.651586:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812359296:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191888.651611:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.651647:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0f7 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b7ff expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.652135:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b0fe lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.652151:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b0fe lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.652164:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b0fe lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191888.652227:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1784191888.652233:0:161504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1784191888.652292:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b0f7 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ff expref: 9 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.652312:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b0fe lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ff expref: 8 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.652321:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff8af207498a00) 00010000:00010000:1.0:1784191888.652324:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784191888.652327:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9200, rc 0) 00000100:00100000:1.0:1784191888.652397:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812359296:12345-192.168.204.16@tcp:101:rm.0 Request processed in 812us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.652404:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 486 00000100:00100000:0.0:1784191888.659164:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.659341:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812359552 00000100:00100000:1.0:1784191888.659352:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812359552 00000100:00100000:1.0:1784191888.659420:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 487 00000100:00100000:1.0:1784191888.659431:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:123674:x1870858812359552:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:1.0:1784191888.659453:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191888.659478:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4b105 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b806 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191888.659657:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x7:0x0]: returning size 4096 00010000:00010000:1.0:1784191888.660984:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4b105 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b806 expref: 30 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.661005:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5400) 00010000:00010000:1.0:1784191888.661008:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784191888.661013:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4b105 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b806 expref: 30 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.661020:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1784191888.661052:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9800, rc 0) 00000100:00100000:1.0:1784191888.661127:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:123674:x1870858812359552:12345-192.168.204.16@tcp:101:rm.0 Request processed in 1696us (1971us total) trans 25769803798 rc 301/301 00000100:00100000:1.0:1784191888.661136:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 487 00000100:00100000:0.0:1784191888.661389:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812359680 00000100:00100000:0.0:1784191888.661396:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812359680 00000100:00100000:0.0:1784191888.661447:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 669 00000100:00100000:0.0:1784191888.661456:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:69109:x1870858812359680:12345-192.168.204.16@tcp:63:ll_sa.0 00010000:00010000:0.0:1784191888.661496:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.661510:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4b113 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b80d expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.661554:0:158670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b11a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.661567:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b11a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.661587:0:158670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b11a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.661602:0:158670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b121 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.661609:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b121 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.661623:0:158670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b121 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.661774:0:158670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID:158670:1870858827948800:0@lo:1000:mdt_out00_000.0 00000100:00100000:0.0:1784191888.661820:0:158670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.661846:0:158670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2277db600 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.661866:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827948800 00000100:00100000:0.0:1784191888.661870:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827948800 00000100:00100000:0.0:1784191888.661896:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1784191888.661902:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:158670:x1870858827948800:12345-0@lo:1000:mdt_out00_000.0 00000100:00100000:0.0:1784191888.661966:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:158670:x1870858827948800:12345-0@lo:1000:mdt_out00_000.0 Request processed in 63us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.661972:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1784191888.662009:0:158670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID:158670:1870858827948800:0@lo:1000:mdt_out00_000.0 00010000:00010000:0.0:1784191888.662049:0:158670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b11a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.662056:0:158670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b11a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.662073:0:158670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b11a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.662079:0:158670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3fa00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191888.662083:0:158670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b11a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.662091:0:158670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b11a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.662100:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af207498900) 00010000:00010000:0.0:1784191888.662103:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191888.662107:0:158670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b11a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.662112:0:158670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4b11a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.662126:0:158670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b121 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.662133:0:158670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b121 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.662138:0:158670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b121 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.662143:0:158670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191888.662146:0:158670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b121 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.662162:0:158670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b121 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.662184:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9d6f79b8 (ffff8af210dfef00) 00010000:00010000:0.0:1784191888.662186:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191888.662189:0:158670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b121 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.662194:0:158670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b121 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.662220:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-66, rc=-66) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4b113 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b80d expref: 9 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.662228:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af207498900) 00010000:00010000:0.0:1784191888.662230:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784191888.662234:0:158670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4b113 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b80d expref: 9 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.662241:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3ea00, rc -66) 00000100:00100000:0.0:1784191888.662280:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:69109:x1870858812359680:12345-192.168.204.16@tcp:63:ll_sa.0 Request processed in 826us (1260us total) trans 0 rc -66/-66 00000100:00100000:0.0:1784191888.662287:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 669 00000100:00100000:3.0:1784191888.672468:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.672563:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812359808 00000100:00100000:1.0:1784191888.672574:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812359808 00000100:00100000:1.0:1784191888.672674:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 125 00000100:00100000:1.0:1784191888.672686:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:123674:x1870858812359808:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:1.0:1784191888.677391:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:123674:x1870858812359808:12345-192.168.204.16@tcp:37:rm.0 Request processed in 4693us (4916us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.677406:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 125 00000100:00100000:3.0:1784191888.682310:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.682671:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812359936 00000100:00100000:2.0:1784191888.682682:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812359936 00000100:00100000:2.0:1784191888.682807:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 126 00000100:00100000:2.0:1784191888.682818:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812359936:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:2.0:1784191888.689056:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812359936:12345-192.168.204.16@tcp:37:rm.0 Request processed in 6227us (6744us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.689072:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 126 00000100:00100000:3.0:1784191888.693122:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.693219:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812360192 00000100:00100000:1.0:1784191888.693229:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812360192 00000100:00100000:1.0:1784191888.693285:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 127 00000100:00100000:1.0:1784191888.693295:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:123674:x1870858812360192:12345-192.168.204.16@tcp:35:rm.0 00000100:00100000:1.0:1784191888.694036:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:123674:x1870858812360192:12345-192.168.204.16@tcp:35:rm.0 Request processed in 735us (917us total) trans 25769803799 rc 0/0 00000100:00100000:1.0:1784191888.694048:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 127 00000100:00100000:3.0:1784191888.699801:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.699839:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.699983:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812360320 00000100:00100000:1.0:1784191888.699993:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812360320 00000100:00100000:1.0:1784191888.700066:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 85 00000100:00100000:1.0:1784191888.700077:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:69110:x1870858812360320:12345-192.168.204.16@tcp:103:rm.0 00010000:00010000:1.0:1784191888.700094:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.700123:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b0d4 lrc: 0/0,0 mode: --/PR res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ea expref: 8 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.700158:0:160189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x7:0x0].0x0 (ffff8af207498100) 00010000:00010000:1.0:1784191888.700181:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191888.700236:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69110:x1870858812360320:12345-192.168.204.16@tcp:103:rm.0 Request processed in 161us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.700245:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 85 00000100:00100000:0.0:1784191888.700728:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812360576 00000100:00100000:0.0:1784191888.700735:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812360576 00000100:00100000:0.0:1784191888.700799:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 488 00000100:00100000:0.0:1784191888.700807:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:123674:x1870858812360576:12345-192.168.204.16@tcp:36:rm.0 00010000:00010000:0.0:1784191888.700878:0:158665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191888.700896:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b0e2 lrc: 0/0,0 mode: --/PR res: [0x240002343:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7f1 expref: 30 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.700911:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x7:0x0].0x0 (ffff8af207498000) 00010000:00010000:0.0:1784191888.700918:0:158665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784191888.700970:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.700979:0:158665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.700990:0:158665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.701016:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827948928:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1784191888.701073:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.701111:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef50900 going to sleep for 11 seconds 00000100:00100000:3.0:1784191888.701331:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827948928 00000100:00100000:3.0:1784191888.701336:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827948928 00000100:00100000:3.0:1784191888.701376:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1784191888.701383:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+19:158665:x1870858827948928:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1784191888.701397:0:161739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191888.701412:0:161739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4b12f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4b128 expref: -99 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.701434:0:161739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4b0b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7e3 expref: 6 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.701443:0:161739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4b12f lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b128 expref: 20 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.701470:0:161739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4b0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7e3 expref: 6 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.701484:0:161739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4b0b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7e3 expref: 6 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.701495:0:161739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827949056:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191888.701558:0:161739:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35900 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.714305:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.714380:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812360704 00000100:00100000:1.0:1784191888.714391:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812360704 00010000:00010000:1.0:1784191888.714432:0:165501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4b0b8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7e3 expref: 7 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.714478:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 122 00000100:00100000:1.0:1784191888.714488:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69111:x1870858812360704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.714503:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.714510:0:165501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4b0b8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7e3 expref: 7 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.714527:0:165501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4b0b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7e3 expref: 7 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.714549:0:161739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827949056:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191888.714777:0:161739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4b12f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b128 expref: 20 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.714801:0:161739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af207498900) 00010000:00010000:3.0:1784191888.714806:0:161739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191888.714810:0:161739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4b12f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b128 expref: 20 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.714819:0:161739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3800, rc 0) 00000100:00100000:3.0:1784191888.714883:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:158665:x1870858827948928:12345-0@lo:101:mdt00_000.0 Request processed in 13499us (13808us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.714891:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:0.0:1784191888.715080:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827948928:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1784191888.715110:0:158665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b12f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.715121:0:158665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b12f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.715645:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4b0b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7e3 expref: 7 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.715663:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af207498900) 00010000:00010000:1.0:1784191888.715669:0:165501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4b12f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b128 expref: 19 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.715882:0:165501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4b12f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b128 expref: 19 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.715892:0:165501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4b12f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b128 expref: 19 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.715930:0:165501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4b12f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b128 expref: 19 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.715946:0:165501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:165501:1870858827949184:0@lo:105: 00000100:00100000:1.0:1784191888.715991:0:165501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.716080:0:165501:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2057fe540 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.716445:0:158649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827949184 00000100:00100000:2.0:1784191888.716453:0:158649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827949184 00000100:00100000:2.0:1784191888.716541:0:158649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784191888.716551:0:158649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:165501:x1870858827949184:12345-0@lo:105: 00010000:00010000:2.0:1784191888.716563:0:158649:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b12f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.716572:0:158649:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b12f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.716580:0:158649:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b12f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.716599:0:158649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4b12f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.716606:0:158649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4b12f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.716624:0:158649:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4b12f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.716649:0:158649:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af10de3fa00) 00000100:00100000:2.0:1784191888.716731:0:158649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:165501:x1870858827949184:12345-0@lo:105: Request processed in 182us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.716738:0:158649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:0.0:1784191888.716937:0:158665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b12f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.716957:0:158665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b12f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191888.716983:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784191888.717020:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4b136 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.717028:0:158665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4b136 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.717038:0:158665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4b136 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.717055:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827949312:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1784191888.717090:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.717113:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef50900 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.717130:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827949312 00000100:00100000:0.0:1784191888.717135:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827949312 00000100:00100000:0.0:1784191888.717184:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:0.0:1784191888.717192:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:158665:x1870858827949312:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1784191888.717210:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.717227:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4b13d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4b136 expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.717262:0:158671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4b13d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b136 expref: 21 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.717275:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4b13d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b136 expref: 21 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.717289:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcaaa8ec3 (ffff8af210dfe100) 00010000:00010000:0.0:1784191888.717292:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191888.717295:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3e000, rc 0) 00000100:00100000:0.0:1784191888.717327:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:158665:x1870858827949312:12345-0@lo:101:mdt00_000.0 Request processed in 135us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.717333:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:0.0:1784191888.717371:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827949312:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1784191888.717385:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4b136 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b13d expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.717394:0:158665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4b136 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b13d expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191888.717407:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1784191888.717442:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827949440:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784191888.717468:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.717483:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef506c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.717497:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827949440 00000100:00100000:0.0:1784191888.717501:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827949440 00000100:00100000:0.0:1784191888.717525:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1784191888.717531:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:158665:x1870858827949440:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784191888.717589:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:158665:x1870858827949440:12345-0@lo:1000:mdt00_000.0 Request processed in 57us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.717596:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1784191888.717640:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827949440:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784191888.717708:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827949568:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784191888.717733:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.717751:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827949568 00000100:00100000:0.0:1784191888.717755:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827949568 00000100:00100000:0.0:1784191888.717775:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1784191888.717781:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:158665:x1870858827949568:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784191888.717861:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:158665:x1870858827949568:12345-0@lo:1000:mdt00_000.0 Request processed in 79us (126us total) trans 0 rc 1/1 00000100:00100000:0.0:1784191888.717868:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1784191888.717884:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef506c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.717895:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827949568:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1784191888.717933:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4b144 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.717942:0:158665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4b144 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.717950:0:158665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4b144 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.717960:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827949696:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1784191888.717982:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.717996:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef50900 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.718007:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827949696 00000100:00100000:0.0:1784191888.718010:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827949696 00000100:00100000:0.0:1784191888.718031:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:0.0:1784191888.718037:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:158665:x1870858827949696:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1784191888.718045:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.718064:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4b14b lrc: 2/0,0 mode: --/EX res: [0x240002343:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4b144 expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.718080:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4b14b lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b144 expref: 22 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.718090:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4b14b lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b144 expref: 22 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.718098:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x7:0x0].0x0 (ffff8af210dfee00) 00010000:00010000:0.0:1784191888.718101:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784191888.718103:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3f600, rc 0) 00000100:00100000:0.0:1784191888.718130:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:158665:x1870858827949696:12345-0@lo:101:mdt00_000.0 Request processed in 93us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.718136:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:0.0:1784191888.718162:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827949696:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1784191888.718588:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4b144 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b14b expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.718602:0:158665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4b144 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b14b expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.718641:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4b152 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.718651:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4b152 lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.718660:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4b152 lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.718916:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b159 lrc: 3/0,1 mode: --/EX res: [0x240002340:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.718931:0:158665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b0f0 lrc: 2/0,0 mode: PR/PR res: [0x240002340:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7f8 expref: 29 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.718940:0:158665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b159 lrc: 4/0,1 mode: --/EX res: [0x240002340:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.718964:0:158665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b0f0 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7f8 expref: 29 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.718980:0:158665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b0f0 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7f8 expref: 29 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.718992:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:158665:1870858827949824:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191888.719061:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef50900 going to sleep for 11 seconds 00000100:00100000:3.0:1784191888.719232:0:165501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:165501:1870858827949184:0@lo:105: 00010000:00010000:3.0:1784191888.719262:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191888.719288:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812360704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4801us (5133us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.719297:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 122 00000100:00100000:3.0:1784191888.723008:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.724333:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812360832 00000100:00100000:0.0:1784191888.724346:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812360832 00010000:00010000:0.0:1784191888.724396:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b0f0 lrc: 5/0,0 mode: PR/PR res: [0x240002340:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7f8 expref: 30 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.724444:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 123 00000100:00100000:0.0:1784191888.724453:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23d2c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:69111:x1870858812360832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191888.724468:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191888.724475:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b0f0 lrc: 5/0,0 mode: PR/PR res: [0x240002340:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7f8 expref: 30 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.724510:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b0f0 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7f8 expref: 30 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.724546:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xa:0x0].0x0 (ffff8af207498400) 00010000:00010000:0.0:1784191888.724552:0:158650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b159 lrc: 3/0,1 mode: --/EX res: [0x240002340:0xa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.724562:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b159 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0xa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.724569:0:158650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b159 lrc: 4/0,1 mode: EX/EX res: [0x240002340:0xa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.724591:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191888.724661:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23d2c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:69111:x1870858812360832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 208us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.724669:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 123 00010000:00010000:0.0:1784191888.725552:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b0f0 lrc: 0/0,0 mode: --/PR res: [0x240002340:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7f8 expref: 29 pid: 158666 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.725573:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:158665:1870858827949824:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191888.725593:0:158665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b159 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.725602:0:158665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b159 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.725608:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b159 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.725682:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b160 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.725706:0:158665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b160 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.725717:0:158665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b160 lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.725738:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827949952:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1784191888.725805:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.725840:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827949952 00000100:00100000:0.0:1784191888.725845:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827949952 00000100:00100000:0.0:1784191888.725877:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:0.0:1784191888.725884:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:158665:x1870858827949952:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1784191888.725901:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.725916:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b167 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4b160 expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.725939:0:158671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b0fe lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ff expref: 5 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.725950:0:158671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b167 lrc: 4/0,0 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b160 expref: 23 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.725972:0:158671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b0fe lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ff expref: 5 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.725996:0:158671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b0fe lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ff expref: 5 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.726007:0:158671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827950080:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191888.726063:0:158671:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef50600 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.726077:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef50900 going to sleep for 11 seconds 00000100:00100000:3.0:1784191888.733659:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.733763:0:158671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827950080:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191888.733809:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b167 lrc: 3/0,0 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b160 expref: 23 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.733821:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff8af207498a00) 00010000:00010000:1.0:1784191888.733824:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784191888.733828:0:158671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b167 lrc: 3/0,0 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b160 expref: 23 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.733837:0:158671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b167 lrc: 3/0,0 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b160 expref: 23 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.733844:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341b000, rc 0) 00000100:00100000:1.0:1784191888.733899:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+23:158665:x1870858827949952:12345-0@lo:101:mdt00_000.0 Request processed in 8015us (8103us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.733920:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:2.0:1784191888.734064:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812360960 00000100:00100000:2.0:1784191888.734071:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812360960 00010000:00010000:2.0:1784191888.734116:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b0fe lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ff expref: 6 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.734151:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 124 00000100:00100000:2.0:1784191888.734160:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101686300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69110:x1870858812360960:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191888.734184:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191888.734191:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b0fe lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ff expref: 6 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.734204:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b0fe lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ff expref: 6 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.734238:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b0fe lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b7ff expref: 6 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.734252:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff8af207498a00) 00010000:00010000:2.0:1784191888.734256:0:158652:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b167 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b160 expref: 22 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.734266:0:158652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b167 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b160 expref: 22 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.734274:0:158652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b167 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b160 expref: 22 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.734304:0:158652:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b167 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b160 expref: 22 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.734318:0:158652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:158652:1870858827950208:0@lo:105: 00000100:00100000:2.0:1784191888.734353:0:158652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.734384:0:158652:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.734400:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827950208 00000100:00100000:2.0:1784191888.734403:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827950208 00000100:00100000:2.0:1784191888.734432:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784191888.734438:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158652:x1870858827950208:12345-0@lo:105: 00010000:00010000:2.0:1784191888.734448:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b160 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b167 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.734468:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b160 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b167 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.734477:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b160 lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b167 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.734484:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b160 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4b167 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.734491:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b160 lrc: 5/0,1 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4b167 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.734499:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b160 lrc: 5/0,1 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4b167 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.734513:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af20341b400) 00000100:00100000:2.0:1784191888.734543:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158652:x1870858827950208:12345-0@lo:105: Request processed in 104us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.734549:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784191888.734578:0:158652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:158652:1870858827950208:0@lo:105: 00010000:00010000:2.0:1784191888.734589:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191888.735714:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101686300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812360960:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1549us (2059us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.735725:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 124 00000100:00100000:0.0:1784191888.736081:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827949952:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1784191888.736111:0:158665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b160 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b167 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.737306:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827950336:0@lo:403:mdt00_000.0 00000100:00100000:0.0:1784191888.737396:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.737472:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef50900 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.739285:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827950336 00000100:00100000:2.0:1784191888.739302:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827950336 00000100:00100000:0.0:1784191888.739462:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:0.0:1784191888.739473:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+23:158665:x1870858827950336:12345-0@lo:403:mdt00_000.0 00000100:00100000:0.0:1784191888.741453:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+23:158665:x1870858827950336:12345-0@lo:403:mdt00_000.0 Request processed in 1973us (4048us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.741467:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:0.0:1784191888.741535:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:158665:1870858827950336:0@lo:403:mdt00_000.0 00000040:00080000:0.0:1784191888.742563:0:158665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002b10:0x2:0x0].8, 944 off40320 00000040:00080000:0.0:1784191888.744037:0:158665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab4:0x2:0x0].8, 1024 off40960 00000004:00080000:0.0:1784191888.744050:0:158665:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af10ef50900 with version 15 00000004:00080000:2.0:1784191888.744121:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 15 rpc_version 15 00000020:00100000:2.0:1784191888.744159:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784191888.744238:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af111a8d180 x1870858827950592/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784191888.744266:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8d180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827950592:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784191888.744342:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.744411:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.744459:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827950592 00000100:00100000:0.0:1784191888.744467:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827950592 00000100:00100000:0.0:1784191888.744600:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:0.0:1784191888.744620:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af205712850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+23:165486:x1870858827950592:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784191888.745336:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af205712850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+24:165486:x1870858827950592:12345-0@lo:1000:osp_up0-1.0 Request processed in 724us (992us total) trans 34359738647 rc 0/0 00000100:00100000:0.0:1784191888.745344:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1784191888.745716:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8d180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827950592:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1784191888.745834:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x7:0x0]: returning size 4096 00010000:00010000:0.0:1784191888.745857:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b159 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.745867:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b159 lrc: 2/0,0 mode: EX/EX res: [0x240002340:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.745876:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b159 lrc: 3/0,0 mode: EX/EX res: [0x240002340:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.745883:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191888.745892:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b159 lrc: 3/0,0 mode: EX/EX res: [0x240002340:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.745900:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b159 lrc: 4/0,0 mode: EX/EX res: [0x240002340:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.745915:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xa:0x0].0x0 (ffff8af207498400) 00010000:00010000:0.0:1784191888.745918:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784191888.745923:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b159 lrc: 2/0,0 mode: --/EX res: [0x240002340:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.745930:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4b159 lrc: 0/0,0 mode: --/EX res: [0x240002340:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.745951:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b160 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b167 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.745964:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b160 lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b167 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.745968:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b160 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b167 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.746035:0:158665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1784191888.746044:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0xa:0x0] 00010000:00010000:0.0:1784191888.746053:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4b152 lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.746060:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4b152 lrc: 2/0,0 mode: EX/EX res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.746064:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191888.746065:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4b152 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.746070:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3f000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191888.746071:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b160 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4b167 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.746073:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4b152 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.746079:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341b400 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:0.0:1784191888.746080:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4b152 lrc: 4/0,0 mode: EX/EX res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.746083:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b160 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4b167 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.746089:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x7:0x0].0x0 (ffff8af210dfeb00) 00000004:00010000:1.0:1784191888.746091:0:160901:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b160 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4b167 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.746091:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191888.746094:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4b152 lrc: 2/0,0 mode: --/EX res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.746099:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4b152 lrc: 0/0,0 mode: --/EX res: [0x240002343:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.746117:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4b144 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b14b expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.746121:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b160 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b167 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.746124:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4b144 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b14b expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.746127:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784191888.746244:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827950720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784191888.746290:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784191888.746309:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4b144 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b14b expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.746322:0:158665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1784191888.746333:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784191888.746337:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b12f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.746344:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b12f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.746350:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b12f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.746364:0:158665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1784191888.746367:0:158665:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784191888.746372:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4b136 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b13d expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.746379:0:158665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4b136 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b13d expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.746382:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b160 lrc: 1/0,0 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b167 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.746390:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b160 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b167 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.746406:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784191888.746409:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4b144 lrc: 2/0,0 mode: EX/EX res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4b14b expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.746414:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3ec00 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:1.0:1784191888.746417:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4b144 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4b14b expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191888.746429:0:160901:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4b144 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4b14b expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.746446:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4b144 lrc: 2/0,0 mode: --/EX res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b14b expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.746452:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784191888.746459:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:123674:x1870858812360576:12345-192.168.204.16@tcp:36:rm.0 Request processed in 45652us (46674us total) trans 25769803800 rc 0/0 00000100:00100000:0.0:1784191888.746467:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 488 00000100:00100000:2.0:1784191888.746485:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784191888.746492:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827950848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784191888.746517:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.746568:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827950720 00000100:00100000:2.0:1784191888.746574:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827950720 00000100:00100000:2.0:1784191888.746625:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827950848 00000100:00100000:2.0:1784191888.746629:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827950848 00000100:00100000:2.0:1784191888.746657:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784191888.746665:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+25:106501:x1870858827950720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191888.746677:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191888.746718:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b167 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b160 expref: 25 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.746732:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xa:0x0].0x0 (ffff8af207498a00) 00010000:00010000:2.0:1784191888.746750:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191888.746778:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+24:106501:x1870858827950720:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.746929:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784191888.746944:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784191888.746950:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+23:106501:x1870858827950848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191888.746958:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191888.746969:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4b14b lrc: 0/0,0 mode: --/EX res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b144 expref: 23 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.746980:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x7:0x0].0x0 (ffff8af210dfee00) 00010000:00010000:2.0:1784191888.746986:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191888.747010:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+22:106501:x1870858827950848:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.747017:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784191888.747054:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827950848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784191888.747062:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827950720:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784191888.747261:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784191888.747268:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4b12f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.747277:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3fa00 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:3.0:1784191888.747282:0:158653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4b12f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191888.747290:0:158653:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4b12f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.747330:0:158653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b12f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.747336:0:158653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784191888.747364:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b12f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.747371:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fa00/0xfeec3c2dc5a4b128 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b12f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.747384:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191888.747385:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191888.747387:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191888.747393:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191888.747400:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784191888.747409:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827950976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191888.747442:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191888.747477:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827950976 00000100:00100000:3.0:1784191888.747481:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827950976 00000100:00100000:3.0:1784191888.747510:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784191888.747517:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+22:106500:x1870858827950976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784191888.747525:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191888.747757:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4b12f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b128 expref: 22 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.747772:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af207498900) 00010000:00010000:3.0:1784191888.747780:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784191888.747878:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4b144 lrc: 1/0,0 mode: --/EX res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b14b expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.747887:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3ec00/0xfeec3c2dc5a4b144 lrc: 0/0,0 mode: --/EX res: [0x240002343:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b14b expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.747910:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191888.747912:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191888.747914:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191888.748074:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+21:106500:x1870858827950976:12345-0@lo:103:ldlm_bl.0 Request processed in 556us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.748083:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784191888.751606:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.751922:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812361088 00000100:00100000:3.0:1784191888.751933:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812361088 00000100:00100000:3.0:1784191888.751995:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 489 00000100:00100000:3.0:1784191888.752006:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:123674:x1870858812361088:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:3.0:1784191888.752027:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191888.752051:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b16e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b845 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.752134:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b175 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.752149:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b175 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.752160:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b175 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191888.752218:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784191888.752223:0:161504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784191888.752244:0:161504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b175 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.752269:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b16e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b845 expref: 7 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.752289:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b175 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b845 expref: 6 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.752317:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af110071a00) 00010000:00010000:3.0:1784191888.752320:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784191888.752323:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db2200, rc 0) 00000100:00100000:3.0:1784191888.752388:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812361088:12345-192.168.204.16@tcp:101:rm.0 Request processed in 383us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.752395:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 489 00000100:00100000:2.0:1784191888.754354:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827950976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191888.758108:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.758182:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812361216 00000100:00100000:2.0:1784191888.758192:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812361216 00000100:00100000:3.0:1784191888.758231:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.758257:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 490 00000100:00100000:2.0:1784191888.758267:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812361216:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191888.758288:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.758310:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b17c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b84c expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758385:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b183 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758413:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b183 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758425:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b183 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758442:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b18a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758448:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b18a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758455:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b18a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758516:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b191 lrc: 3/1,0 mode: --/PR res: [0x240002343:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758525:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b191 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758532:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b191 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191888.758554:0:158666:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b191 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758566:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b183 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758572:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b183 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758587:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b183 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758593:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b183 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758599:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191888.758604:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b183 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758620:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b183 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758633:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af110071a00) 00010000:00010000:2.0:1784191888.758636:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191888.758641:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b183 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758648:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b183 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758665:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b18a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758671:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b18a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758677:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b18a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758681:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191888.758734:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b18a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758741:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b18a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758750:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9d6f79b8 (ffff8af207498a00) 00010000:00010000:2.0:1784191888.758752:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191888.758755:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b18a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758761:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b18a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758797:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b17c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b84c expref: 8 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758811:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b191 lrc: 3/0,0 mode: PR/PR res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b84c expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.758818:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x8:0x0].0x0 (ffff8af207498f00) 00010000:00010000:2.0:1784191888.758820:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191888.758822:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f400, rc 0) 00000100:00100000:2.0:1784191888.758884:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812361216:12345-192.168.204.16@tcp:101:rm.0 Request processed in 617us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.758891:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 490 00000100:00100000:0.0:1784191888.759223:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812361344 00000100:00100000:0.0:1784191888.759229:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812361344 00000100:00100000:0.0:1784191888.759275:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 679 00000100:00100000:0.0:1784191888.759282:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69110:x1870858812361344:12345-192.168.204.16@tcp:63:ll_sa.0 00010000:00010000:0.0:1784191888.759308:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.759320:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b198 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b853 expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759352:0:158670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b19f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759362:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b19f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759370:0:158670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b19f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759382:0:158670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf58b9667 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759388:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf58b9667 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759395:0:158670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf58b9667 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759438:0:158670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b19f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759446:0:158670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b19f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759452:0:158670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b19f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759458:0:158670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341ba00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191888.759461:0:158670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b19f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759467:0:158670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b19f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759476:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af110071a00) 00010000:00010000:0.0:1784191888.759478:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191888.759481:0:158670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b19f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759487:0:158670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b19f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759500:0:158670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf58b9667 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759505:0:158670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf58b9667 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759511:0:158670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf58b9667 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759521:0:158670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341aa00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191888.759525:0:158670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf58b9667 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759530:0:158670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf58b9667 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759537:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf58b9667 (ffff8af210dfeb00) 00010000:00010000:0.0:1784191888.759540:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191888.759542:0:158670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf58b9667 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759547:0:158670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf58b9667 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759571:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b198 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b853 expref: 8 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759581:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af110071a00) 00010000:00010000:0.0:1784191888.759583:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784191888.759586:0:158670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b198 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b853 expref: 8 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.759594:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341a400, rc -2) 00000100:00100000:0.0:1784191888.759652:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69110:x1870858812361344:12345-192.168.204.16@tcp:63:ll_sa.0 Request processed in 369us (1420us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784191888.759660:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 679 00000100:00100000:3.0:1784191888.762655:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.762826:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812361472 00000100:00100000:0.0:1784191888.762854:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812361472 00000100:00100000:0.0:1784191888.762988:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 491 00000100:00100000:0.0:1784191888.763008:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:123674:x1870858812361472:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191888.763043:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.763070:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341b200/0xfeec3c2dc5a4b1ad lrc: 2/0,0 mode: --/CR res: [0x240002343:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b85a expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.763135:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341ae00/0xfeec3c2dc5a4b1b4 lrc: 3/1,0 mode: --/PR res: [0x240002343:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.763156:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341ae00/0xfeec3c2dc5a4b1b4 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.763170:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341ae00/0xfeec3c2dc5a4b1b4 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191888.763287:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x8:0x0]: returning size 4096 00000004:00200000:0.0:1784191888.763292:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1784191888.763333:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341b200/0xfeec3c2dc5a4b1ad lrc: 0/0,0 mode: --/CR res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b85a expref: 31 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.763355:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341ae00/0xfeec3c2dc5a4b1b4 lrc: 3/0,0 mode: PR/PR res: [0x240002343:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b85a expref: 30 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.763364:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x8:0x0].0x0 (ffff8af210dfed00) 00010000:00010000:0.0:1784191888.763367:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784191888.763370:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341ae00, rc 0) 00000100:00100000:0.0:1784191888.763437:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:123674:x1870858812361472:12345-192.168.204.16@tcp:101:rm.0 Request processed in 432us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.763454:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 491 00000100:00100000:1.0:1784191888.768429:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.768517:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812361600 00000100:00100000:0.0:1784191888.768529:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812361600 00000100:00100000:0.0:1784191888.768726:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 492 00000100:00100000:0.0:1784191888.768738:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:123674:x1870858812361600:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191888.768762:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.768789:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341b400/0xfeec3c2dc5a4b1bb lrc: 2/0,0 mode: --/CR res: [0x240002340:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b861 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.768859:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b1c2 lrc: 3/1,0 mode: --/PR res: [0x240002340:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.768873:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b1c2 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.768887:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b1c2 lrc: 3/1,0 mode: PR/PR res: [0x240002340:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191888.768939:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002340:0xb:0x0]: returning size 4096 00000004:00200000:0.0:1784191888.768946:0:164531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1784191888.769061:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341b400/0xfeec3c2dc5a4b1bb lrc: 0/0,0 mode: --/CR res: [0x240002340:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b861 expref: 32 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.769086:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b1c2 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b861 expref: 31 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.769096:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xb:0x0].0x0 (ffff8af210dfe800) 00010000:00010000:0.0:1784191888.769099:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784191888.769118:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341a200, rc 0) 00000100:00100000:0.0:1784191888.769228:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:123674:x1870858812361600:12345-192.168.204.16@tcp:101:rm.0 Request processed in 492us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.769236:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 492 00000100:00100000:1.0:1784191888.773833:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.774069:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812361728 00000100:00100000:0.0:1784191888.774079:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812361728 00000100:00100000:0.0:1784191888.774156:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 493 00000100:00100000:0.0:1784191888.774166:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812361728:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191888.774189:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.774214:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b1c9 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b868 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.774281:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1d0 lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.774295:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1d0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.774307:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1d0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191888.774380:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xb:0x0]: returning size 4096 00000004:00200000:0.0:1784191888.774385:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1784191888.774425:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b1c9 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b868 expref: 9 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.774450:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1d0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b868 expref: 8 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.774459:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff8af210dfeb00) 00010000:00010000:0.0:1784191888.774475:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784191888.774480:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341aa00, rc 0) 00000100:00100000:0.0:1784191888.774547:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812361728:12345-192.168.204.16@tcp:101:rm.0 Request processed in 382us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.774936:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 493 00000100:00100000:1.0:1784191888.779744:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.780276:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812361984 00000100:00100000:2.0:1784191888.780287:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812361984 00000100:00100000:2.0:1784191888.780362:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 494 00000100:00100000:2.0:1784191888.780372:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:123674:x1870858812361984:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191888.780408:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.780433:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b1d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b86f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191888.780621:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x8:0x0]: returning size 4096 00010000:00010000:2.0:1784191888.781041:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b1d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b86f expref: 33 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.781061:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af207498a00) 00010000:00010000:2.0:1784191888.781064:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191888.781070:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b1d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b86f expref: 33 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.781093:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e400, rc 0) 00000100:00100000:2.0:1784191888.781427:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:123674:x1870858812361984:12345-192.168.204.16@tcp:101:rm.0 Request processed in 1055us (1746us total) trans 25769803801 rc 301/301 00000100:00100000:2.0:1784191888.781440:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 494 00000100:00100000:1.0:1784191888.787526:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.787607:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812362112 00000100:00100000:2.0:1784191888.787627:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812362112 00000100:00100000:2.0:1784191888.787725:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 128 00000100:00100000:2.0:1784191888.787737:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1099f6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:123674:x1870858812362112:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:2.0:1784191888.796377:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1099f6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:123674:x1870858812362112:12345-192.168.204.16@tcp:37:rm.0 Request processed in 8632us (8852us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.796392:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 128 00000100:00100000:1.0:1784191888.802414:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.802515:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812362240 00000100:00100000:3.0:1784191888.802527:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812362240 00000100:00100000:3.0:1784191888.802714:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 129 00000100:00100000:3.0:1784191888.802725:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812362240:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:3.0:1784191888.808367:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812362240:12345-192.168.204.16@tcp:37:rm.0 Request processed in 5629us (5948us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.808383:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 129 00000100:00100000:1.0:1784191888.813773:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.813874:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812362496 00000100:00100000:2.0:1784191888.813886:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812362496 00000100:00100000:2.0:1784191888.813949:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 130 00000100:00100000:2.0:1784191888.813976:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:123674:x1870858812362496:12345-192.168.204.16@tcp:35:rm.0 00000100:00100000:2.0:1784191888.814358:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:123674:x1870858812362496:12345-192.168.204.16@tcp:35:rm.0 Request processed in 384us (676us total) trans 25769803802 rc 0/0 00000100:00100000:2.0:1784191888.814367:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 130 00000100:00100000:0.0:1784191888.818053:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.818154:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.818367:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812362624 00000100:00100000:2.0:1784191888.818377:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812362624 00000100:00100000:2.0:1784191888.818451:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 89 00000100:00100000:2.0:1784191888.818463:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:69111:x1870858812362624:12345-192.168.204.16@tcp:103:rm.0 00010000:00010000:2.0:1784191888.818479:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191888.818504:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b191 lrc: 0/0,0 mode: --/PR res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b84c expref: 8 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.818524:0:160189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x8:0x0].0x0 (ffff8af207498f00) 00010000:00010000:2.0:1784191888.818546:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191888.818650:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69111:x1870858812362624:12345-192.168.204.16@tcp:103:rm.0 Request processed in 189us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.818658:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 89 00000100:00100000:1.0:1784191888.818936:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812362880 00000100:00100000:1.0:1784191888.818941:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812362880 00000100:00100000:1.0:1784191888.819017:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 495 00000100:00100000:1.0:1784191888.819026:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:123674:x1870858812362880:12345-192.168.204.16@tcp:36:rm.0 00010000:00010000:1.0:1784191888.819246:0:164531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.819266:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341ae00/0xfeec3c2dc5a4b1b4 lrc: 0/0,0 mode: --/PR res: [0x240002343:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b85a expref: 33 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.819284:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x8:0x0].0x0 (ffff8af210dfed00) 00010000:00010000:1.0:1784191888.819291:0:164531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784191888.819342:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.819351:0:164531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.819362:0:164531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.819386:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827951104:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1784191888.819437:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.819478:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2057feb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.819527:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827951104 00000100:00100000:2.0:1784191888.819545:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827951104 00000100:00100000:2.0:1784191888.819584:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:2.0:1784191888.819591:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:164531:x1870858827951104:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1784191888.819606:0:159636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.819630:0:159636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b1ec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4b1e5 expref: -99 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.819654:0:159636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b175 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b845 expref: 6 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.819672:0:159636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b1ec lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b1e5 expref: 22 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.819739:0:159636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b175 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b845 expref: 6 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.819754:0:159636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b175 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b845 expref: 6 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.819766:0:159636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8df80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:159636:1870858827951232:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191888.820018:0:159636:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2dbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.824301:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.824415:0:159636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8df80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:159636:1870858827951232:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191888.824457:0:159636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b1ec lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b1e5 expref: 22 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.824470:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af110071a00) 00010000:00010000:0.0:1784191888.824485:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191888.824490:0:159636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b1ec lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b1e5 expref: 22 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.824500:0:159636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e400, rc 0) 00000100:00100000:0.0:1784191888.824577:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+22:164531:x1870858827951104:12345-0@lo:101:mdt00_004.0 Request processed in 4985us (5138us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.824586:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:1.0:1784191888.824830:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827951104:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1784191888.824853:0:164531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b1ec expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.824864:0:164531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b1ec expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.825325:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812363008 00000100:00100000:3.0:1784191888.825334:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812363008 00010000:00010000:2.0:1784191888.825446:0:165501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b175 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b845 expref: 7 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.825520:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 125 00000100:00100000:2.0:1784191888.825530:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69112:x1870858812363008:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191888.825554:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191888.825561:0:165501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b175 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b845 expref: 7 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.825575:0:165501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b175 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b845 expref: 7 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.825599:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b175 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b845 expref: 7 pid: 161504 timeout: 5608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.825643:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af110071a00) 00010000:00010000:2.0:1784191888.825651:0:165501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b1ec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b1e5 expref: 21 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.825664:0:165501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b1ec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b1e5 expref: 21 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.825673:0:165501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b1ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b1e5 expref: 21 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.825750:0:165501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b1ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b1e5 expref: 21 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.825764:0:165501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:165501:1870858827951360:0@lo:105: 00000100:00100000:2.0:1784191888.825924:0:165501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.825967:0:165501:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db480 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.826020:0:158648:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784191888.826032:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827951360 00000100:00100000:1.0:1784191888.826036:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827951360 00000100:00100000:1.0:1784191888.826084:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784191888.826101:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af203254450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:165501:x1870858827951360:12345-0@lo:105: 00010000:00010000:1.0:1784191888.826112:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b1ec expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.826122:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b1ec expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.826130:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b1ec expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.826138:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4b1ec expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.826146:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4b1ec expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.826154:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4b1ec expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.826382:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af1115b8600) 00000100:00100000:1.0:1784191888.826430:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af203254450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:165501:x1870858827951360:12345-0@lo:105: Request processed in 339us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.826438:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784191888.826504:0:165501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:165501:1870858827951360:0@lo:105: 00010000:00010000:1.0:1784191888.826520:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191888.826565:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812363008:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1035us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.826583:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 125 00010000:00010000:0.0:1784191888.826658:0:164531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b1ec expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.826669:0:164531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b1ec expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191888.826718:0:164531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784191888.826756:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b1f3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.826771:0:164531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b1f3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.826792:0:164531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b1f3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.826812:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827951488:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1784191888.826851:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.826874:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af109911480 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.826893:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827951488 00000100:00100000:0.0:1784191888.826897:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827951488 00000100:00100000:0.0:1784191888.826933:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1784191888.826941:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:164531:x1870858827951488:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1784191888.826958:0:161739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.826975:0:161739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b200/0xfeec3c2dc5a4b1fa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4b1f3 expref: -99 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.826997:0:161739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b200/0xfeec3c2dc5a4b1fa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b1f3 expref: 23 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.827011:0:161739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b200/0xfeec3c2dc5a4b1fa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b1f3 expref: 23 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.827018:0:161739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9d6f79b8 (ffff8af210dfe500) 00010000:00010000:0.0:1784191888.827021:0:161739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191888.827024:0:161739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341b200, rc 0) 00000100:00100000:0.0:1784191888.827053:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:164531:x1870858827951488:12345-0@lo:101:mdt00_004.0 Request processed in 112us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.827065:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1784191888.827117:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827951488:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1784191888.827131:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b1f3 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b1fa expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.827141:0:164531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b1f3 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b1fa expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191888.827154:0:164531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1784191888.827472:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827951616:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784191888.827505:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.827539:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233dd7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.829885:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827951616 00000100:00100000:0.0:1784191888.829901:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827951616 00000100:00100000:0.0:1784191888.830039:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:0.0:1784191888.830051:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+23:164531:x1870858827951616:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784191888.830203:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+23:164531:x1870858827951616:12345-0@lo:1000:mdt00_004.0 Request processed in 154us (2696us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.830211:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:1.0:1784191888.830286:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827951616:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1784191888.830378:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827951744:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1784191888.830418:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.830658:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2057fe540 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.830821:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827951744 00000100:00100000:2.0:1784191888.830831:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827951744 00000100:00100000:2.0:1784191888.830905:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1784191888.830913:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+23:164531:x1870858827951744:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1784191888.831003:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+23:164531:x1870858827951744:12345-0@lo:1000:mdt00_004.0 Request processed in 90us (584us total) trans 0 rc 1/1 00000100:00100000:2.0:1784191888.831010:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:1.0:1784191888.831067:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827951744:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1784191888.831133:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b201 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.831146:0:164531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b201 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.831156:0:164531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b201 lrc: 3/0,1 mode: --/EX res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.831371:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827951872:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1784191888.831404:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.831429:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af109911480 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.831478:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827951872 00000100:00100000:0.0:1784191888.831483:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827951872 00000100:00100000:0.0:1784191888.831516:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:0.0:1784191888.831524:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+23:164531:x1870858827951872:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1784191888.831544:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.831562:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b208 lrc: 2/0,0 mode: --/EX res: [0x240002343:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4b201 expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.831620:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b208 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b201 expref: 24 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.831635:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b208 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b201 expref: 24 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.831645:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x8:0x0].0x0 (ffff8af210dfe400) 00010000:00010000:0.0:1784191888.831647:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784191888.831651:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341b000, rc 0) 00000100:00100000:0.0:1784191888.831683:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+24:164531:x1870858827951872:12345-0@lo:101:mdt00_004.0 Request processed in 160us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.831710:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:1.0:1784191888.831911:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827951872:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1784191888.831925:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b201 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b208 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.831937:0:164531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b201 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b208 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.831964:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4b20f lrc: 3/0,1 mode: --/EX res: [0x240002343:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.831980:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4b20f lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.831990:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4b20f lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.832116:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b216 lrc: 3/0,1 mode: --/EX res: [0x240002340:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.832130:0:164531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b1c2 lrc: 2/0,0 mode: PR/PR res: [0x240002340:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b861 expref: 32 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.832139:0:164531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b216 lrc: 4/0,1 mode: --/EX res: [0x240002340:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.832442:0:164531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b1c2 lrc: 3/0,0 mode: PR/PR res: [0x240002340:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b861 expref: 32 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.832460:0:164531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b1c2 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b861 expref: 32 pid: 164531 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.832473:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:164531:1870858827952000:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191888.832557:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af109911480 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.837958:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.838510:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812363136 00000100:00100000:3.0:1784191888.838520:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812363136 00010000:00010000:3.0:1784191888.838634:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b1c2 lrc: 5/0,0 mode: PR/PR res: [0x240002340:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b861 expref: 33 pid: 164531 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.838737:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 126 00000100:00100000:3.0:1784191888.838751:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23d2c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:69110:x1870858812363136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191888.838806:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191888.838813:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b1c2 lrc: 5/0,0 mode: PR/PR res: [0x240002340:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b861 expref: 33 pid: 164531 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.838827:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b1c2 lrc: 4/0,0 mode: PR/PR res: [0x240002340:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b861 expref: 33 pid: 164531 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.838850:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xb:0x0].0x0 (ffff8af210dfe800) 00010000:00010000:3.0:1784191888.838856:0:158652:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b216 lrc: 3/0,1 mode: --/EX res: [0x240002340:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.838876:0:158652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b216 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.838884:0:158652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b216 lrc: 4/0,1 mode: EX/EX res: [0x240002340:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.838904:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191888.838964:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23d2c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:69110:x1870858812363136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 217us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.838972:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 126 00010000:00010000:1.0:1784191888.840256:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b1c2 lrc: 0/0,0 mode: --/PR res: [0x240002340:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b861 expref: 32 pid: 164531 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.840283:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:164531:1870858827952000:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191888.840307:0:164531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b216 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.840459:0:164531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b216 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.840467:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b216 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.840517:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341bc00/0xfeec3c2dc5a4b21d lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.840524:0:164531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341bc00/0xfeec3c2dc5a4b21d lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.840546:0:164531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341bc00/0xfeec3c2dc5a4b21d lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.840567:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827952128:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1784191888.840633:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.840677:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233dd7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.841484:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827952128 00000100:00100000:1.0:1784191888.841493:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827952128 00000100:00100000:1.0:1784191888.841566:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1784191888.841575:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+24:164531:x1870858827952128:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1784191888.841594:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191888.841643:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b224 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4b21d expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.841673:0:158670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1d0 lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b868 expref: 5 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.841683:0:158670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b224 lrc: 4/0,0 mode: --/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b21d expref: 25 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.841731:0:158670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1d0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b868 expref: 5 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.841745:0:158670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1d0 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b868 expref: 5 pid: 158667 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.841757:0:158670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227cd1180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:158670:1870858827952256:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191888.841849:0:158670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af109911480 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.851973:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.852106:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812363264 00000100:00100000:3.0:1784191888.852116:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812363264 00010000:00010000:3.0:1784191888.852158:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1d0 lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b868 expref: 6 pid: 158667 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.852211:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 127 00000100:00100000:3.0:1784191888.852221:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812363264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191888.852254:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191888.852262:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1d0 lrc: 5/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b868 expref: 6 pid: 158667 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.852278:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1d0 lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b868 expref: 6 pid: 158667 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.852303:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff8af210dfeb00) 00010000:00010000:3.0:1784191888.852310:0:158651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b224 lrc: 3/0,0 mode: --/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b21d expref: 25 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.852322:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b224 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b21d expref: 25 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.852331:0:158651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b224 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b21d expref: 25 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.852364:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b224 lrc: 4/0,0 mode: EX/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b21d expref: 25 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.852378:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:158651:1870858827952384:0@lo:105: 00000100:00100000:3.0:1784191888.852425:0:158651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191888.852475:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.852638:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827952384 00000100:00100000:0.0:1784191888.852643:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827952384 00000100:00100000:0.0:1784191888.852684:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784191888.852714:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158651:x1870858827952384:12345-0@lo:105: 00010000:00010000:0.0:1784191888.852726:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341bc00/0xfeec3c2dc5a4b21d lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b224 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.852735:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341bc00/0xfeec3c2dc5a4b21d lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b224 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.852742:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341bc00/0xfeec3c2dc5a4b21d lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b224 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.852750:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341bc00/0xfeec3c2dc5a4b21d lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4b224 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.852756:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341bc00/0xfeec3c2dc5a4b21d lrc: 5/0,1 mode: EX/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4b224 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.852764:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341bc00/0xfeec3c2dc5a4b21d lrc: 5/0,1 mode: EX/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4b224 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.852778:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af20341bc00) 00000100:00100000:0.0:1784191888.852832:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158651:x1870858827952384:12345-0@lo:105: Request processed in 120us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.852840:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784191888.852881:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:158651:1870858827952384:0@lo:105: 00010000:00010000:0.0:1784191888.852906:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191888.852948:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812363264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 728us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.852955:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 127 00010000:00010000:1.0:1784191888.854925:0:158670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b1d0 lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b868 expref: 5 pid: 158667 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.854957:0:158670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227cd1180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:158670:1870858827952256:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191888.855012:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b224 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b21d expref: 25 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.855024:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff8af210dfeb00) 00010000:00010000:1.0:1784191888.855027:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784191888.855031:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9000, rc 0) 00000100:00100000:1.0:1784191888.856166:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+25:164531:x1870858827952128:12345-0@lo:101:mdt00_004.0 Request processed in 14578us (15519us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.856178:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:2.0:1784191888.856332:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827952128:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1784191888.856363:0:164531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341bc00/0xfeec3c2dc5a4b21d lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b224 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.857274:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827952512:0@lo:403:mdt00_004.0 00000100:00100000:2.0:1784191888.857342:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.857366:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db180 going to sleep for 11 seconds 00000100:00100000:3.0:1784191888.858095:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827952512 00000100:00100000:3.0:1784191888.858105:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827952512 00000100:00100000:3.0:1784191888.858174:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1784191888.858185:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+25:164531:x1870858827952512:12345-0@lo:403:mdt00_004.0 00000100:00100000:3.0:1784191888.860130:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+25:164531:x1870858827952512:12345-0@lo:403:mdt00_004.0 Request processed in 1937us (2778us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.860144:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1784191888.860427:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827952512:0@lo:403:mdt00_004.0 00000040:00080000:1.0:1784191888.861491:0:164531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002b10:0x2:0x0].9, 944 off41264 00000040:00080000:1.0:1784191888.861754:0:164531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab4:0x2:0x0].9, 1024 off41984 00000004:00080000:1.0:1784191888.861761:0:164531:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af109911480 with version 16 00000004:00080000:3.0:1784191888.862095:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 16 rpc_version 16 00000020:00100000:3.0:1784191888.862141:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784191888.862152:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af101686300 x1870858827952768/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191888.862179:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827952768:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784191888.862261:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191888.862346:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.862679:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827952768 00000100:00100000:2.0:1784191888.862719:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827952768 00000100:00100000:2.0:1784191888.862957:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:0.0:1784191888.863032:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+25:165486:x1870858827952768:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784191888.863559:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+26:165486:x1870858827952768:12345-0@lo:1000:osp_up0-1.0 Request processed in 589us (1296us total) trans 34359738648 rc 0/0 00000100:00100000:3.0:1784191888.863680:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827952768:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1784191888.863906:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x8:0x0]: returning size 4096 00010000:00010000:2.0:1784191888.863930:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b216 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.863941:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b216 lrc: 2/0,0 mode: EX/EX res: [0x240002340:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.863948:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b216 lrc: 3/0,0 mode: EX/EX res: [0x240002340:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.863954:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191888.863958:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b216 lrc: 3/0,0 mode: EX/EX res: [0x240002340:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.863966:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b216 lrc: 4/0,0 mode: EX/EX res: [0x240002340:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.863982:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xb:0x0].0x0 (ffff8af210dfe800) 00010000:00010000:2.0:1784191888.863985:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784191888.863989:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b216 lrc: 2/0,0 mode: --/EX res: [0x240002340:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864011:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b216 lrc: 0/0,0 mode: --/EX res: [0x240002340:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864031:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341bc00/0xfeec3c2dc5a4b21d lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b224 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864040:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341bc00/0xfeec3c2dc5a4b21d lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b224 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864046:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341bc00/0xfeec3c2dc5a4b21d lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b224 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864073:0:164531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1784191888.864081:0:164531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0xb:0x0] 00010000:00010000:2.0:1784191888.864089:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4b20f lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864096:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4b20f lrc: 2/0,0 mode: EX/EX res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864101:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4b20f lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864106:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191888.864109:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4b20f lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864116:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4b20f lrc: 4/0,0 mode: EX/EX res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864135:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x8:0x0].0x0 (ffff8af23d0d5900) 00010000:00010000:2.0:1784191888.864137:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191888.864140:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4b20f lrc: 2/0,0 mode: --/EX res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864147:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4b20f lrc: 0/0,0 mode: --/EX res: [0x240002343:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864161:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b201 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b208 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864168:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b201 lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b208 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864174:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b201 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b208 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864191:0:164531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1784191888.864200:0:164531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1784191888.864208:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784191888.864213:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341bc00/0xfeec3c2dc5a4b21d lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4b224 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864221:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341bc00 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:2.0:1784191888.864224:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341bc00/0xfeec3c2dc5a4b21d lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4b224 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191888.864231:0:158654:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341bc00/0xfeec3c2dc5a4b21d lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4b224 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864270:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341bc00/0xfeec3c2dc5a4b21d lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b224 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864277:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191888.864297:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341bc00/0xfeec3c2dc5a4b21d lrc: 1/0,0 mode: --/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b224 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864304:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341bc00/0xfeec3c2dc5a4b21d lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b224 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864319:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191888.864322:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b201 lrc: 2/0,0 mode: EX/EX res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4b208 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864328:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8e00 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:2.0:1784191888.864332:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b201 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4b208 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191888.864338:0:158654:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b201 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4b208 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864353:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b201 lrc: 2/0,0 mode: --/EX res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b208 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864359:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784191888.864373:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b201 lrc: 1/0,0 mode: --/EX res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b208 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864389:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8e00/0xfeec3c2dc5a4b201 lrc: 0/0,0 mode: --/EX res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b208 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864402:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191888.864404:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191888.864406:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191888.864414:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784191888.864431:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827952896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784191888.864477:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.864511:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827953024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784191888.864548:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.864582:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827952896 00000100:00100000:2.0:1784191888.864588:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827952896 00000100:00100000:2.0:1784191888.864633:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827953024 00000100:00100000:2.0:1784191888.864637:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827953024 00000100:00100000:2.0:1784191888.864659:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784191888.864666:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+28:106499:x1870858827952896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191888.864679:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191888.864727:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b224 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b21d expref: 28 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864739:0:160189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xb:0x0].0x0 (ffff8af210dfeb00) 00010000:00010000:2.0:1784191888.864746:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191888.864777:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+27:106499:x1870858827952896:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.864927:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784191888.864957:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784191888.864962:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+26:106501:x1870858827953024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191888.864970:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191888.864982:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b208 lrc: 0/0,0 mode: --/EX res: [0x240002343:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b201 expref: 26 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.864999:0:160189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x8:0x0].0x0 (ffff8af210dfe400) 00010000:00010000:2.0:1784191888.865006:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191888.865034:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+25:106501:x1870858827953024:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.865041:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784191888.865076:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827953024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784191888.865101:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827952896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191888.865129:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b1ec expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.865139:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b1ec expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.865145:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b1ec expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.865161:0:164531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1784191888.865168:0:164531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1784191888.865173:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b1f3 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b1fa expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.865190:0:164531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b1f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b1fa expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.865268:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:123674:x1870858812362880:12345-192.168.204.16@tcp:36:rm.0 Request processed in 46241us (47223us total) trans 25769803803 rc 0/0 00000100:00100000:2.0:1784191888.865276:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 495 00010000:00010000:3.0:1784191888.865461:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784191888.865468:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4b1ec expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.865476:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8600 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:3.0:1784191888.865480:0:158653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4b1ec expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191888.865489:0:158653:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4b1ec expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.865515:0:158653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b1ec expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.865522:0:158653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784191888.865558:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b1ec expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.865573:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8600/0xfeec3c2dc5a4b1e5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b1ec expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.865587:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191888.865588:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191888.865590:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191888.865597:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784191888.865606:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827953152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191888.865649:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191888.865716:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827953152 00000100:00100000:3.0:1784191888.865721:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827953152 00000100:00100000:3.0:1784191888.865755:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784191888.865762:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+25:106501:x1870858827953152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784191888.865772:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191888.865799:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b1ec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b1e5 expref: 25 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.865812:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af110071a00) 00010000:00010000:3.0:1784191888.865820:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191888.865852:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+24:106501:x1870858827953152:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.865858:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784191888.865888:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827953152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.866187:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191888.869333:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.869413:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812363392 00000100:00100000:1.0:1784191888.869424:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812363392 00000100:00100000:1.0:1784191888.869490:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 496 00000100:00100000:1.0:1784191888.869501:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:123674:x1870858812363392:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:1.0:1784191888.869528:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191888.869568:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b22b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b876 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.869660:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4b232 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.869676:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4b232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.869758:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4b232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191888.869987:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784191888.869991:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784191888.870015:0:158667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4b232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.870042:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b22b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b876 expref: 7 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.870060:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4b232 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b876 expref: 6 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.870067:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5300) 00010000:00010000:1.0:1784191888.870070:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784191888.870074:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9400, rc 0) 00000100:00100000:1.0:1784191888.870182:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812363392:12345-192.168.204.16@tcp:101:rm.0 Request processed in 683us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.870188:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 496 00000100:00100000:0.0:1784191888.870501:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:1.0:1784191888.876857:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.876958:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.877430:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812363520 00000100:00100000:2.0:1784191888.877442:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812363520 00000100:00100000:2.0:1784191888.877516:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 497 00000100:00100000:2.0:1784191888.877528:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123674:x1870858812363520:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191888.877562:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.877586:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b239 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b87d expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.877668:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b240 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.877684:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b240 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.877724:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b240 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.877740:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b247 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.877748:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.877768:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.877919:0:158665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:158665:1870858827953280:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784191888.877976:0:158665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.878072:0:158665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db240 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.878350:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812363648 00000100:00100000:0.0:1784191888.878356:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812363648 00000100:00100000:0.0:1784191888.878395:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827953280 00000100:00100000:0.0:1784191888.878398:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827953280 00000100:00100000:0.0:1784191888.878429:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 688 00000100:00100000:0.0:1784191888.878438:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:69112:x1870858812363648:12345-192.168.204.16@tcp:63:ll_sa.0 00010000:00010000:0.0:1784191888.878463:0:159636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.878473:0:159636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b24e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b884 expref: -99 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.878507:0:159636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341bc00/0xfeec3c2dc5a4b255 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.878518:0:159636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341bc00/0xfeec3c2dc5a4b255 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.878536:0:159636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341bc00/0xfeec3c2dc5a4b255 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.878600:0:159636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b25c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2fef16ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.878626:0:159636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b25c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2fef16ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.878634:0:159636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b25c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2fef16ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.878665:0:159636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341bc00/0xfeec3c2dc5a4b255 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.878672:0:159636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341bc00/0xfeec3c2dc5a4b255 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.878678:0:159636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341bc00/0xfeec3c2dc5a4b255 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.878684:0:159636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341bc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191888.878721:0:159636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341bc00/0xfeec3c2dc5a4b255 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.878728:0:159636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341bc00/0xfeec3c2dc5a4b255 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.878740:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5300) 00010000:00010000:0.0:1784191888.878744:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191888.878748:0:159636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341bc00/0xfeec3c2dc5a4b255 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.878754:0:159636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341bc00/0xfeec3c2dc5a4b255 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.878868:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1784191888.878878:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:158665:x1870858827953280:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784191888.878965:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:158665:x1870858827953280:12345-0@lo:1000:mdt00_000.0 Request processed in 89us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.878972:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1784191888.879030:0:158665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:158665:1870858827953280:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1784191888.879075:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b263 lrc: 3/1,0 mode: --/PR res: [0x240002343:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879085:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b263 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879092:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b263 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191888.879112:0:158665:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b263 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879125:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b240 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879131:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b240 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879136:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b240 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879142:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b240 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879147:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191888.879151:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b240 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879157:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b240 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879166:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5300) 00010000:00010000:1.0:1784191888.879173:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191888.879177:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b240 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879184:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b240 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879197:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879203:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b247 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879209:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b247 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879214:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191888.879217:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b247 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879223:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b247 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879231:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9feaf7a7 (ffff8af207498f00) 00010000:00010000:1.0:1784191888.879233:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191888.879236:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b247 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879241:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e400/0xfeec3c2dc5a4b247 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879270:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b239 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b87d expref: 10 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879291:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b263 lrc: 3/0,0 mode: PR/PR res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b87d expref: 9 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.879298:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x9:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191888.879301:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784191888.879303:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8e00, rc 0) 00000100:00100000:1.0:1784191888.879347:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:123674:x1870858812363520:12345-192.168.204.16@tcp:101:rm.0 Request processed in 1822us (2500us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.879354:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 497 00010000:00010000:0.0:1784191888.882426:0:159636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b25c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2fef16ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.882461:0:159636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b25c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2fef16ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.882468:0:159636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b25c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2fef16ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.882473:0:159636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341aa00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191888.882478:0:159636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b25c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2fef16ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.882485:0:159636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b25c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2fef16ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.882501:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2fef16ea (ffff8af210dfe700) 00010000:00010000:0.0:1784191888.882505:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191888.882509:0:159636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b25c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2fef16ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.882515:0:159636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b25c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2fef16ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 159636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.882588:0:159636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b24e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b884 expref: 8 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.882599:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5300) 00010000:00010000:0.0:1784191888.882601:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784191888.882605:0:159636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b24e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b884 expref: 8 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.882636:0:159636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341a400, rc -2) 00000100:00100000:0.0:1784191888.882958:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69112:x1870858812363648:12345-192.168.204.16@tcp:63:ll_sa.0 Request processed in 4519us (5998us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784191888.882969:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 688 00000100:00100000:1.0:1784191888.885151:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.886960:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812363776 00000100:00100000:2.0:1784191888.886976:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812363776 00000100:00100000:2.0:1784191888.887051:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 498 00000100:00100000:2.0:1784191888.887063:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:123674:x1870858812363776:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191888.887273:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.887302:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b26a lrc: 2/0,0 mode: --/CR res: [0x240002343:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b88b expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.887368:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b271 lrc: 3/1,0 mode: --/PR res: [0x240002343:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.887381:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b271 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.887392:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b271 lrc: 3/1,0 mode: PR/PR res: [0x240002343:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191888.887495:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x9:0x0]: returning size 4096 00000004:00200000:2.0:1784191888.887501:0:164531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1784191888.887622:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b26a lrc: 0/0,0 mode: --/CR res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b88b expref: 34 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.887662:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b271 lrc: 3/0,0 mode: PR/PR res: [0x240002343:0x9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b88b expref: 33 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.887673:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x9:0x0].0x0 (ffff8af207498a00) 00010000:00010000:2.0:1784191888.887676:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784191888.887679:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ea00, rc 0) 00000100:00100000:2.0:1784191888.888021:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:123674:x1870858812363776:12345-192.168.204.16@tcp:101:rm.0 Request processed in 958us (2879us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.888029:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 498 00000100:00100000:0.0:1784191888.891296:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.891840:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812363904 00000100:00100000:1.0:1784191888.891852:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812363904 00000100:00100000:1.0:1784191888.891922:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 499 00000100:00100000:1.0:1784191888.891933:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:123674:x1870858812363904:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:1.0:1784191888.891957:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191888.891985:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b278 lrc: 2/0,0 mode: --/CR res: [0x240002340:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b892 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.893193:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b27f lrc: 3/1,0 mode: --/PR res: [0x240002340:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.893213:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b27f lrc: 3/1,0 mode: PR/PR res: [0x240002340:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.893225:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b27f lrc: 3/1,0 mode: PR/PR res: [0x240002340:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191888.893293:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002340:0xc:0x0]: returning size 4096 00000004:00200000:0.0:1784191888.893299:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1784191888.893354:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b278 lrc: 0/0,0 mode: --/CR res: [0x240002340:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b892 expref: 35 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.893376:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b27f lrc: 3/0,0 mode: PR/PR res: [0x240002340:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b892 expref: 34 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.893385:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xc:0x0].0x0 (ffff8af23d0d5a00) 00010000:00010000:0.0:1784191888.893388:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784191888.893391:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9200, rc 0) 00000100:00100000:0.0:1784191888.893464:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+34:123674:x1870858812363904:12345-192.168.204.16@tcp:101:rm.0 Request processed in 1532us (2175us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.893486:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 499 00000100:00100000:1.0:1784191888.896764:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.896955:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812364032 00000100:00100000:2.0:1784191888.896966:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812364032 00000100:00100000:2.0:1784191888.897024:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 500 00000100:00100000:2.0:1784191888.897035:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123674:x1870858812364032:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191888.897057:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.897080:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4b286 lrc: 2/0,0 mode: --/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b899 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.897144:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b28d lrc: 3/1,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.897158:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b28d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.897170:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b28d lrc: 3/1,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191888.897223:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab1:0xc:0x0]: returning size 4096 00000004:00200000:2.0:1784191888.897240:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1784191888.897281:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4b286 lrc: 0/0,0 mode: --/CR res: [0x200003ab1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b899 expref: 9 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.897300:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b28d lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b899 expref: 8 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.897308:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff8af207498b00) 00010000:00010000:2.0:1784191888.897311:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784191888.897314:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7fa00, rc 0) 00000100:00100000:2.0:1784191888.897375:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812364032:12345-192.168.204.16@tcp:101:rm.0 Request processed in 342us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.897382:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 500 00000100:00100000:1.0:1784191888.901742:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.902038:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812364288 00000100:00100000:2.0:1784191888.902049:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812364288 00000100:00100000:2.0:1784191888.902153:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 501 00000100:00100000:2.0:1784191888.902165:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+34:123674:x1870858812364288:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191888.902190:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.902215:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b294 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b8a0 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191888.902363:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x9:0x0]: returning size 4096 00010000:00010000:2.0:1784191888.902462:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b294 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8a0 expref: 36 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.902479:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af207498800) 00010000:00010000:2.0:1784191888.902482:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191888.902486:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b294 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8a0 expref: 36 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.902529:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f400, rc 0) 00000100:00100000:2.0:1784191888.902606:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:123674:x1870858812364288:12345-192.168.204.16@tcp:101:rm.0 Request processed in 443us (921us total) trans 25769803804 rc 301/301 00000100:00100000:2.0:1784191888.902624:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 501 00000100:00100000:3.0:1784191888.907015:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.907134:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812364416 00000100:00100000:2.0:1784191888.907145:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812364416 00000100:00100000:2.0:1784191888.907201:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 131 00000100:00100000:2.0:1784191888.907211:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:123674:x1870858812364416:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:2.0:1784191888.912591:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:123674:x1870858812364416:12345-192.168.204.16@tcp:37:rm.0 Request processed in 5366us (5570us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.912624:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 131 00000100:00100000:1.0:1784191888.917147:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.917237:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812364544 00000100:00100000:3.0:1784191888.917248:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812364544 00000100:00100000:3.0:1784191888.917326:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 132 00000100:00100000:3.0:1784191888.917336:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812364544:12345-192.168.204.16@tcp:37:rm.0 00000100:00100000:3.0:1784191888.921447:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123674:x1870858812364544:12345-192.168.204.16@tcp:37:rm.0 Request processed in 4102us (4302us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.921463:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 132 00000100:00100000:1.0:1784191888.925088:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.925182:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812364800 00000100:00100000:2.0:1784191888.925195:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812364800 00000100:00100000:2.0:1784191888.925259:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 133 00000100:00100000:2.0:1784191888.925270:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1099f6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:123674:x1870858812364800:12345-192.168.204.16@tcp:35:rm.0 00000100:00100000:2.0:1784191888.925500:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1099f6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:123674:x1870858812364800:12345-192.168.204.16@tcp:35:rm.0 Request processed in 231us (422us total) trans 25769803805 rc 0/0 00000100:00100000:2.0:1784191888.925508:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 133 00000100:00100000:1.0:1784191888.928813:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.928956:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812364928 00000100:00100000:3.0:1784191888.928967:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812364928 00000100:00100000:3.0:1784191888.929045:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 93 00000100:00100000:3.0:1784191888.929056:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:69112:x1870858812364928:12345-192.168.204.16@tcp:103:rm.0 00010000:00010000:3.0:1784191888.929076:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191888.929105:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b263 lrc: 0/0,0 mode: --/PR res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b87d expref: 8 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.929126:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x9:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191888.929137:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191888.929202:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69112:x1870858812364928:12345-192.168.204.16@tcp:103:rm.0 Request processed in 147us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.929210:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 93 00000100:00100000:0.0:1784191888.931460:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.931570:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812365184 00000100:00100000:2.0:1784191888.931581:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812365184 00000100:00100000:2.0:1784191888.931658:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 502 00000100:00100000:2.0:1784191888.931668:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:123674:x1870858812365184:12345-192.168.204.16@tcp:36:rm.0 00010000:00010000:2.0:1784191888.931802:0:158667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191888.931839:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b271 lrc: 0/0,0 mode: --/PR res: [0x240002343:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b88b expref: 36 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.931876:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x9:0x0].0x0 (ffff8af207498a00) 00010000:00010000:2.0:1784191888.931889:0:158667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784191888.931943:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4b2a2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.931952:0:158667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4b2a2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.931961:0:158667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4b2a2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.931984:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827953408:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1784191888.932038:0:158667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.932065:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db840 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.932279:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827953408 00000100:00100000:0.0:1784191888.932284:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827953408 00000100:00100000:0.0:1784191888.932327:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:0.0:1784191888.932335:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+23:158667:x1870858827953408:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1784191888.932350:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.932364:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b2a9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4b2a2 expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.932386:0:158671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4b232 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b876 expref: 6 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.932395:0:158671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b2a9 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2a2 expref: 24 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.932421:0:158671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4b232 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b876 expref: 6 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.932434:0:158671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4b232 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b876 expref: 6 pid: 158667 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.932444:0:158671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827953536:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191888.932513:0:158671:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233dd7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191888.936139:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.936283:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812365312 00000100:00100000:3.0:1784191888.936295:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812365312 00010000:00010000:3.0:1784191888.936342:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4b232 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b876 expref: 7 pid: 158667 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.936385:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 128 00000100:00100000:3.0:1784191888.936397:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69110:x1870858812365312:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191888.936412:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191888.936435:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4b232 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b876 expref: 7 pid: 158667 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.936452:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4b232 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b876 expref: 7 pid: 158667 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.936476:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5300) 00010000:00010000:3.0:1784191888.936483:0:158652:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b2a9 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2a2 expref: 24 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.936494:0:158652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b2a9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2a2 expref: 24 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.936502:0:158652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b2a9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2a2 expref: 24 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.936551:0:158652:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b2a9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2a2 expref: 24 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.936566:0:158652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:158652:1870858827953664:0@lo:105: 00000100:00100000:3.0:1784191888.936627:0:158652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191888.936683:0:158652:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.937126:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827953664 00000100:00100000:2.0:1784191888.937134:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827953664 00000100:00100000:2.0:1784191888.937172:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784191888.937179:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158652:x1870858827953664:12345-0@lo:105: 00010000:00010000:2.0:1784191888.937191:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4b2a2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b2a9 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.937202:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4b2a2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b2a9 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.937211:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4b2a2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b2a9 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.937218:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4b2a2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4b2a9 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.937233:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4b2a2 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4b2a9 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.937242:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4b2a2 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4b2a9 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.937257:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af20cd7f400) 00000100:00100000:2.0:1784191888.937301:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:158652:x1870858827953664:12345-0@lo:105: Request processed in 121us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.937309:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784191888.937390:0:158652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf24e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:158652:1870858827953664:0@lo:105: 00010000:00010000:1.0:1784191888.937420:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191888.937475:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69110:x1870858812365312:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1079us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.937483:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 128 00010000:00010000:0.0:1784191888.937709:0:158671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4b232 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b876 expref: 6 pid: 158667 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.937740:0:158671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:158671:1870858827953536:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191888.937762:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b2a9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2a2 expref: 24 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.937771:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5300) 00010000:00010000:0.0:1784191888.937774:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191888.937777:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341aa00, rc 0) 00000100:00100000:0.0:1784191888.937838:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+24:158667:x1870858827953408:12345-0@lo:101:mdt00_002.0 Request processed in 5504us (5799us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.937846:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1784191888.937974:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827953408:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1784191888.937990:0:158667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4b2a2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b2a9 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191888.938015:0:158667:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784191888.938057:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b2b0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.938065:0:158667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b2b0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.938075:0:158667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b2b0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.938107:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827953792:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1784191888.938144:0:158667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.938173:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f82f840 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.938758:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827953792 00000100:00100000:0.0:1784191888.938766:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827953792 00000100:00100000:0.0:1784191888.938825:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1784191888.938834:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+24:158667:x1870858827953792:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1784191888.938853:0:158670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.938873:0:158670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341bc00/0xfeec3c2dc5a4b2b7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4b2b0 expref: -99 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.938899:0:158670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341bc00/0xfeec3c2dc5a4b2b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2b0 expref: 25 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.938913:0:158670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341bc00/0xfeec3c2dc5a4b2b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2b0 expref: 25 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.938921:0:158670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9feaf7a7 (ffff8af210dfe700) 00010000:00010000:0.0:1784191888.938933:0:158670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191888.938937:0:158670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341bc00, rc 0) 00000100:00100000:0.0:1784191888.938980:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+25:158667:x1870858827953792:12345-0@lo:101:mdt00_002.0 Request processed in 147us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.938986:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:1.0:1784191888.939366:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827953792:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1784191888.939384:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b2b0 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b2b7 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.939394:0:158667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b2b0 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b2b7 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191888.939426:0:158667:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1784191888.939467:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827953920:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1784191888.939504:0:158667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.939540:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f82fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.939670:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827953920 00000100:00100000:2.0:1784191888.939676:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827953920 00000100:00100000:2.0:1784191888.939746:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:2.0:1784191888.939756:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:158667:x1870858827953920:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784191888.939840:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:158667:x1870858827953920:12345-0@lo:1000:mdt00_002.0 Request processed in 86us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.939848:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1784191888.939999:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827953920:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1784191888.940046:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827954048:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1784191888.940071:0:158667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.940109:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f82fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191888.940223:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827954048 00000100:00100000:0.0:1784191888.940228:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827954048 00000100:00100000:0.0:1784191888.940263:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1784191888.940270:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+25:158667:x1870858827954048:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784191888.940352:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+25:158667:x1870858827954048:12345-0@lo:1000:mdt00_002.0 Request processed in 82us (280us total) trans 0 rc 1/1 00000100:00100000:0.0:1784191888.940359:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1784191888.940483:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827954048:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1784191888.940548:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8a00/0xfeec3c2dc5a4b2be lrc: 3/0,1 mode: --/EX res: [0x240002343:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.940558:0:158667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8a00/0xfeec3c2dc5a4b2be lrc: 3/0,1 mode: --/EX res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.940567:0:158667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8a00/0xfeec3c2dc5a4b2be lrc: 3/0,1 mode: --/EX res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.940579:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827954176:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1784191888.940604:0:158667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.940637:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f82f840 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.940769:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827954176 00000100:00100000:2.0:1784191888.940773:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827954176 00000100:00100000:2.0:1784191888.940811:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:2.0:1784191888.940818:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:158667:x1870858827954176:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1784191888.940828:0:159636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.940844:0:159636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b2c5 lrc: 2/0,0 mode: --/EX res: [0x240002343:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4b2be expref: -99 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.940867:0:159636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b2c5 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2be expref: 26 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.940893:0:159636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b2c5 lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2be expref: 26 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.940902:0:159636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x9:0x0].0x0 (ffff8af207498d00) 00010000:00010000:2.0:1784191888.940904:0:159636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191888.940908:0:159636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7fc00, rc 0) 00000100:00100000:2.0:1784191888.940937:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+26:158667:x1870858827954176:12345-0@lo:101:mdt00_002.0 Request processed in 119us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.940942:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1784191888.941187:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827954176:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1784191888.941200:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8a00/0xfeec3c2dc5a4b2be lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b2c5 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.941208:0:158667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8a00/0xfeec3c2dc5a4b2be lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b2c5 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.941240:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b2cc lrc: 3/0,1 mode: --/EX res: [0x240002343:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.941249:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b2cc lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.941257:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b2cc lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.941362:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b2d3 lrc: 3/0,1 mode: --/EX res: [0x240002340:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.941376:0:158667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b27f lrc: 2/0,0 mode: PR/PR res: [0x240002340:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b892 expref: 35 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.941384:0:158667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b2d3 lrc: 4/0,1 mode: --/EX res: [0x240002340:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.941407:0:158667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b27f lrc: 3/0,0 mode: PR/PR res: [0x240002340:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b892 expref: 35 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.941422:0:158667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b27f lrc: 4/0,0 mode: PR/PR res: [0x240002340:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b892 expref: 35 pid: 158667 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.941433:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:158667:1870858827954304:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191888.941520:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f82f840 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.946584:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:158667:1870858827954304:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191888.946624:0:158667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b2d3 lrc: 3/0,1 mode: --/EX res: [0x240002340:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.948531:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191888.948796:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812365440 00000100:00100000:1.0:1784191888.948806:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812365440 00010000:00010000:1.0:1784191888.948853:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b27f lrc: 4/0,0 mode: PR/PR res: [0x240002340:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b892 expref: 36 pid: 158667 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.948919:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 129 00000100:00100000:1.0:1784191888.948928:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af202d70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:69110:x1870858812365440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.948946:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.948953:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b27f lrc: 4/0,0 mode: PR/PR res: [0x240002340:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b892 expref: 36 pid: 158667 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.948967:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b27f lrc: 3/0,0 mode: PR/PR res: [0x240002340:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b892 expref: 36 pid: 158667 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.948993:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b27f lrc: 0/0,0 mode: --/PR res: [0x240002340:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b892 expref: 36 pid: 158667 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.949015:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xc:0x0].0x0 (ffff8af23d0d5a00) 00010000:00010000:1.0:1784191888.949020:0:158651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b2d3 lrc: 3/0,1 mode: --/EX res: [0x240002340:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.949029:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b2d3 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.949037:0:158651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b2d3 lrc: 4/0,1 mode: EX/EX res: [0x240002340:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.949066:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191888.949311:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af202d70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:69110:x1870858812365440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 381us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.949319:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 129 00010000:00010000:2.0:1784191888.949746:0:158667:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b2d3 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.949757:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b2d3 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.949820:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.949828:0:158667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.949838:0:158667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 3/0,1 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191888.949873:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827954432:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1784191888.949919:0:158667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191888.949951:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2dbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784191888.950106:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827954432 00000100:00100000:3.0:1784191888.950112:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827954432 00000100:00100000:3.0:1784191888.950153:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:3.0:1784191888.950160:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+26:158667:x1870858827954432:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1784191888.950177:0:161739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191888.950193:0:161739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b2e1 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4b2da expref: -99 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.950224:0:161739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b28d lrc: 2/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b899 expref: 5 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.950234:0:161739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b2e1 lrc: 4/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2da expref: 27 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.950257:0:161739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b28d lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b899 expref: 5 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.950271:0:161739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b28d lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b899 expref: 5 pid: 158665 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191888.950282:0:161739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4efb80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827954560:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191888.950333:0:161739:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.955143:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191888.955293:0:161739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4efb80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:161739:1870858827954560:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191888.955338:0:161739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b2e1 lrc: 3/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2da expref: 27 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.955351:0:161739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff8af207498b00) 00010000:00010000:3.0:1784191888.955354:0:161739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784191888.955358:0:161739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b2e1 lrc: 3/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2da expref: 27 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.955367:0:161739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b2e1 lrc: 3/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2da expref: 27 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191888.955395:0:161739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3e00, rc 0) 00000100:00100000:3.0:1784191888.955466:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+27:158667:x1870858827954432:12345-0@lo:101:mdt00_002.0 Request processed in 5306us (5545us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191888.955476:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:2.0:1784191888.955583:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827954432:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1784191888.955603:0:158667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b2e1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.955624:0:158667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 4/0,1 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b2e1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.955808:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812365568 00000100:00100000:0.0:1784191888.955819:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812365568 00010000:00010000:0.0:1784191888.955857:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b28d lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b899 expref: 6 pid: 158665 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.955891:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 130 00000100:00100000:0.0:1784191888.955899:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812365568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191888.955917:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191888.955923:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b28d lrc: 4/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b899 expref: 6 pid: 158665 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.955936:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b28d lrc: 3/0,0 mode: PR/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b899 expref: 6 pid: 158665 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.955956:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b28d lrc: 0/0,0 mode: --/PR res: [0x200003ab1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b899 expref: 6 pid: 158665 timeout: 5609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.955983:0:160189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff8af207498b00) 00010000:00010000:0.0:1784191888.955989:0:160189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b2e1 lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2da expref: 26 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.955998:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b2e1 lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2da expref: 26 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.956007:0:160189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b2e1 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2da expref: 26 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.956041:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b2e1 lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2da expref: 26 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.956055:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:160189:1870858827954688:0@lo:105: 00000100:00100000:0.0:1784191888.956095:0:160189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.956140:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233dd7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.956195:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827954688 00000100:00100000:2.0:1784191888.956199:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827954688 00000100:00100000:2.0:1784191888.956237:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784191888.956245:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:160189:x1870858827954688:12345-0@lo:105: 00010000:00010000:2.0:1784191888.956254:0:158648:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 5/0,1 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b2e1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.956264:0:158648:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 5/0,1 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b2e1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.956273:0:158648:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 5/0,1 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b2e1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.956281:0:158648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 5/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4b2e1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.956299:0:158648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 6/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfeec3c2dc5a4b2e1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.956307:0:158648:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 6/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfeec3c2dc5a4b2e1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.956334:0:158648:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8af20cd7ea00) 00000100:00100000:2.0:1784191888.956368:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:160189:x1870858827954688:12345-0@lo:105: Request processed in 124us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.956374:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784191888.957021:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:160189:1870858827954688:0@lo:105: 00010000:00010000:0.0:1784191888.957037:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191888.957100:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812365568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1190us (1962us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.957108:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 130 00010000:00010000:0.0:1784191888.957135:0:158667:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b2e1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.957144:0:158667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b2e1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191888.959308:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827954816:0@lo:403:mdt00_002.0 00000100:00100000:0.0:1784191888.959394:0:158667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.959423:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233dd7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.959884:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827954816 00000100:00100000:2.0:1784191888.959894:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827954816 00000100:00100000:2.0:1784191888.959946:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:2.0:1784191888.959954:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+27:158667:x1870858827954816:12345-0@lo:403:mdt00_002.0 00000100:00100000:2.0:1784191888.964246:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+27:158667:x1870858827954816:12345-0@lo:403:mdt00_002.0 Request processed in 4282us (4841us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191888.964263:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1784191888.964876:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:158667:1870858827954816:0@lo:403:mdt00_002.0 00000040:00080000:1.0:1784191888.968019:0:158667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002b10:0x2:0x0].10, 944 off42208 00000040:00080000:1.0:1784191888.968227:0:158667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200003ab4:0x2:0x0].10, 1024 off43008 00000004:00080000:1.0:1784191888.968233:0:158667:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af10f82fa80 with version 17 00000004:00080000:3.0:1784191888.968340:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 17 rpc_version 17 00000020:00100000:3.0:1784191888.968379:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784191888.968392:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af10f4efb80 x1870858827955072/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191888.968418:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4efb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827955072:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784191888.968496:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191888.968675:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784191888.968970:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827955072 00000100:00100000:2.0:1784191888.968979:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827955072 00000100:00100000:2.0:1784191888.969074:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:2.0:1784191888.969085:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+27:165486:x1870858827955072:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784191888.969475:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+28:165486:x1870858827955072:12345-0@lo:1000:osp_up0-1.0 Request processed in 389us (976us total) trans 34359738649 rc 0/0 00000100:00100000:2.0:1784191888.969484:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:0.0:1784191888.969597:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4efb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827955072:0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1784191888.969678:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002343:0x9:0x0]: returning size 4096 00010000:00010000:1.0:1784191888.969732:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b2d3 lrc: 3/0,1 mode: EX/EX res: [0x240002340:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.969743:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b2d3 lrc: 2/0,0 mode: EX/EX res: [0x240002340:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.969753:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b2d3 lrc: 3/0,0 mode: EX/EX res: [0x240002340:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.969760:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191888.969764:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b2d3 lrc: 3/0,0 mode: EX/EX res: [0x240002340:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.969772:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b2d3 lrc: 4/0,0 mode: EX/EX res: [0x240002340:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.969800:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002340:0xc:0x0].0x0 (ffff8af23d0d5a00) 00010000:00010000:1.0:1784191888.969804:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784191888.969810:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b2d3 lrc: 2/0,0 mode: --/EX res: [0x240002340:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.969816:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b2d3 lrc: 0/0,0 mode: --/EX res: [0x240002340:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.969836:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b2e1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.969844:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 4/0,1 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b2e1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.969864:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b2e1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.969883:0:158667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1784191888.969893:0:158667:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200003ab1:0xc:0x0] 00010000:00010000:1.0:1784191888.969902:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b2cc lrc: 3/0,1 mode: EX/EX res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.969909:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b2cc lrc: 2/0,0 mode: EX/EX res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.969913:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b2cc lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.969919:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191888.969922:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b2cc lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.969927:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b2cc lrc: 4/0,0 mode: EX/EX res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.969936:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x9:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191888.969938:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191888.969941:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b2cc lrc: 2/0,0 mode: --/EX res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.969946:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b2cc lrc: 0/0,0 mode: --/EX res: [0x240002343:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.969960:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8a00/0xfeec3c2dc5a4b2be lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b2c5 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.969974:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8a00/0xfeec3c2dc5a4b2be lrc: 4/0,1 mode: EX/EX res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b2c5 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.969980:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8a00/0xfeec3c2dc5a4b2be lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b2c5 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970001:0:158667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1784191888.970011:0:158667:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784191888.970016:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4b2a2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4b2a9 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970022:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4b2a2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b2a9 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970028:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4b2a2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4b2a9 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970040:0:158667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:1.0:1784191888.970044:0:158667:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784191888.970053:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784191888.970059:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 2/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4b2e1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970066:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ea00 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:1.0:1784191888.970070:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4b2e1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191888.970088:0:160901:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 3/0,0 mode: EX/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4b2e1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970119:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 2/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b2e1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970125:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191888.970154:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 1/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b2e1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970162:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b2da lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b2e1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970178:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784191888.970181:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8a00/0xfeec3c2dc5a4b2be lrc: 2/0,0 mode: EX/EX res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4b2c5 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970186:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8a00 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:1.0:1784191888.970190:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8a00/0xfeec3c2dc5a4b2be lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4b2c5 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191888.970196:0:160901:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8a00/0xfeec3c2dc5a4b2be lrc: 3/0,0 mode: EX/EX res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4b2c5 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970212:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8a00/0xfeec3c2dc5a4b2be lrc: 2/0,0 mode: --/EX res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b2c5 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970218:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191888.970231:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8a00/0xfeec3c2dc5a4b2be lrc: 1/0,0 mode: --/EX res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b2c5 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970238:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8a00/0xfeec3c2dc5a4b2be lrc: 0/0,0 mode: --/EX res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b2c5 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970251:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191888.970254:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4b2a2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4b2a9 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970259:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f400 already unused, calling callback (ffffffffc19a1ed0) 00010000:00010000:1.0:1784191888.970263:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4b2a2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4b2a9 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191888.970269:0:160901:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4b2a2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4b2a9 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970285:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4b2a2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b2a9 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970291:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191888.970307:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4b2a2 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b2a9 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970315:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f400/0xfeec3c2dc5a4b2a2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b2a9 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970328:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191888.970330:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191888.970332:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191888.970346:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784191888.970362:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827955456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191888.970411:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.970451:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827955456 00000100:00100000:1.0:1784191888.970456:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827955456 00000100:00100000:1.0:1784191888.970494:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784191888.970501:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+28:106502:x1870858827955456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.970514:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.970533:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b2a9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2a2 expref: 28 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970547:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5300) 00010000:00010000:1.0:1784191888.970553:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191888.970585:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+27:106502:x1870858827955456:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.970591:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784191888.970633:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827955456:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.970655:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b2b0 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b2b7 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.970664:0:158667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b2b0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4b2b7 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191888.970755:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:123674:x1870858812365184:12345-192.168.204.16@tcp:36:rm.0 Request processed in 39087us (39304us total) trans 25769803806 rc 0/0 00000100:00100000:1.0:1784191888.970763:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 502 00010000:00010000:0.0:1784191888.971081:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191888.974798:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191888.975113:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827955328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191888.975199:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191888.975245:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784191888.975252:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827955200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191888.975273:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191888.975436:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827955328 00000100:00100000:1.0:1784191888.975455:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827955328 00000100:00100000:1.0:1784191888.975510:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827955200 00000100:00100000:1.0:1784191888.975513:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827955200 00000100:00100000:1.0:1784191888.975552:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784191888.975561:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+28:106500:x1870858827955328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.975577:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.975606:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b2c5 lrc: 0/0,0 mode: --/EX res: [0x240002343:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2be expref: 28 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.975639:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002343:0x9:0x0].0x0 (ffff8af207498d00) 00010000:00010000:1.0:1784191888.975654:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191888.975711:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+27:106500:x1870858827955328:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.975718:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784191888.975738:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784191888.975744:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+26:106500:x1870858827955200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.975752:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191888.975764:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b2e1 lrc: 0/0,0 mode: --/EX res: [0x200003ab1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2da expref: 26 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191888.975774:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab1:0xc:0x0].0x0 (ffff8af207498b00) 00000100:00100000:0.0:1784191888.975961:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827955328:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191888.976008:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191888.976047:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+25:106500:x1870858827955200:12345-0@lo:103:ldlm_bl.0 Request processed in 303us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191888.976055:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784191888.976128:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827955200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784191888.991416:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191888.991525:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812365696 00000100:00100000:0.0:1784191888.991548:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812365696 00000100:00100000:0.0:1784191888.991627:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 503 00000100:00100000:0.0:1784191888.991639:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:123683:x1870858812365696:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1784191888.991664:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191888.991729:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b2e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b8a7 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.991822:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b2ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.991838:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b2ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.991868:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b2ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191888.991934:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784191888.991938:0:158666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784191888.991961:0:158666:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b2ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.991986:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b2e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8a7 expref: 7 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.992008:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b2ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8a7 expref: 6 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191888.992016:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af210dfe000) 00010000:00010000:0.0:1784191888.992019:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784191888.992023:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341ba00, rc 0) 00000100:00100000:0.0:1784191888.992085:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123683:x1870858812365696:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 448us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191888.992092:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 503 00000100:00100000:1.0:1784191888.998525:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191888.998642:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812365824 00000100:00100000:2.0:1784191888.998666:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812365824 00000100:00100000:2.0:1784191888.998757:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 504 00000100:00100000:2.0:1784191888.998767:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123683:x1870858812365824:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1784191888.998800:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191888.998822:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b2f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b8ae expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.998886:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b2fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.998900:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b2fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.998911:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b2fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.998926:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b304 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.998932:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.998938:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.998983:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b2fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.998991:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b2fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.998998:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b2fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.999011:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b2fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.999018:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ee00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191888.999022:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b2fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.999030:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b2fd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.999043:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af210dfe000) 00010000:00010000:2.0:1784191888.999047:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191888.999051:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b2fd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.999057:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b2fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.999070:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.999075:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b304 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.999081:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b304 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.999086:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7fc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191888.999089:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b304 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.999106:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b304 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.999113:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4632c348 (ffff8af207498c00) 00010000:00010000:2.0:1784191888.999116:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191888.999118:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b304 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.999125:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b304 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.999158:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b2f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8ae expref: 7 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.999167:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af210dfe000) 00010000:00010000:2.0:1784191888.999170:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191888.999173:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b2f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8ae expref: 7 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191888.999181:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ec00, rc 0) 00000100:00100000:2.0:1784191888.999237:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123683:x1870858812365824:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 471us (721us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191888.999245:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 504 00000100:00100000:1.0:1784191889.005125:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191889.005343:0:158674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812365952 00000100:00100000:3.0:1784191889.005357:0:158674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812365952 00000100:00100000:3.0:1784191889.005439:0:158674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7 00000100:00100000:3.0:1784191889.005449:0:158674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123683:x1870858812365952:12345-192.168.204.16@tcp:700:lfs.0 00000100:00100000:3.0:1784191889.005544:0:158674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123683:x1870858812365952:12345-192.168.204.16@tcp:700:lfs.0 Request processed in 96us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191889.005553:0:158674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7 00000100:00080000:0.0:1784191889.005628:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784191889.008063:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191889.008260:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812366208 00000100:00100000:1.0:1784191889.008288:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812366208 00000100:00100000:1.0:1784191889.008526:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 505 00000100:00100000:1.0:1784191889.008549:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:123683:x1870858812366208:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:1.0:1784191889.008620:0:158667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191889.008651:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b2ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8a7 expref: 6 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.008674:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af210dfe000) 00010000:00010000:1.0:1784191889.008684:0:158667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784191889.008813:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b30b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.008827:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b30b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.008837:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b30b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.008849:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b312 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4632c348 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.008856:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b312 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.008861:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b312 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:1.0:1784191889.009646:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 258 < left 278, rollback = 2 00080000:00000400:1.0:1784191889.009653:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191889.009656:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191889.009659:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191889.009666:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/2, delete: 0/0/0 00080000:00000400:1.0:1784191889.009669:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191889.009714:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 258 < left 278, rollback = 2 00080000:00000400:1.0:1784191889.009717:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191889.009719:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191889.009721:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191889.009722:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/2, delete: 0/0/0 00080000:00000400:1.0:1784191889.009724:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191889.009755:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 258 < left 278, rollback = 2 00080000:00000400:1.0:1784191889.009758:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191889.009760:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191889.009762:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191889.009763:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/2, delete: 0/0/0 00080000:00000400:1.0:1784191889.009765:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191889.010056:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b319 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.010070:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b319 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.010080:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b319 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191889.010094:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb44080d reply state 000000007fdf852a transno 34359738650 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b319 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.010104:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b319 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.010110:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191889.010113:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191889.010116:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784191889.010124:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab5:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1784191889.010139:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b30b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.010146:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b30b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.010152:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b30b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.010157:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b30b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.010162:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191889.010166:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b30b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.010173:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b30b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.010183:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af23d0d5300) 00010000:00010000:1.0:1784191889.010185:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191889.010189:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b30b lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.010195:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b30b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191889.010210:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb44080d reply state 000000007fdf852a transno 34359738650 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b312 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.010218:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b312 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.010235:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4632c348 (ffff8af23d0d5b00) 00010000:00010000:1.0:1784191889.010237:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191889.010239:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1784191889.010381:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123683:x1870858812366208:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 1843us (2324us total) trans 34359738650 rc 0/0 00000100:00100000:1.0:1784191889.010389:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 505 00000100:00100000:2.0:1784191889.063548:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191889.063920:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812366336 00000100:00100000:3.0:1784191889.063932:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812366336 00000100:00100000:3.0:1784191889.064001:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 506 00000100:00100000:3.0:1784191889.064011:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123531:x1870858812366336:12345-192.168.204.16@tcp:101:bash.0 00010000:00010000:3.0:1784191889.064035:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191889.064061:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b320 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b8b5 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.064155:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4b327 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.064172:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4b327 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.064198:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4b327 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191889.064248:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784191889.064251:0:161504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784191889.064274:0:161504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4b327 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.064299:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b320 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8b5 expref: 9 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.064318:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4b327 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8b5 expref: 8 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.064327:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af110071a00) 00010000:00010000:3.0:1784191889.064330:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784191889.064334:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3800, rc 0) 00000100:00100000:3.0:1784191889.064395:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123531:x1870858812366336:12345-192.168.204.16@tcp:101:bash.0 Request processed in 386us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191889.064402:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 506 00000100:00100000:3.0:1784191889.068772:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191889.068922:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812366464 00000100:00100000:1.0:1784191889.068934:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812366464 00000100:00100000:1.0:1784191889.068998:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 507 00000100:00100000:1.0:1784191889.069009:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123531:x1870858812366464:12345-192.168.204.16@tcp:101:bash.0 00010000:00010000:1.0:1784191889.069033:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191889.069056:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b32e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b8bc expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069144:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b335 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069372:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b335 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069386:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b335 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069403:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b33c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069411:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b33c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069437:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b33c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069500:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4b343 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069507:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4b343 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069513:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4b343 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191889.069548:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784191889.069553:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784191889.069573:0:158665:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4b343 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069586:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b335 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069593:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b335 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069599:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b335 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069616:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b335 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069623:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191889.069627:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b335 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069641:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b335 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069655:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af110071a00) 00010000:00010000:1.0:1784191889.069658:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191889.069662:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b335 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069669:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b335 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069683:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b33c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069731:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b33c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069738:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b33c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069743:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191889.069746:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b33c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069753:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b33c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.069760:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8af23d0d5300) 00010000:00010000:1.0:1784191889.069763:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191889.069765:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b33c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.070161:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b33c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.070205:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b32e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8bc expref: 10 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.070220:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4b343 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8bc expref: 9 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.070229:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8af23d0d5a00) 00010000:00010000:1.0:1784191889.070231:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784191889.070234:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9400, rc 0) 00000100:00100000:1.0:1784191889.070361:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:123531:x1870858812366464:12345-192.168.204.16@tcp:101:bash.0 Request processed in 1352us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191889.070369:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 507 00000100:00100000:0.0:1784191889.074824:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191889.077525:0:158676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812366592 00000100:00100000:1.0:1784191889.077541:0:158676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812366592 00000100:00100000:1.0:1784191889.077628:0:158676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19 00000100:00100000:1.0:1784191889.077638:0:158676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:123531:x1870858812366592:12345-192.168.204.16@tcp:900:bash.0 00000100:00100000:1.0:1784191889.077773:0:158676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:123531:x1870858812366592:12345-192.168.204.16@tcp:900:bash.0 Request processed in 136us (2959us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191889.077781:0:158676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19 00000100:00100000:2.0:1784191889.081502:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191889.081793:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812366720 00000100:00100000:1.0:1784191889.081804:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812366720 00000100:00100000:1.0:1784191889.081869:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 508 00000100:00100000:1.0:1784191889.081880:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:123531:x1870858812366720:12345-192.168.204.16@tcp:101:bash.0 00010000:00010000:1.0:1784191889.081918:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191889.081939:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b34a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b8c3 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082010:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b351 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082024:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b351 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082037:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b351 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082052:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b358 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082059:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b358 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082066:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b358 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082130:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4b35f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082139:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4b35f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082145:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4b35f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191889.082180:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1784191889.082190:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784191889.082212:0:158667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4b35f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082224:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b351 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082231:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b351 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082237:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b351 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082244:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b351 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082251:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191889.082254:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b351 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082262:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b351 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082274:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8af23d0d5a00) 00010000:00010000:1.0:1784191889.082278:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191889.082282:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b351 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082290:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b351 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082304:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b358 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082320:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b358 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082325:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b358 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082329:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191889.082332:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b358 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082337:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b358 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082345:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0xf20aa046 (ffff8af23d0d5300) 00010000:00010000:1.0:1784191889.082347:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191889.082349:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b358 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082354:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b358 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082385:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b34a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8c3 expref: 11 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082399:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4b35f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8c3 expref: 10 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.082407:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff8af23d0d5200) 00010000:00010000:1.0:1784191889.082409:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784191889.082417:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5200, rc 0) 00000100:00100000:1.0:1784191889.082488:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+10:123531:x1870858812366720:12345-192.168.204.16@tcp:101:bash.0 Request processed in 609us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191889.082495:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 508 00000100:00100000:1.0:1784191889.086474:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.086649:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812366976 00000100:00100000:2.0:1784191889.086659:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812366976 00000100:00100000:2.0:1784191889.086945:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 509 00000100:00100000:2.0:1784191889.086973:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+10:123531:x1870858812366976:12345-192.168.204.16@tcp:101:bash.0 00010000:00010000:2.0:1784191889.086999:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191889.087022:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b366 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b8ca expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087104:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b36d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087118:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b36d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087130:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b36d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087145:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b374 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087152:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b374 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087158:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b374 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191889.087254:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784191889.087337:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b36d lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087344:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b36d lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087365:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b36d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087383:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b36d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087389:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191889.087392:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b36d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087400:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b36d lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087413:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff8af23d0d5200) 00010000:00010000:2.0:1784191889.087416:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.087420:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b36d lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087426:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b36d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087440:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b374 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087446:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b374 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087452:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b374 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087456:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ea00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191889.087459:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b374 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087474:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b374 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087483:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0xaaab9583 (ffff8af207498c00) 00010000:00010000:2.0:1784191889.087485:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.087488:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b374 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087494:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b374 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087546:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b366 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8ca expref: 12 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087558:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff8af23d0d5200) 00010000:00010000:2.0:1784191889.087561:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191889.087565:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b366 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8ca expref: 12 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.087574:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ee00, rc 0) 00000100:00100000:2.0:1784191889.087653:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:123531:x1870858812366976:12345-192.168.204.16@tcp:101:bash.0 Request processed in 683us (1190us total) trans 34359738651 rc 301/301 00000100:00100000:2.0:1784191889.087661:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 509 00000100:00100000:0.0:1784191889.093293:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191889.093869:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812367104 00000100:00100000:1.0:1784191889.093880:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812367104 00000100:00100000:1.0:1784191889.093992:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 510 00000100:00100000:1.0:1784191889.094003:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:123531:x1870858812367104:12345-192.168.204.16@tcp:101:bash.0 00010000:00010000:1.0:1784191889.094031:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191889.094055:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4b382 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b8d1 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.094157:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4b389 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.094172:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4b389 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.094184:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4b389 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191889.094211:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784191889.094215:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784191889.094237:0:158665:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4b389 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.094270:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4b382 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8d1 expref: 13 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.094312:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4b389 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8d1 expref: 12 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.094327:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8af23d0d5300) 00010000:00010000:1.0:1784191889.094330:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784191889.094333:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5a00, rc 0) 00000100:00100000:1.0:1784191889.094400:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:123531:x1870858812367104:12345-192.168.204.16@tcp:101:bash.0 Request processed in 399us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191889.094407:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 510 00000100:00100000:1.0:1784191889.099400:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.099483:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812367232 00000100:00100000:2.0:1784191889.099493:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812367232 00000100:00100000:2.0:1784191889.099565:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 134 00000100:00100000:2.0:1784191889.099575:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:123531:x1870858812367232:12345-192.168.204.16@tcp:37:bash.0 00000100:00100000:2.0:1784191889.105507:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:123531:x1870858812367232:12345-192.168.204.16@tcp:37:bash.0 Request processed in 5921us (6104us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191889.105522:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 134 00000100:00100000:0.0:1784191889.109574:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191889.109679:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812367488 00000100:00100000:3.0:1784191889.109742:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812367488 00000100:00100000:3.0:1784191889.109809:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 135 00000100:00100000:3.0:1784191889.109821:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:123531:x1870858812367488:12345-192.168.204.16@tcp:35:bash.0 00000100:00100000:3.0:1784191889.110095:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:123531:x1870858812367488:12345-192.168.204.16@tcp:35:bash.0 Request processed in 274us (528us total) trans 34359738652 rc 0/0 00000100:00100000:3.0:1784191889.110103:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 135 00000100:00100000:1.0:1784191889.120429:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191889.120763:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812367616 00000100:00100000:3.0:1784191889.120773:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812367616 00000100:00100000:3.0:1784191889.120855:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 511 00000100:00100000:3.0:1784191889.120866:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:123686:x1870858812367616:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:3.0:1784191889.120892:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191889.120914:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b390 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b8d8 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121251:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b397 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121267:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b397 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121279:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b397 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121296:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b39e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121303:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b39e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121310:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b39e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121391:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b3a5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121400:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121408:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191889.121446:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784191889.121449:0:161504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784191889.121472:0:161504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121485:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b397 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121491:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b397 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121497:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b397 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121503:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b397 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121509:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af110db3e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191889.121512:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b397 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121520:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b397 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121622:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff8af23d0d5200) 00010000:00010000:3.0:1784191889.121625:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191889.121631:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b397 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121637:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b397 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121651:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b39e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121657:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b39e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121662:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b39e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121667:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af110db2200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191889.121669:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b39e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121675:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b39e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121681:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0xaaab9583 (ffff8af110071100) 00010000:00010000:3.0:1784191889.121683:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191889.121685:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b39e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121888:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b39e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121935:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b390 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8d8 expref: 15 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121947:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b3a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8d8 expref: 14 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.121955:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8af23d0d5300) 00010000:00010000:3.0:1784191889.121957:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784191889.121960:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3600, rc 0) 00000100:00100000:2.0:1784191889.122424:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:123686:x1870858812367616:12345-192.168.204.16@tcp:101:rm.0 Request processed in 1556us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191889.122434:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 511 00000100:00100000:0.0:1784191889.126746:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191889.126952:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812367872 00000100:00100000:3.0:1784191889.126963:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812367872 00000100:00100000:3.0:1784191889.127034:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 97 00000100:00100000:3.0:1784191889.127044:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:69112:x1870858812367872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191889.127060:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191889.127085:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b3a5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8d8 expref: 14 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.127117:0:158650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8af23d0d5300) 00010000:00010000:3.0:1784191889.127122:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191889.127182:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:69112:x1870858812367872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 139us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191889.127190:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 97 00000100:00100000:0.0:1784191889.130236:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.132388:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812367744 00000100:00100000:2.0:1784191889.132403:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812367744 00000100:00100000:2.0:1784191889.132464:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 512 00000100:00100000:2.0:1784191889.132476:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:123686:x1870858812367744:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:2.0:1784191889.132499:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191889.132520:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b3ac lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b8df expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.132596:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3b3 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.132622:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3b3 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.132634:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3b3 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.132649:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3ba lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0xa12f67b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.132657:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.132684:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.132749:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3b3 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.132757:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3b3 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.132764:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3b3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.132771:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3b3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.133019:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ea00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191889.133024:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3b3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.133033:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3b3 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.133045:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8af23d0d5300) 00010000:00010000:2.0:1784191889.133048:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.133053:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3b3 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.133059:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3b3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.133130:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3ba lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.133142:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3ba lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.133148:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3ba lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.133154:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191889.133156:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3ba lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.133163:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3ba lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.133172:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0xa12f67b5 (ffff8af207498c00) 00010000:00010000:2.0:1784191889.133175:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.133178:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3ba lrc: 2/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.133184:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3ba lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.133220:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b3ac lrc: 1/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8df expref: 14 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.133230:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8af23d0d5300) 00010000:00010000:2.0:1784191889.133232:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.133235:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b3ac lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8df expref: 14 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.133255:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ee00, rc 0) 00000100:00100000:2.0:1784191889.133521:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:123686:x1870858812367744:12345-192.168.204.16@tcp:101:rm.0 Request processed in 1046us (3295us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191889.133539:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 512 00000100:00100000:1.0:1784191889.152567:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.152677:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812368128 00000100:00100000:2.0:1784191889.152717:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812368128 00000100:00100000:2.0:1784191889.152775:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 513 00000100:00100000:2.0:1784191889.152791:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:123531:x1870858812368128:12345-192.168.204.16@tcp:101:bash.0 00010000:00010000:2.0:1784191889.152814:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191889.152836:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b3c1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b8e6 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.152911:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3c8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.152925:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.152937:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.152950:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3cf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.152957:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.152965:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153048:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4b3d6 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153056:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4b3d6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153063:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4b3d6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153077:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3c8 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153084:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3c8 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153103:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3c8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153110:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3c8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153116:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191889.153121:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3c8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153128:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3c8 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153138:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff8af23d0d5200) 00010000:00010000:2.0:1784191889.153142:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.153146:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3c8 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153160:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b3c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153173:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153179:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3cf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153184:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153189:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ea00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191889.153192:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153198:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3cf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153205:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x4649583 (ffff8af207498c00) 00010000:00010000:2.0:1784191889.153207:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.153210:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3cf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153216:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b3cf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153249:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b3c1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8e6 expref: 15 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153277:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4b3d6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8e6 expref: 14 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.153285:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0x0 (ffff8af207498e00) 00010000:00010000:2.0:1784191889.153288:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784191889.153290:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e000, rc 0) 00000100:00100000:2.0:1784191889.153369:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:123531:x1870858812368128:12345-192.168.204.16@tcp:101:bash.0 Request processed in 578us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191889.153378:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 513 00000100:00100000:2.0:1784191889.163991:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191889.164239:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812368384 00000100:00100000:1.0:1784191889.164250:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812368384 00000100:00100000:1.0:1784191889.164338:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 514 00000100:00100000:1.0:1784191889.164348:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:123531:x1870858812368384:12345-192.168.204.16@tcp:101:bash.0 00010000:00010000:1.0:1784191889.164378:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191889.164405:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4b3dd lrc: 2/0,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b8ed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191889.164524:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000403:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1784191889.164659:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4b3dd lrc: 1/0,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8ed expref: 37 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.164675:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0x0 (ffff8af23d0d5900) 00010000:00010000:1.0:1784191889.164728:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784191889.164734:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4b3dd lrc: 0/0,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8ed expref: 37 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.164755:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4200, rc 0) 00000100:00100000:1.0:1784191889.164824:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:123531:x1870858812368384:12345-192.168.204.16@tcp:101:bash.0 Request processed in 477us (854us total) trans 25769803807 rc 301/301 00000100:00100000:1.0:1784191889.164832:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 514 00000100:00080000:0.0:1784191889.165265:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784191889.169165:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.169259:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812368512 00000100:00100000:2.0:1784191889.169269:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812368512 00000100:00100000:2.0:1784191889.169334:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 515 00000100:00100000:2.0:1784191889.169345:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:123531:x1870858812368512:12345-192.168.204.16@tcp:101:bash.0 00010000:00010000:2.0:1784191889.169375:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191889.169400:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b3eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b8f4 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191889.169500:0:164531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827955584:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1784191889.169565:0:164531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191889.169591:0:164531:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2dba80 going to sleep for 11 seconds 00000100:00100000:0.0:1784191889.169895:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827955584 00000100:00100000:0.0:1784191889.169901:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827955584 00000100:00100000:0.0:1784191889.169943:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:0.0:1784191889.169952:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+25:164531:x1870858827955584:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784191889.170039:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+25:164531:x1870858827955584:12345-0@lo:1000:mdt00_004.0 Request processed in 88us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191889.170047:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1784191889.170168:0:164531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:164531:1870858827955584:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1784191889.170248:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5600/0xfeec3c2dc5a4b3f2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.170263:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5600/0xfeec3c2dc5a4b3f2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.170276:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5600/0xfeec3c2dc5a4b3f2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191889.170319:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000403:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784191889.170323:0:164531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784191889.170340:0:164531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5600/0xfeec3c2dc5a4b3f2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.170372:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b3eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8f4 expref: 38 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.170399:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af10b5e5600/0xfeec3c2dc5a4b3f2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8f4 expref: 37 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.170428:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0x0 (ffff8af23d0d5400) 00010000:00010000:1.0:1784191889.170430:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784191889.170434:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5600, rc 0) 00000100:00100000:1.0:1784191889.170485:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+37:123531:x1870858812368512:12345-192.168.204.16@tcp:101:bash.0 Request processed in 1143us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191889.170492:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 515 00000100:00100000:1.0:1784191889.174568:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191889.174665:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812368640 00000100:00100000:3.0:1784191889.174679:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812368640 00000100:00100000:3.0:1784191889.174792:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 136 00000100:00100000:3.0:1784191889.174804:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+37:123531:x1870858812368640:12345-192.168.204.16@tcp:37:bash.0 00000100:00100000:3.0:1784191889.184166:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+37:123531:x1870858812368640:12345-192.168.204.16@tcp:37:bash.0 Request processed in 9352us (9599us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191889.184180:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 136 00000100:00100000:1.0:1784191889.190110:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.190211:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812368896 00000100:00100000:2.0:1784191889.190222:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812368896 00000100:00100000:2.0:1784191889.190294:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 137 00000100:00100000:2.0:1784191889.190306:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+37:123531:x1870858812368896:12345-192.168.204.16@tcp:35:bash.0 00000100:00100000:2.0:1784191889.190635:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+38:123531:x1870858812368896:12345-192.168.204.16@tcp:35:bash.0 Request processed in 330us (549us total) trans 25769803808 rc 0/0 00000100:00100000:2.0:1784191889.190643:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 137 00000100:00100000:1.0:1784191889.200281:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191889.200381:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812369024 00000100:00100000:0.0:1784191889.200391:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812369024 00000100:00100000:0.0:1784191889.200462:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 516 00000100:00100000:0.0:1784191889.200474:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+38:123688:x1870858812369024:12345-192.168.204.16@tcp:101:rm.0 00010000:00010000:0.0:1784191889.200502:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191889.200533:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b3f9 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b8fb expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.200602:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b400 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.200625:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b400 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.200638:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b400 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.200655:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b407 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1:0x0].0xa12f67b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.200661:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b407 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.200735:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b407 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.201066:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b400 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.201074:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b400 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.201082:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b400 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.201088:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b400 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.201095:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341b000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191889.201099:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b400 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.201106:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b400 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.201119:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0x0 (ffff8af23d0d5400) 00010000:00010000:0.0:1784191889.201122:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191889.201126:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b400 lrc: 3/0,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.201132:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b400 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.201150:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b407 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.201163:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b407 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.201169:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b407 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.201174:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341aa00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191889.201177:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b407 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.201184:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b407 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.201192:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0xa12f67b5 (ffff8af210dfe200) 00010000:00010000:0.0:1784191889.201195:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191889.201199:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b407 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.201205:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b407 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x1:0x0].0xa12f67b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.201241:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b3f9 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8fb expref: 39 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.201250:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1:0x0].0x0 (ffff8af23d0d5400) 00010000:00010000:0.0:1784191889.201253:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191889.201256:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b3f9 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8fb expref: 39 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.201277:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341a400, rc 0) 00000100:00100000:0.0:1784191889.201342:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+38:123688:x1870858812369024:12345-192.168.204.16@tcp:101:rm.0 Request processed in 870us (1071us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191889.201349:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 516 00000100:00100000:0.0:1784191889.245898:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.246122:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812369152 00000100:00100000:2.0:1784191889.246133:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812369152 00000100:00100000:2.0:1784191889.246235:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 290 00000100:00100000:2.0:1784191889.246247:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812369152:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191889.246330:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812369152:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 85us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191889.246338:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 290 00000100:00100000:1.0:1784191889.268095:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191889.272411:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812369280 00000100:00100000:0.0:1784191889.272435:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812369280 00000100:00100000:0.0:1784191889.272631:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 517 00000100:00100000:0.0:1784191889.272645:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:123690:x1870858812369280:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191889.272676:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191889.272731:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b40e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b902 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.272838:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b415 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.272856:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b415 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.272870:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b415 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.272884:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b41c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.272891:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b41c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.272937:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b41c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273007:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b423 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273016:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b423 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273024:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b423 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191889.273082:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab5:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784191889.273086:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784191889.273134:0:158667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b423 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273150:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b415 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273158:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b415 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273165:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b415 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273185:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b415 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273192:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341aa00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191889.273197:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b415 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273213:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b415 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273228:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af110071a00) 00010000:00010000:0.0:1784191889.273231:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191889.273245:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b415 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273253:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b415 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273280:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b41c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273286:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b41c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273291:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b41c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273297:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341b000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191889.273299:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b41c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273305:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b41c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273311:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4632c348 (ffff8af23d0d5b00) 00010000:00010000:0.0:1784191889.273314:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191889.273316:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b41c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273344:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b41c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273376:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b40e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b902 expref: 16 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273391:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b423 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b902 expref: 15 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.273398:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191889.273400:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784191889.273403:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341ba00, rc 0) 00000100:00100000:0.0:1784191889.273502:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:123690:x1870858812369280:12345-192.168.204.16@tcp:101:cp.0 Request processed in 859us (5423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191889.273509:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 517 00000100:00100000:1.0:1784191889.279225:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191889.281420:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812369408 00000100:00100000:3.0:1784191889.281442:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812369408 00000100:00100000:3.0:1784191889.281559:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 518 00000100:00100000:3.0:1784191889.281572:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cdbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:123690:x1870858812369408:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191889.281611:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191889.281645:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b42a lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b909 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.281798:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b431 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.281818:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b431 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.281833:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b431 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.281850:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b438 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.281858:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b438 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.281865:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b438 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.282180:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b431 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.282214:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b431 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.282222:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b431 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.282230:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b431 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.282238:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af110db3c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191889.282243:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b431 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.282253:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b431 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.282270:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191889.282274:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191889.282280:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b431 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.282288:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b431 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.282309:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b438 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.282376:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b438 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.282383:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b438 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.282396:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af110db2200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191889.282400:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b438 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.282408:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b438 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.282418:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x45c0cf9c (ffff8af110071100) 00010000:00010000:3.0:1784191889.282421:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191889.282424:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b438 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.282432:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b438 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.282480:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b42a lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b909 expref: 16 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.282493:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191889.282496:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191889.282500:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b42a lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b909 expref: 16 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.282511:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3600, rc 0) 00000100:00100000:3.0:1784191889.283145:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cdbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:123690:x1870858812369408:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1569us (3927us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191889.283157:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 518 00000100:00100000:2.0:1784191889.289452:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191889.289554:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812369664 00000100:00100000:0.0:1784191889.289567:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812369664 00000100:00100000:0.0:1784191889.289662:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 519 00000100:00100000:0.0:1784191889.289677:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:123690:x1870858812369664:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191889.289751:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191889.289756:0:158666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784191889.289800:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b423 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b902 expref: 15 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.289832:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191889.289839:0:158666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784191889.289885:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b43f lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b910 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.290055:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ae00/0xfeec3c2dc5a4b446 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.290071:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ae00/0xfeec3c2dc5a4b446 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.290084:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ae00/0xfeec3c2dc5a4b446 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.290108:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4b44d lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.290114:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4b44d lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.290121:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4b44d lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191889.290596:0:158666:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x246:0x0], index 0: 0 00080000:00000400:0.0:1784191889.290628:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 257 < left 278, rollback = 2 00080000:00000400:0.0:1784191889.290633:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/2, destroy: 0/0/0 00080000:00000400:0.0:1784191889.290635:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191889.290638:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191889.290640:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191889.290642:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191889.290665:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 257 < left 278, rollback = 2 00080000:00000400:0.0:1784191889.290668:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/2, destroy: 0/0/0 00080000:00000400:0.0:1784191889.290669:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191889.290671:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191889.290684:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191889.290729:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191889.290776:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 257 < left 278, rollback = 2 00080000:00000400:0.0:1784191889.290779:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/2, destroy: 0/0/0 00080000:00000400:0.0:1784191889.290781:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191889.290783:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191889.290785:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191889.290787:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191889.290915:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073c00/0xfeec3c2dc5a4b454 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.290927:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073c00/0xfeec3c2dc5a4b454 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.290936:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073c00/0xfeec3c2dc5a4b454 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.290980:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ae00/0xfeec3c2dc5a4b446 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.290989:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ae00/0xfeec3c2dc5a4b446 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.290997:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ae00/0xfeec3c2dc5a4b446 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.291004:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ae00/0xfeec3c2dc5a4b446 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.291011:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341ae00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191889.291016:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ae00/0xfeec3c2dc5a4b446 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.291024:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ae00/0xfeec3c2dc5a4b446 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.291043:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191889.291046:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191889.291051:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ae00/0xfeec3c2dc5a4b446 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.291059:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ae00/0xfeec3c2dc5a4b446 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191889.291079:0:158666:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006fd8e609 reply state 000000001014d6bf transno 34359738653 ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4b44d lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.291091:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4b44d lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.291098:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x45c0cf9c (ffff8af210dfe200) 00010000:00010000:0.0:1784191889.291100:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191889.291104:0:158666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191889.291151:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b43f lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b910 expref: 17 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.291171:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073c00/0xfeec3c2dc5a4b454 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b910 expref: 16 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.291179:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x2:0x0].0x0 (ffff8af210dfe000) 00010000:00010000:0.0:1784191889.291181:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191889.291183:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af242073c00, rc 0) 00000100:00100000:0.0:1784191889.291279:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:123690:x1870858812369664:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1605us (1843us total) trans 34359738653 rc 0/0 00000100:00100000:0.0:1784191889.291289:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 519 00000100:00100000:1.0:1784191889.303801:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.303955:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812369792 00000100:00100000:2.0:1784191889.303972:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812369792 00000100:00100000:2.0:1784191889.304049:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 245 00000100:00100000:2.0:1784191889.304061:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:69108:x1870858812369792:12345-192.168.204.16@tcp:8:cp.0 00010000:00080000:2.0:1784191889.304113:0:161232:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp t0 exp 0000000000000000 cur 5509 last 0 00000020:00000080:2.0:1784191889.304167:0:161232:0:(genops.c:1406:class_connect()) connect: client 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a, cookie 0xfeec3c2dc5a4b462 00002000:00100000:2.0:1784191889.304184:0:161232:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a/ffff8af109022800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 7950336 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784191889.304209:0:161232:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784191889.304505:0:161232:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784191889.304548:0:161232:0:(import.c:65:import_set_state_nolock()) ffff8af109020000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784191889.304659:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69108:x1870858812369792:12345-192.168.204.16@tcp:8:cp.0 Request processed in 596us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191889.304669:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 245 00000100:00100000:2.0:1784191889.310749:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191889.310924:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812369920 00000100:00100000:0.0:1784191889.310941:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812369920 00000100:00100000:0.0:1784191889.311062:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 246 00000100:00100000:0.0:1784191889.311078:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:0:x1870858812369920:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191889.311108:0:162385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191889.311140:0:162385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac115e8b/0xfeec3c2dc5a4b469 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b917 expref: -99 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191889.311177:0:162385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x246:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191889.311207:0:162385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x246:0x0].0x0 since=5509s v=(0 0) 00010000:00010000:0.0:1784191889.311212:0:162385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x246:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191889.311224:0:162385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac115e8b/0xfeec3c2dc5a4b469 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b917 expref: 7 pid: 162385 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.311251:0:162385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac115e8b/0xfeec3c2dc5a4b469 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b917 expref: 7 pid: 162385 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.311270:0:162385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af242072a00, rc 0) 00000100:00080000:1.0:1784191889.311585:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191889.311831:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:0:x1870858812369920:12345-192.168.204.16@tcp:101:cp.0 Request processed in 757us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191889.311840:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 246 00000100:00100000:0.0:1784191889.336964:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.337153:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812370048 00000100:00100000:2.0:1784191889.337166:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812370048 00000100:00100000:2.0:1784191889.337260:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 247 00000100:00100000:2.0:1784191889.337274:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123690:x1870858812370048:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191889.337300:0:160166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191889.337337:0:160166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003af6ff5d/0xfeec3c2dc5a4b470 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x246:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b91e expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.337380:0:160166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac115e8b/0xfeec3c2dc5a4b469 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b917 expref: 8 pid: 162385 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.337392:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x246:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191889.337397:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x246:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191889.337403:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003af6ff5d/0xfeec3c2dc5a4b470 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x246:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b91e expref: 8 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.337449:0:160166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac115e8b/0xfeec3c2dc5a4b469 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b917 expref: 8 pid: 162385 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.337467:0:160166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac115e8b/0xfeec3c2dc5a4b469 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b917 expref: 8 pid: 162385 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191889.337484:0:160166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:160166:1870858827955712:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191889.337598:0:160166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191889.347813:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191889.347946:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812370176 00000100:00100000:0.0:1784191889.347961:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812370176 00010000:00010000:0.0:1784191889.348026:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac115e8b/0xfeec3c2dc5a4b469 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b917 expref: 9 pid: 162385 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191889.348112:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 131 00000100:00100000:0.0:1784191889.348126:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69111:x1870858812370176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191889.348160:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191889.348195:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac115e8b/0xfeec3c2dc5a4b469 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b917 expref: 9 pid: 162385 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.348214:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac115e8b/0xfeec3c2dc5a4b469 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b917 expref: 9 pid: 162385 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.348250:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x246:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191889.348256:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x246:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191889.348267:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003af6ff5d/0xfeec3c2dc5a4b470 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b91e expref: 9 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.348279:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003af6ff5d/0xfeec3c2dc5a4b470 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b91e expref: 9 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.348344:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003af6ff5d/0xfeec3c2dc5a4b470 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b91e expref: 9 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191889.348362:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e63b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827955840:192.168.204.16@tcp:105: 00000100:00100000:0.0:1784191889.348490:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233dd7cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1784191889.351117:0:160166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac115e8b/0xfeec3c2dc5a4b469 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b917 expref: 9 pid: 162385 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191889.351189:0:160166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:160166:1870858827955712:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191889.351248:0:160166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003af6ff5d/0xfeec3c2dc5a4b470 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b91e expref: 8 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.351273:0:160166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e400, rc 0) 00000100:00100000:2.0:1784191889.351435:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123690:x1870858812370048:12345-192.168.204.16@tcp:101:cp.0 Request processed in 14164us (14486us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191889.351446:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 247 00000100:00100000:1.0:1784191889.370380:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e63b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827955840:192.168.204.16@tcp:105: 00010000:00010000:1.0:1784191889.370426:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191889.370505:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69111:x1870858812370176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 22381us (22711us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191889.370521:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 131 00000100:00100000:2.0:1784191889.404326:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191889.405338:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812370432 00000100:00100000:0.0:1784191889.405378:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812370432 00000100:00100000:0.0:1784191889.405472:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 138 00000100:00100000:0.0:1784191889.405485:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1099f7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:123690:x1870858812370432:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:0.0:1784191889.406279:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1099f7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:123690:x1870858812370432:12345-192.168.204.16@tcp:35:cp.0 Request processed in 792us (1973us total) trans 34359738654 rc 0/0 00000100:00100000:0.0:1784191889.406291:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 138 00000100:00100000:0.0:1784191889.426272:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191889.426492:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812370560 00000100:00100000:1.0:1784191889.426505:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812370560 00000100:00100000:1.0:1784191889.426593:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 520 00000100:00100000:1.0:1784191889.426615:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:123690:x1870858812370560:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191889.426648:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191889.426677:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b477 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b925 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.426963:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4b47e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.426982:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4b47e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.426996:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4b47e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427009:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4b485 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427015:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4b485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427021:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4b485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427097:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5000/0xfeec3c2dc5a4b48c lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427107:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5000/0xfeec3c2dc5a4b48c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427114:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5000/0xfeec3c2dc5a4b48c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191889.427159:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab5:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784191889.427163:0:161504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784191889.427208:0:161504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5000/0xfeec3c2dc5a4b48c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427237:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4b47e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427245:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4b47e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427252:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4b47e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427259:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4b47e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427267:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191889.427272:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4b47e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427282:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4b47e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427298:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af110071a00) 00010000:00010000:1.0:1784191889.427301:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191889.427306:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4b47e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427313:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4e00/0xfeec3c2dc5a4b47e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427341:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4b485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427348:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4b485 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427360:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4b485 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427366:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191889.427369:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4b485 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427376:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4b485 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427385:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4632c348 (ffff8af23d0d5b00) 00010000:00010000:1.0:1784191889.427387:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191889.427391:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4b485 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427397:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4b485 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427427:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b477 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b925 expref: 20 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427445:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5000/0xfeec3c2dc5a4b48c lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b925 expref: 19 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.427452:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191889.427455:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784191889.427457:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5000, rc 0) 00000100:00100000:1.0:1784191889.427545:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:123690:x1870858812370560:12345-192.168.204.16@tcp:101:cp.0 Request processed in 933us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191889.427564:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 520 00000100:00100000:2.0:1784191889.431865:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191889.432046:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812370688 00000100:00100000:3.0:1784191889.432078:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812370688 00000100:00100000:3.0:1784191889.432149:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 521 00000100:00100000:3.0:1784191889.432161:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:123690:x1870858812370688:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191889.432202:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191889.432233:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b493 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b92c expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.432474:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b49a lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.432494:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b49a lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.432509:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b49a lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.432526:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b4a1 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.432535:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b4a1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.432541:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b4a1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.432609:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b49a lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.432617:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b49a lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.432624:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b49a lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.432640:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b49a lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.432647:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af110db2200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191889.432652:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b49a lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.432661:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b49a lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.432676:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191889.432679:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191889.432686:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b49a lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.432741:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b49a lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.432760:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b4a1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.432767:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b4a1 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.433124:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b4a1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.433131:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af110db3c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191889.433134:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b4a1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.433151:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b4a1 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.433160:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x56569231 (ffff8af110071100) 00010000:00010000:3.0:1784191889.433162:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191889.433165:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b4a1 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.434029:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b4a1 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.434104:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b493 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b92c expref: 20 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.434119:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191889.434121:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191889.434126:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3600/0xfeec3c2dc5a4b493 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b92c expref: 20 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.434137:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3600, rc 0) 00000100:00100000:2.0:1784191889.435059:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:123690:x1870858812370688:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2891us (3200us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191889.435072:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 521 00000100:00100000:2.0:1784191889.440544:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191889.440675:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812370816 00000100:00100000:3.0:1784191889.440730:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812370816 00000100:00100000:3.0:1784191889.440827:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 522 00000100:00100000:3.0:1784191889.440843:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:123690:x1870858812370816:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191889.440874:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191889.441183:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b4a8 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b933 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441377:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af242072a00/0xfeec3c2dc5a4b4af lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441397:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af242072a00/0xfeec3c2dc5a4b4af lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441411:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af242072a00/0xfeec3c2dc5a4b4af lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441430:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073400/0xfeec3c2dc5a4b4b6 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441438:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073400/0xfeec3c2dc5a4b4b6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441445:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073400/0xfeec3c2dc5a4b4b6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441502:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af242072a00/0xfeec3c2dc5a4b4af lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441510:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af242072a00/0xfeec3c2dc5a4b4af lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441531:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af242072a00/0xfeec3c2dc5a4b4af lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441538:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af242072a00/0xfeec3c2dc5a4b4af lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441545:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af242072a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191889.441550:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af242072a00/0xfeec3c2dc5a4b4af lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441558:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af242072a00/0xfeec3c2dc5a4b4af lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441573:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191889.441576:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191889.441581:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af242072a00/0xfeec3c2dc5a4b4af lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441589:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af242072a00/0xfeec3c2dc5a4b4af lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441622:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073400/0xfeec3c2dc5a4b4b6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441629:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073400/0xfeec3c2dc5a4b4b6 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441635:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073400/0xfeec3c2dc5a4b4b6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441641:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af242073400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191889.441650:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073400/0xfeec3c2dc5a4b4b6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441658:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073400/0xfeec3c2dc5a4b4b6 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441667:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x56569231 (ffff8af210dfee00) 00010000:00010000:0.0:1784191889.441670:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191889.441673:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073400/0xfeec3c2dc5a4b4b6 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441679:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073400/0xfeec3c2dc5a4b4b6 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441760:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b4a8 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b933 expref: 20 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441780:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191889.441783:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191889.441788:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3e00/0xfeec3c2dc5a4b4a8 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b933 expref: 20 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.441800:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3e00, rc 0) 00000100:00100000:0.0:1784191889.441879:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:123690:x1870858812370816:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1040us (1352us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191889.441887:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 522 00000100:00100000:0.0:1784191889.447572:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191889.447825:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812371072 00000100:00100000:3.0:1784191889.447838:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812371072 00000100:00100000:3.0:1784191889.448060:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 523 00000100:00100000:3.0:1784191889.448075:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:123690:x1870858812371072:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191889.448102:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191889.448129:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3a00/0xfeec3c2dc5a4b4bd lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b93a expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.461488:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b4c4 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.461524:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b4c4 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.461542:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b4c4 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.461561:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b4cb lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.461592:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b4cb lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.461610:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b4cb lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191889.464943:0:158667:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1c3:0x0], index 1: 0 00080000:00000400:2.0:1784191889.464978:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191889.464983:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191889.464986:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191889.464988:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191889.464991:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191889.464993:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191889.465020:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191889.465023:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191889.465026:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191889.465028:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191889.465030:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191889.465032:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191889.465075:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191889.465077:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191889.465079:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191889.465081:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191889.465083:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191889.465085:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191889.465293:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b4d2 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.465316:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b4d2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.465352:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b4d2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.465412:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b4c4 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.465420:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b4c4 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.465426:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b4c4 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.465434:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b4c4 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.465441:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191889.465446:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b4c4 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.465455:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b4c4 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.465470:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191889.465473:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.465478:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b4c4 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.465485:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b4c4 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191889.465504:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000046cdb5c2 reply state 0000000092188744 transno 34359738655 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b4cb lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.465526:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b4cb lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.465534:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x56569231 (ffff8af207498600) 00010000:00010000:2.0:1784191889.465536:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191889.465540:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191889.465595:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3a00/0xfeec3c2dc5a4b4bd lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b93a expref: 22 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.465626:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b4d2 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b93a expref: 21 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.465635:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x3:0x0].0x0 (ffff8af207498c00) 00010000:00010000:2.0:1784191889.465637:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191889.465640:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ee00, rc 0) 00000100:00100000:2.0:1784191889.465789:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+22:123690:x1870858812371072:12345-192.168.204.16@tcp:101:cp.0 Request processed in 17716us (18234us total) trans 34359738655 rc 0/0 00000100:00100000:2.0:1784191889.465801:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 523 00000100:00100000:3.0:1784191889.475113:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.476891:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812371200 00000100:00100000:2.0:1784191889.476921:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812371200 00000100:00100000:2.0:1784191889.476989:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 248 00000100:00100000:2.0:1784191889.477000:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:69108:x1870858812371200:12345-192.168.204.16@tcp:8:cp.0 00010000:00080000:2.0:1784191889.477049:0:162386:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp t0 exp 0000000000000000 cur 5509 last 0 00000020:00000080:2.0:1784191889.477092:0:162386:0:(genops.c:1406:class_connect()) connect: client 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a, cookie 0xfeec3c2dc5a4b4e0 00002000:00100000:2.0:1784191889.477109:0:162386:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a/ffff8af204c79800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 7970816 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784191889.477136:0:162386:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784191889.477274:0:162386:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784191889.477319:0:162386:0:(import.c:65:import_set_state_nolock()) ffff8af204c7c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784191889.477419:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69108:x1870858812371200:12345-192.168.204.16@tcp:8:cp.0 Request processed in 418us (2325us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191889.477428:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 248 00000100:00100000:3.0:1784191889.479630:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.481125:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812371328 00000100:00100000:2.0:1784191889.481148:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812371328 00000100:00100000:2.0:1784191889.481270:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 249 00000100:00100000:2.0:1784191889.481286:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:0:x1870858812371328:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191889.481315:0:162394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191889.481348:0:162394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030086b32/0xfeec3c2dc5a4b4e7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b941 expref: -99 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191889.481383:0:162394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191889.481414:0:162394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c3:0x0].0x0 since=5509s v=(0 0) 00010000:00010000:2.0:1784191889.481420:0:162394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191889.481435:0:162394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030086b32/0xfeec3c2dc5a4b4e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b941 expref: 7 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.481462:0:162394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030086b32/0xfeec3c2dc5a4b4e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b941 expref: 7 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.481479:0:162394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7fa00, rc 0) 00000100:00100000:2.0:1784191889.481565:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:0:x1870858812371328:12345-192.168.204.16@tcp:101:cp.0 Request processed in 284us (1948us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191889.481573:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 249 00000100:00080000:3.0:1784191889.481736:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784191889.483944:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191889.508068:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191889.508138:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812371456 00000100:00100000:0.0:1784191889.508151:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812371456 00000100:00100000:0.0:1784191889.508246:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 250 00000100:00100000:0.0:1784191889.508534:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:123690:x1870858812371456:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191889.508565:0:160165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191889.508592:0:160165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ed6aa89/0xfeec3c2dc5a4b4ee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b948 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.508901:0:160165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030086b32/0xfeec3c2dc5a4b4e7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b941 expref: 8 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.508912:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191889.508918:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191889.508925:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ed6aa89/0xfeec3c2dc5a4b4ee lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b948 expref: 8 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.508971:0:160165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030086b32/0xfeec3c2dc5a4b4e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b941 expref: 8 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.508994:0:160165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030086b32/0xfeec3c2dc5a4b4e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b941 expref: 8 pid: 162394 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191889.509013:0:160165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e63b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:160165:1870858827955968:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191889.509149:0:160165:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233dd7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191889.515459:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191889.516038:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812371584 00000100:00100000:1.0:1784191889.516048:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812371584 00000100:00100000:0.0:1784191889.516068:0:160165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e63b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:160165:1870858827955968:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191889.516100:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030086b32/0xfeec3c2dc5a4b4e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b941 expref: 9 pid: 162394 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.516113:0:160165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ed6aa89/0xfeec3c2dc5a4b4ee lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 4 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b948 expref: 9 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191889.516147:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 132 00000100:00100000:1.0:1784191889.516155:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af202d71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69109:x1870858812371584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191889.516159:0:160165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341ae00, rc 0) 00000100:00100000:0.0:1784191889.516258:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:123690:x1870858812371456:12345-192.168.204.16@tcp:101:cp.0 Request processed in 7980us (8202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191889.516267:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 250 00010000:00010000:1.0:1784191889.516312:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191889.516345:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030086b32/0xfeec3c2dc5a4b4e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b941 expref: 8 pid: 162394 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.516362:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030086b32/0xfeec3c2dc5a4b4e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b941 expref: 8 pid: 162394 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.516389:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030086b32/0xfeec3c2dc5a4b4e7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b941 expref: 8 pid: 162394 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.516406:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191889.516412:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191889.516422:0:158652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ed6aa89/0xfeec3c2dc5a4b4ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b948 expref: 7 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.516434:0:158652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ed6aa89/0xfeec3c2dc5a4b4ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b948 expref: 7 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.516489:0:158652:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ed6aa89/0xfeec3c2dc5a4b4ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b948 expref: 7 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191889.516504:0:158652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:158652:1870858827956096:192.168.204.16@tcp:105: 00000100:00100000:1.0:1784191889.516573:0:158652:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10d302a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784191889.524364:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191889.524612:0:158652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:158652:1870858827956096:192.168.204.16@tcp:105: 00010000:00010000:1.0:1784191889.524651:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191889.524921:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af202d71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69109:x1870858812371584:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8763us (9477us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191889.524940:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 132 00000100:00100000:0.0:1784191889.525110:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812371840 00000100:00100000:0.0:1784191889.525125:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812371840 00000100:00100000:0.0:1784191889.525216:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 139 00000100:00100000:0.0:1784191889.525232:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+22:123690:x1870858812371840:12345-192.168.204.16@tcp:35:cp.0 00000001:00080000:0.0:1784191889.526952:0:158668:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738656 00000100:00100000:2.0:1784191889.532205:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:123690:x1870858812371840:12345-192.168.204.16@tcp:35:cp.0 Request processed in 6958us (7837us total) trans 34359738657 rc 0/0 00000100:00100000:2.0:1784191889.532225:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 139 00000020:00080000:2.0:1784191889.532235:0:158668:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784191889.542182:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.543726:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812371968 00000100:00100000:2.0:1784191889.543747:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812371968 00000100:00100000:2.0:1784191889.543843:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 524 00000100:00100000:2.0:1784191889.543857:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:123690:x1870858812371968:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191889.543890:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191889.543920:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b4f5 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b94f expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.544018:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b4fc lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.544036:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b4fc lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.544049:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b4fc lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.544068:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b503 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.544075:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b503 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.544082:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b503 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.544144:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b4fc lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.544173:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b4fc lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.544181:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b4fc lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.544189:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b4fc lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.544196:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7fa00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191889.544202:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b4fc lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.544211:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b4fc lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.544228:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191889.544232:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.544239:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b4fc lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.544247:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b4fc lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.544268:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b503 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.544275:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b503 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.544281:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b503 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.544294:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7fc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191889.544298:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b503 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.544304:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b503 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.545918:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xa6e7eec (ffff8af207498800) 00010000:00010000:2.0:1784191889.545931:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.545940:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b503 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.545951:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b503 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.546033:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b4f5 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b94f expref: 25 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.546250:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191889.546253:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.546259:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b4f5 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b94f expref: 25 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.546276:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ec00, rc 0) 00000100:00100000:2.0:1784191889.547016:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:123690:x1870858812371968:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3153us (4843us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191889.547029:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 524 00000100:00100000:3.0:1784191889.563680:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.565532:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812372096 00000100:00100000:2.0:1784191889.565576:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812372096 00000100:00100000:2.0:1784191889.565802:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 525 00000100:00100000:2.0:1784191889.565818:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:123690:x1870858812372096:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191889.565856:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191889.565889:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b50a lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b956 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.565989:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b511 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566007:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b511 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566022:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b511 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566040:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b518 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566048:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b518 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566055:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b518 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566108:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b511 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566117:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b511 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566124:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b511 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566140:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b511 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566148:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7fc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191889.566153:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b511 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566161:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b511 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566187:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191889.566191:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.566197:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b511 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566204:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b511 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566223:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b518 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566230:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b518 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566236:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b518 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566241:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7fa00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191889.566245:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b518 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566262:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b518 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566271:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xa6e7eec (ffff8af207498800) 00010000:00010000:2.0:1784191889.566273:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.566275:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b518 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566282:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b518 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566333:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b50a lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b956 expref: 25 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566346:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191889.566349:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.566353:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b50a lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b956 expref: 25 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.566364:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ec00, rc 0) 00000100:00100000:2.0:1784191889.566493:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:123690:x1870858812372096:12345-192.168.204.16@tcp:101:cp.0 Request processed in 676us (2825us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191889.566502:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 525 00000100:00100000:3.0:1784191889.576286:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.576567:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812372352 00000100:00100000:2.0:1784191889.576582:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812372352 00000100:00100000:2.0:1784191889.576678:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 526 00000100:00100000:2.0:1784191889.576743:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:123690:x1870858812372352:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191889.576800:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191889.576828:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b51f lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b95d expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.577179:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b526 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.577198:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b526 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.577215:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b526 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.577236:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b52d lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.577244:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b52d lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.577251:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b52d lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191889.580050:0:158667:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x247:0x0], index 0: 0 00080000:00000400:1.0:1784191889.580077:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:1.0:1784191889.580083:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191889.580085:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191889.580087:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191889.580090:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191889.580092:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191889.580115:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:1.0:1784191889.580118:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191889.580120:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191889.580122:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191889.580124:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191889.580126:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191889.580167:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:1.0:1784191889.580171:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191889.580173:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191889.580197:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191889.580199:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191889.580201:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191889.580502:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4b534 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.580523:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4b534 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.580538:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4b534 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.580588:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b526 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.580607:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b526 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.580670:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b526 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.580680:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b526 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.581060:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7fa00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191889.581068:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b526 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.581078:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b526 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.581093:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191889.581096:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191889.581113:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b526 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.581120:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b526 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191889.581142:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000047f52e95 reply state 000000005b4cf440 transno 34359738658 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b52d lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.581155:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b52d lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.581162:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xa6e7eec (ffff8af207498800) 00010000:00010000:1.0:1784191889.581165:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191889.581168:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191889.581225:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b51f lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b95d expref: 27 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.581243:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4b534 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b95d expref: 26 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.581252:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x4:0x0].0x0 (ffff8af23d0d5900) 00010000:00010000:1.0:1784191889.581254:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191889.581257:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4200, rc 0) 00000100:00100000:1.0:1784191889.582068:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:123690:x1870858812372352:12345-192.168.204.16@tcp:101:cp.0 Request processed in 4829us (5247us total) trans 34359738658 rc 0/0 00000100:00100000:1.0:1784191889.582083:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 526 00000100:00100000:1.0:1784191889.586094:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.586325:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812372480 00000100:00100000:2.0:1784191889.586339:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812372480 00000100:00100000:2.0:1784191889.586488:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 251 00000100:00100000:2.0:1784191889.586502:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69110:x1870858812372480:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191889.586613:0:162389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191889.587118:0:162389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e62983b5/0xfeec3c2dc5a4b542 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b964 expref: -99 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191889.587361:0:162389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x247:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191889.587390:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x247:0x0].0x0 since=5509s v=(0 0) 00010000:00010000:2.0:1784191889.587396:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x247:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191889.587419:0:162389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e62983b5/0xfeec3c2dc5a4b542 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b964 expref: 8 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.587443:0:162389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e62983b5/0xfeec3c2dc5a4b542 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b964 expref: 8 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.587461:0:162389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e200, rc 0) 00000100:00100000:2.0:1784191889.587561:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:69110:x1870858812372480:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1061us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191889.587570:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 251 00000100:00100000:3.0:1784191889.655520:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191889.659470:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812372608 00000100:00100000:1.0:1784191889.659493:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812372608 00000100:00100000:1.0:1784191889.659639:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 252 00000100:00100000:1.0:1784191889.659653:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123690:x1870858812372608:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191889.659679:0:162392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191889.659762:0:162392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f533b2f/0xfeec3c2dc5a4b549 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x247:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b96b expref: -99 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.659811:0:162392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e62983b5/0xfeec3c2dc5a4b542 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b964 expref: 9 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.659822:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x247:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191889.659828:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x247:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191889.659835:0:162392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f533b2f/0xfeec3c2dc5a4b549 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x247:0x0].0x0 rrc: 3 type: EXT [0->393215] (req 0->393215) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b96b expref: 9 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.659882:0:162392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e62983b5/0xfeec3c2dc5a4b542 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b964 expref: 9 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.659900:0:162392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e62983b5/0xfeec3c2dc5a4b542 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b964 expref: 9 pid: 162389 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191889.659917:0:162392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:162392:1870858827956224:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191889.660045:0:162392:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10d302300 going to sleep for 11 seconds 00000100:00100000:3.0:1784191889.665812:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191889.667789:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812372736 00000100:00100000:0.0:1784191889.667809:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812372736 00010000:00010000:0.0:1784191889.667890:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e62983b5/0xfeec3c2dc5a4b542 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b964 expref: 10 pid: 162389 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191889.667959:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 133 00000100:00100000:0.0:1784191889.667971:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+10:69112:x1870858812372736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191889.667994:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191889.668025:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e62983b5/0xfeec3c2dc5a4b542 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x247:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b964 expref: 10 pid: 162389 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.668042:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e62983b5/0xfeec3c2dc5a4b542 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x247:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b964 expref: 10 pid: 162389 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.668076:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x247:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191889.668103:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x247:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191889.668114:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001f533b2f/0xfeec3c2dc5a4b549 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x247:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b96b expref: 10 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.668126:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f533b2f/0xfeec3c2dc5a4b549 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x247:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b96b expref: 10 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.668184:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001f533b2f/0xfeec3c2dc5a4b549 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x247:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b96b expref: 10 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191889.668202:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e63b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827956352:192.168.204.16@tcp:105: 00000100:00100000:0.0:1784191889.668333:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233dd7780 going to sleep for 11 seconds 00000100:00100000:0.0:1784191889.671959:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e63b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827956352:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191889.672012:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191889.672100:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+10:69112:x1870858812372736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4129us (6303us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191889.672112:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 133 00010000:00010000:1.0:1784191889.673292:0:162392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e62983b5/0xfeec3c2dc5a4b542 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b964 expref: 9 pid: 162389 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191889.673418:0:162392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:162392:1870858827956224:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191889.673481:0:162392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001f533b2f/0xfeec3c2dc5a4b549 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b96b expref: 8 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.673501:0:162392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4e00, rc 0) 00000100:00100000:1.0:1784191889.673579:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123690:x1870858812372608:12345-192.168.204.16@tcp:101:cp.0 Request processed in 13928us (18075us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191889.673588:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 252 00000100:00100000:3.0:1784191889.696379:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.696473:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812372992 00000100:00100000:2.0:1784191889.696492:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812372992 00000100:00100000:2.0:1784191889.696592:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 140 00000100:00100000:2.0:1784191889.696614:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:123690:x1870858812372992:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191889.697198:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:123690:x1870858812372992:12345-192.168.204.16@tcp:35:cp.0 Request processed in 583us (841us total) trans 34359738659 rc 0/0 00000100:00100000:2.0:1784191889.697208:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 140 00000100:00100000:3.0:1784191889.707802:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.710218:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812373120 00000100:00100000:2.0:1784191889.710240:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812373120 00000100:00100000:2.0:1784191889.710361:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 527 00000100:00100000:2.0:1784191889.710375:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:123690:x1870858812373120:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191889.710435:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191889.710471:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b550 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b972 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.710637:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b557 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.710662:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b557 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.710678:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b557 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.710778:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b55e lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.710787:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b55e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.710795:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b55e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.710852:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b557 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.710861:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b557 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.710867:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b557 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.710874:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b557 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.710890:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191889.710896:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b557 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.710905:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b557 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.710922:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191889.710926:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.710932:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b557 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.710940:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4b557 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.710961:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b55e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.710968:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b55e lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.710974:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b55e lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.710979:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191889.710982:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b55e lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.710988:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b55e lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.711008:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe6b34bd0 (ffff8af207498900) 00010000:00010000:2.0:1784191889.711011:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.711014:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b55e lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.711020:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e200/0xfeec3c2dc5a4b55e lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.711065:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b550 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b972 expref: 29 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.711076:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191889.711079:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.711082:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4b550 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b972 expref: 29 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.711092:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ea00, rc 0) 00000100:00100000:2.0:1784191889.711197:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:123690:x1870858812373120:12345-192.168.204.16@tcp:101:cp.0 Request processed in 825us (3409us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191889.711206:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 527 00000100:00100000:0.0:1784191889.714788:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.715182:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812373248 00000100:00100000:2.0:1784191889.715197:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812373248 00000100:00100000:2.0:1784191889.715288:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 528 00000100:00100000:2.0:1784191889.715302:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:123690:x1870858812373248:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191889.715331:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191889.715362:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b565 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b979 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.715484:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b56c lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.715503:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b56c lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.715518:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b56c lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.715559:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7800/0xfeec3c2dc5a4b573 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.715568:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7800/0xfeec3c2dc5a4b573 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.715575:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7800/0xfeec3c2dc5a4b573 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.718079:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b56c lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.718101:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b56c lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.718110:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b56c lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.718118:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b56c lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.718125:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7fa00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191889.718154:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b56c lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.718163:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b56c lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.718186:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191889.718189:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.718195:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b56c lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.718204:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4b56c lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.718223:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7800/0xfeec3c2dc5a4b573 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.718229:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7800/0xfeec3c2dc5a4b573 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.718236:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7800/0xfeec3c2dc5a4b573 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.718240:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191889.718244:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7800/0xfeec3c2dc5a4b573 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.718250:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7800/0xfeec3c2dc5a4b573 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.718258:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe6b34bd0 (ffff8af207498400) 00010000:00010000:2.0:1784191889.718261:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.718271:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7800/0xfeec3c2dc5a4b573 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.718288:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7800/0xfeec3c2dc5a4b573 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.718353:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b565 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b979 expref: 29 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.718366:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191889.718368:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.718371:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4b565 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b979 expref: 29 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.718383:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ec00, rc 0) 00000100:00100000:2.0:1784191889.718482:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:123690:x1870858812373248:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3182us (3717us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191889.718493:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 528 00000100:00100000:1.0:1784191889.725515:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191889.725643:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812373504 00000100:00100000:0.0:1784191889.725656:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812373504 00000100:00100000:0.0:1784191889.725790:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 529 00000100:00100000:0.0:1784191889.725804:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:123690:x1870858812373504:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191889.725834:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191889.725863:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b57a lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b980 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.726044:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b581 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.726064:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b581 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.726079:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b581 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.726097:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b588 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.726103:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b588 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.726110:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b588 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191889.727550:0:158667:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1c4:0x0], index 1: 0 00080000:00000400:0.0:1784191889.727579:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191889.727584:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191889.727587:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191889.727590:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191889.727602:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191889.727605:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191889.727627:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191889.727630:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191889.727633:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191889.727635:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191889.727638:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191889.727657:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191889.727725:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191889.727729:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191889.727730:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191889.727733:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191889.727735:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191889.727737:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191889.732399:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b58f lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.732433:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b58f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.732450:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b58f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.732548:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b581 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.732557:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b581 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.732563:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b581 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.732573:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b581 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.732580:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341b000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191889.732586:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b581 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.732603:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b581 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.732655:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191889.732659:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191889.732665:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b581 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.732673:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b581 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191889.734413:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a6210573 reply state 00000000f7825d79 transno 34359738660 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b588 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.734446:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b588 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.734457:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe6b34bd0 (ffff8af210dfee00) 00010000:00010000:0.0:1784191889.734460:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191889.734465:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191889.734547:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b57a lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b980 expref: 31 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.734573:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b58f lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b980 expref: 30 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.734582:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x5:0x0].0x0 (ffff8af210dfe800) 00010000:00010000:0.0:1784191889.734585:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191889.734587:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341ba00, rc 0) 00000100:00100000:0.0:1784191889.736133:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:123690:x1870858812373504:12345-192.168.204.16@tcp:101:cp.0 Request processed in 10314us (10618us total) trans 34359738660 rc 0/0 00000100:00100000:0.0:1784191889.736148:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 529 00000100:00100000:1.0:1784191889.744419:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191889.744560:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812373632 00000100:00100000:0.0:1784191889.744574:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812373632 00000100:00100000:0.0:1784191889.744672:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 253 00000100:00100000:0.0:1784191889.744684:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69111:x1870858812373632:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191889.745069:0:162395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191889.745177:0:162395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4b59d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b987 expref: -99 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784191889.745214:0:162395:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191889.745243:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c4:0x0].0x0 since=5509s v=(0 0) 00010000:00010000:1.0:1784191889.745248:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191889.745261:0:162395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4b59d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b987 expref: 8 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.745294:0:162395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4b59d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b987 expref: 8 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.745312:0:162395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4c00, rc 0) 00000100:00100000:1.0:1784191889.745399:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:69111:x1870858812373632:12345-192.168.204.16@tcp:101:cp.0 Request processed in 716us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191889.745407:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 253 00000100:00100000:3.0:1784191889.783813:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.783998:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812373760 00000100:00100000:2.0:1784191889.784008:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812373760 00000100:00100000:2.0:1784191889.784076:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 254 00000100:00100000:2.0:1784191889.784086:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:123690:x1870858812373760:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191889.784105:0:160163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191889.784125:0:160163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047a435b4/0xfeec3c2dc5a4b5a4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b98e expref: -99 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.784160:0:160163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4b59d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b987 expref: 9 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.784193:0:160163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191889.784198:0:160163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191889.784204:0:160163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047a435b4/0xfeec3c2dc5a4b5a4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b98e expref: 9 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.784249:0:160163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4b59d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b987 expref: 9 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.784266:0:160163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4b59d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b987 expref: 9 pid: 162395 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191889.784282:0:160163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d636300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:160163:1870858827956480:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191889.784490:0:160163:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191889.796757:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.797086:0:160163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d636300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:160163:1870858827956480:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191889.797124:0:160163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000047a435b4/0xfeec3c2dc5a4b5a4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b98e expref: 9 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.797146:0:160163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7800, rc 0) 00000100:00100000:2.0:1784191889.797206:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:123690:x1870858812373760:12345-192.168.204.16@tcp:101:cp.0 Request processed in 13121us (13406us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191889.797214:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 254 00000100:00100000:1.0:1784191889.797552:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812373888 00000100:00100000:1.0:1784191889.797577:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812373888 00010000:00010000:1.0:1784191889.797627:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4b59d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b987 expref: 9 pid: 162395 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191889.797677:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 134 00000100:00100000:1.0:1784191889.797713:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69109:x1870858812373888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191889.797729:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191889.797757:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4b59d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b987 expref: 9 pid: 162395 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.797787:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4b59d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b987 expref: 9 pid: 162395 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.797813:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4b59d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b987 expref: 9 pid: 162395 timeout: 5609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.797830:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191889.797835:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191889.797843:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000047a435b4/0xfeec3c2dc5a4b5a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b98e expref: 8 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.797854:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047a435b4/0xfeec3c2dc5a4b5a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b98e expref: 8 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.797887:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000047a435b4/0xfeec3c2dc5a4b5a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b98e expref: 8 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191889.797914:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfaa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827956608:192.168.204.16@tcp:105: 00000100:00100000:1.0:1784191889.797971:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10d302300 going to sleep for 11 seconds 00000100:00100000:0.0:1784191889.817204:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfaa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827956608:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191889.817233:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191889.817298:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:69109:x1870858812373888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 19612us (20553us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191889.817310:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 134 00000100:00100000:3.0:1784191889.817633:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.818061:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812374144 00000100:00100000:2.0:1784191889.818069:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812374144 00000100:00100000:2.0:1784191889.818115:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 141 00000100:00100000:2.0:1784191889.818143:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:123690:x1870858812374144:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191889.818457:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:123690:x1870858812374144:12345-192.168.204.16@tcp:35:cp.0 Request processed in 315us (824us total) trans 34359738661 rc 0/0 00000100:00100000:2.0:1784191889.818464:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 141 00000100:00100000:3.0:1784191889.824521:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191889.824772:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812374272 00000100:00100000:0.0:1784191889.824786:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812374272 00000100:00100000:0.0:1784191889.824858:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 530 00000100:00100000:0.0:1784191889.824869:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:123690:x1870858812374272:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191889.824899:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191889.824920:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b5ab lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b995 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.824992:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5b2 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825006:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5b2 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825019:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5b2 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825034:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5b9 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825059:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5b9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825066:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5b9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825128:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5b2 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825136:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5b2 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825143:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5b2 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825150:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5b2 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825156:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341b000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191889.825160:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5b2 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825167:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5b2 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825179:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191889.825182:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191889.825187:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5b2 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825195:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5b2 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825219:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5b9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825226:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5b9 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825232:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5b9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825236:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341a200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191889.825239:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5b9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825245:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5b9 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825252:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9ca112ae (ffff8af210dfed00) 00010000:00010000:0.0:1784191889.825255:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191889.825257:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5b9 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825262:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5b9 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825296:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b5ab lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b995 expref: 33 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825305:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191889.825307:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191889.825317:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b5ab lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b995 expref: 33 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.825327:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341a400, rc 0) 00000100:00100000:0.0:1784191889.825414:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:123690:x1870858812374272:12345-192.168.204.16@tcp:101:cp.0 Request processed in 546us (913us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191889.825421:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 530 00000100:00100000:1.0:1784191889.835000:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191889.835185:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812374400 00000100:00100000:0.0:1784191889.835196:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812374400 00000100:00100000:0.0:1784191889.835268:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 531 00000100:00100000:0.0:1784191889.835279:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:123690:x1870858812374400:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191889.835302:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191889.835326:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b5c0 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b99c expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835399:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5c7 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835414:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5c7 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835426:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5c7 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835439:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5ce lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835446:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5ce lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835452:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5ce lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835525:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5c7 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835533:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5c7 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835539:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5c7 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835546:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5c7 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835551:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341a200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191889.835556:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5c7 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835563:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5c7 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835575:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191889.835578:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191889.835582:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5c7 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835589:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b5c7 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835619:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5ce lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835625:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5ce lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835637:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5ce lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835642:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341b000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191889.835644:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5ce lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835651:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5ce lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835658:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9ca112ae (ffff8af210dfed00) 00010000:00010000:0.0:1784191889.835661:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191889.835664:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5ce lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.835670:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b5ce lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.836230:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b5c0 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b99c expref: 33 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.836245:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191889.836248:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191889.836251:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b5c0 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b99c expref: 33 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.836265:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341a400, rc 0) 00000100:00100000:0.0:1784191889.836337:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:123690:x1870858812374400:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1059us (1348us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191889.836356:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 531 00000100:00100000:0.0:1784191889.844751:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191889.844849:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812374656 00000100:00100000:1.0:1784191889.844859:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812374656 00000100:00100000:1.0:1784191889.844925:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 532 00000100:00100000:1.0:1784191889.844936:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:123690:x1870858812374656:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191889.844959:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191889.844982:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4b5d5 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b9a3 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.845104:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4b5dc lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.845121:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4b5dc lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.845133:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4b5dc lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.845149:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4b5e3 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.845155:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4b5e3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.845161:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4b5e3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191889.845521:0:158667:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x248:0x0], index 0: 0 00080000:00000400:1.0:1784191889.845534:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191889.845537:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191889.845540:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191889.845542:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191889.845545:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191889.845547:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191889.845566:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191889.845569:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191889.845571:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191889.845573:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191889.845575:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191889.845578:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191889.845622:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191889.845626:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191889.845627:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191889.845630:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191889.845632:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191889.845634:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191889.845788:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4600/0xfeec3c2dc5a4b5ea lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.845800:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4600/0xfeec3c2dc5a4b5ea lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.845809:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4600/0xfeec3c2dc5a4b5ea lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.845846:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4b5dc lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.845867:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4b5dc lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.845874:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4b5dc lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.845881:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4b5dc lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.845886:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191889.845891:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4b5dc lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.845898:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4b5dc lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.845911:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191889.845914:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191889.845919:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4b5dc lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.845926:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4b5dc lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191889.845939:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fbde83f4 reply state 00000000c52af862 transno 34359738662 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4b5e3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.845949:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4b5e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.845955:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9ca112ae (ffff8af20db3d800) 00010000:00010000:1.0:1784191889.845963:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191889.845966:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191889.845998:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4b5d5 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9a3 expref: 35 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.846014:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4600/0xfeec3c2dc5a4b5ea lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9a3 expref: 34 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.846021:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x6:0x0].0x0 (ffff8af20db3d600) 00010000:00010000:1.0:1784191889.846023:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191889.846026:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4600, rc 0) 00000100:00100000:1.0:1784191889.846096:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:123690:x1870858812374656:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1162us (1357us total) trans 34359738662 rc 0/0 00000100:00100000:1.0:1784191889.846105:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 532 00000100:00100000:1.0:1784191889.862255:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191889.862419:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812374784 00000100:00100000:0.0:1784191889.862430:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812374784 00000100:00100000:0.0:1784191889.862498:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 255 00000100:00100000:0.0:1784191889.862511:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:69109:x1870858812374784:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191889.862532:0:162339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191889.862556:0:162339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e8e4cbe/0xfeec3c2dc5a4b5f8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b9aa expref: -99 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191889.862585:0:162339:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x248:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191889.862617:0:162339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x248:0x0].0x0 since=5510s v=(0 0) 00010000:00010000:0.0:1784191889.862622:0:162339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x248:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191889.862633:0:162339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e8e4cbe/0xfeec3c2dc5a4b5f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9aa expref: 9 pid: 162339 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.862655:0:162339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000e8e4cbe/0xfeec3c2dc5a4b5f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9aa expref: 9 pid: 162339 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.862834:0:162339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341a400, rc 0) 00000100:00100000:0.0:1784191889.862980:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69109:x1870858812374784:12345-192.168.204.16@tcp:101:cp.0 Request processed in 471us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191889.862988:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 255 00000100:00100000:2.0:1784191889.865785:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191889.865862:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812374912 00000100:00100000:3.0:1784191889.865885:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812374912 00000100:00100000:3.0:1784191889.865939:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 256 00000100:00100000:3.0:1784191889.865950:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:123690:x1870858812374912:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191889.865969:0:162386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191889.865989:0:162386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000502ea2c8/0xfeec3c2dc5a4b5ff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b9b1 expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.866021:0:162386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e8e4cbe/0xfeec3c2dc5a4b5f8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9aa expref: 10 pid: 162339 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.866030:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x248:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191889.866034:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x248:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191889.866039:0:162386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000502ea2c8/0xfeec3c2dc5a4b5ff lrc: 4/0,0 mode: --/PW res: [0x280000401:0x248:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9b1 expref: 10 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.866139:0:162386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e8e4cbe/0xfeec3c2dc5a4b5f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9aa expref: 10 pid: 162339 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191889.866154:0:162386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e8e4cbe/0xfeec3c2dc5a4b5f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9aa expref: 10 pid: 162339 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191889.866167:0:162386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:162386:1870858827956736:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191889.866335:0:162386:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35240 going to sleep for 11 seconds 00000100:00100000:3.0:1784191889.876401:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191889.878078:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812375040 00000100:00100000:1.0:1784191889.878103:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812375040 00010000:00010000:1.0:1784191889.878159:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e8e4cbe/0xfeec3c2dc5a4b5f8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9aa expref: 11 pid: 162339 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191889.878217:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 135 00000100:00100000:1.0:1784191889.878227:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:69111:x1870858812375040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191889.878247:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191889.878272:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e8e4cbe/0xfeec3c2dc5a4b5f8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9aa expref: 11 pid: 162339 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.878287:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e8e4cbe/0xfeec3c2dc5a4b5f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9aa expref: 11 pid: 162339 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.878330:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x248:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191889.878335:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x248:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191889.878346:0:158652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000502ea2c8/0xfeec3c2dc5a4b5ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9b1 expref: 11 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.878358:0:158652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000502ea2c8/0xfeec3c2dc5a4b5ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9b1 expref: 11 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191889.878399:0:158652:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000502ea2c8/0xfeec3c2dc5a4b5ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9b1 expref: 11 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191889.878415:0:158652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:158652:1870858827956864:192.168.204.16@tcp:105: 00000100:00100000:1.0:1784191889.878576:0:158652:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10d3029c0 going to sleep for 11 seconds 00010000:00010000:2.0:1784191889.881736:0:162386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e8e4cbe/0xfeec3c2dc5a4b5f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9aa expref: 11 pid: 162339 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191889.881974:0:162386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:162386:1870858827956736:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191889.882015:0:162386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000502ea2c8/0xfeec3c2dc5a4b5ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9b1 expref: 10 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.882032:0:162386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db2600, rc 0) 00000100:00100000:2.0:1784191889.882096:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+10:123690:x1870858812374912:12345-192.168.204.16@tcp:101:cp.0 Request processed in 16147us (16320us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191889.882105:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 256 00000100:00100000:2.0:1784191889.899968:0:158652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:158652:1870858827956864:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191889.899999:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191889.900109:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69111:x1870858812375040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 21881us (23719us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191889.900119:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 135 00000100:00100000:0.0:1784191889.908086:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.911205:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812375296 00000100:00100000:2.0:1784191889.911221:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812375296 00000100:00100000:2.0:1784191889.911375:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 142 00000100:00100000:2.0:1784191889.911392:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:123690:x1870858812375296:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191889.911794:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:123690:x1870858812375296:12345-192.168.204.16@tcp:35:cp.0 Request processed in 408us (3717us total) trans 34359738663 rc 0/0 00000100:00100000:2.0:1784191889.911803:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 142 00000100:00100000:1.0:1784191889.925030:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.925141:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812375424 00000100:00100000:2.0:1784191889.925154:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812375424 00000100:00100000:2.0:1784191889.925263:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 533 00000100:00100000:2.0:1784191889.925274:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:123690:x1870858812375424:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191889.925302:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191889.925327:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b606 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b9b8 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925395:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b60d lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925411:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b60d lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925422:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b60d lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925436:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b614 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925443:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b614 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925449:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b614 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925492:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b60d lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925514:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b60d lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925521:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b60d lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925527:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b60d lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925533:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191889.925537:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b60d lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925544:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b60d lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925557:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191889.925561:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.925565:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b60d lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925572:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b60d lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925586:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b614 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925603:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b614 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925610:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b614 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925622:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191889.925625:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b614 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925631:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b614 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925640:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9fe9a331 (ffff8af207498400) 00010000:00010000:2.0:1784191889.925642:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.925645:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b614 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925650:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b614 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925743:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b606 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9b8 expref: 37 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925754:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191889.925757:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.925770:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b606 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9b8 expref: 37 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.925781:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6000, rc 0) 00000100:00100000:2.0:1784191889.925845:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:123690:x1870858812375424:12345-192.168.204.16@tcp:101:cp.0 Request processed in 573us (824us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191889.925853:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 533 00000100:00100000:1.0:1784191889.939356:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.939454:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812375552 00000100:00100000:2.0:1784191889.939482:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812375552 00000100:00100000:2.0:1784191889.939545:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 534 00000100:00100000:2.0:1784191889.939555:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:123690:x1870858812375552:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191889.939579:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191889.939614:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b61b lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b9bf expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.939736:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b622 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.939754:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b622 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.939949:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b622 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.939968:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b629 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.939976:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b629 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.939983:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b629 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.940028:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b622 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.940036:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b622 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.940042:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b622 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.940059:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b622 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.940066:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191889.940070:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b622 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.940078:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b622 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.940089:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191889.940092:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.940097:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b622 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.940104:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b622 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.940118:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b629 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.940123:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b629 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.940128:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b629 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.940133:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191889.940136:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b629 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.940152:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b629 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.940161:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9fe9a331 (ffff8af207498400) 00010000:00010000:2.0:1784191889.940163:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.940166:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b629 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.940172:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b629 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.940206:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b61b lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9bf expref: 37 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.940217:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191889.940220:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191889.940223:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b61b lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9bf expref: 37 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.940233:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6000, rc 0) 00000100:00100000:2.0:1784191889.940352:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:123690:x1870858812375552:12345-192.168.204.16@tcp:101:cp.0 Request processed in 797us (1008us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191889.940360:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 534 00000100:00100000:1.0:1784191889.971405:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191889.971507:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812375808 00000100:00100000:0.0:1784191889.971549:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812375808 00000100:00100000:0.0:1784191889.971639:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 535 00000100:00100000:0.0:1784191889.971653:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:123690:x1870858812375808:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191889.971736:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191889.971765:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b630 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b9c6 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.971916:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b637 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.971933:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b637 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.971945:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b637 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.971960:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b63e lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.971968:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b63e lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.971975:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b63e lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191889.972322:0:158666:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1c5:0x0], index 1: 0 00080000:00000400:0.0:1784191889.972336:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191889.972340:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191889.972342:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191889.972344:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191889.972346:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191889.972357:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191889.972378:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191889.972381:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191889.972382:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191889.972384:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191889.972386:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191889.972388:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191889.972417:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191889.972421:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191889.972422:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191889.972424:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191889.972426:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191889.972428:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191889.972533:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073400/0xfeec3c2dc5a4b645 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.972543:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073400/0xfeec3c2dc5a4b645 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.972550:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073400/0xfeec3c2dc5a4b645 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.972583:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b637 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.972600:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b637 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.972607:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b637 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.972614:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b637 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.972630:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341b000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191889.972634:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b637 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.972641:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b637 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.972654:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191889.972658:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191889.972663:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b637 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.972669:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b637 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191889.972727:0:158666:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000071c5d416 reply state 0000000054473da1 transno 34359738664 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b63e lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.972739:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b63e lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.972745:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9fe9a331 (ffff8af203904400) 00010000:00010000:0.0:1784191889.972747:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191889.972750:0:158666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191889.972782:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b630 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9c6 expref: 39 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.972799:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073400/0xfeec3c2dc5a4b645 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9c6 expref: 38 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191889.972820:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x7:0x0].0x0 (ffff8af203904b00) 00010000:00010000:0.0:1784191889.972822:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191889.972824:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af242073400, rc 0) 00000100:00100000:0.0:1784191889.972915:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+39:123690:x1870858812375808:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1265us (1519us total) trans 34359738664 rc 0/0 00000100:00100000:0.0:1784191889.972925:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 535 00000100:00100000:1.0:1784191889.981237:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191889.993994:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812375936 00000100:00100000:2.0:1784191889.994013:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812375936 00000100:00100000:2.0:1784191889.994098:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 257 00000100:00100000:2.0:1784191889.994110:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+8:69111:x1870858812375936:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191889.994151:0:162394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191889.994173:0:162394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b653 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b9cd expref: -99 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191889.994201:0:162394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191889.994225:0:162394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c5:0x0].0x0 since=5510s v=(0 0) 00010000:00010000:2.0:1784191889.994229:0:162394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191889.994241:0:162394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b653 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9cd expref: 9 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.994264:0:162394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b653 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9cd expref: 9 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191889.994278:0:162394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6000, rc 0) 00000100:00100000:2.0:1784191889.994348:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69111:x1870858812375936:12345-192.168.204.16@tcp:101:cp.0 Request processed in 240us (13125us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191889.994355:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 257 00000100:00100000:3.0:1784191890.028025:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191890.028188:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812376064 00000100:00100000:0.0:1784191890.028198:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812376064 00000100:00100000:0.0:1784191890.028268:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 258 00000100:00100000:0.0:1784191890.028280:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:123690:x1870858812376064:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191890.028300:0:162398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191890.028321:0:162398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac115e8b/0xfeec3c2dc5a4b65a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b9d4 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.028371:0:162398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b653 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9cd expref: 10 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.028381:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191890.028386:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191890.028392:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac115e8b/0xfeec3c2dc5a4b65a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9d4 expref: 10 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.028429:0:162398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b653 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9cd expref: 10 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.028476:0:162398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b653 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9cd expref: 10 pid: 162394 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191890.028491:0:162398:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233157480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:162398:1870858827956992:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191890.028603:0:162398:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233dd7300 going to sleep for 11 seconds 00000100:00100000:1.0:1784191890.037412:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191890.037456:0:162398:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233157480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:162398:1870858827956992:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191890.037626:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812376192 00000100:00100000:2.0:1784191890.037635:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812376192 00010000:00010000:2.0:1784191890.037676:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b653 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9cd expref: 11 pid: 162394 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191890.037765:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 136 00000100:00100000:2.0:1784191890.037776:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:69110:x1870858812376192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191890.037793:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191890.037848:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b653 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9cd expref: 11 pid: 162394 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.037864:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b653 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9cd expref: 11 pid: 162394 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.037887:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b653 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9cd expref: 11 pid: 162394 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.037903:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.037907:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.037914:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac115e8b/0xfeec3c2dc5a4b65a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9d4 expref: 10 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.037924:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac115e8b/0xfeec3c2dc5a4b65a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9d4 expref: 10 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.037960:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ac115e8b/0xfeec3c2dc5a4b65a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9d4 expref: 10 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191890.037974:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d635880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827957120:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191890.038063:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784191890.038350:0:162398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac115e8b/0xfeec3c2dc5a4b65a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9d4 expref: 10 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.038364:0:162398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af242072a00, rc 0) 00000100:00100000:0.0:1784191890.038412:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+10:123690:x1870858812376064:12345-192.168.204.16@tcp:101:cp.0 Request processed in 10133us (10398us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191890.038420:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 258 00000100:00100000:1.0:1784191890.043116:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.043206:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d635880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827957120:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191890.043232:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191890.043290:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69110:x1870858812376192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5516us (5889us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191890.043319:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 136 00000100:00100000:3.0:1784191890.043400:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812376448 00000100:00100000:3.0:1784191890.043414:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812376448 00000100:00100000:3.0:1784191890.043474:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 143 00000100:00100000:3.0:1784191890.043484:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+39:123690:x1870858812376448:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:0.0:1784191890.050316:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:123690:x1870858812376448:12345-192.168.204.16@tcp:35:cp.0 Request processed in 6820us (7197us total) trans 34359738665 rc 0/0 00000100:00100000:0.0:1784191890.050334:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 143 00000100:00100000:1.0:1784191890.066052:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.070044:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812376576 00000100:00100000:2.0:1784191890.070065:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812376576 00000100:00100000:2.0:1784191890.070154:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 536 00000100:00100000:2.0:1784191890.070166:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:123690:x1870858812376576:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191890.070194:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191890.070220:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b661 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b9db expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070296:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b668 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070312:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b668 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070325:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b668 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070339:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b66f lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070345:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b66f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070352:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b66f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070403:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b668 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070432:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b668 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070796:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b668 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070806:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b668 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070812:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.070876:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b668 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070886:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b668 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070899:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.070902:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.070907:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b668 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070914:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b668 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070932:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b66f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070937:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b66f lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070942:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b66f lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070956:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.070959:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b66f lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070965:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b66f lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070973:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x151c8ac3 (ffff8af207498000) 00010000:00010000:2.0:1784191890.070975:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.070978:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b66f lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.070984:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b66f lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.071025:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b661 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9db expref: 41 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.071036:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.071039:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.071042:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b661 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9db expref: 41 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.071052:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6000, rc 0) 00000100:00100000:2.0:1784191890.071134:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:123690:x1870858812376576:12345-192.168.204.16@tcp:101:cp.0 Request processed in 969us (5095us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191890.071142:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 536 00000100:00100000:1.0:1784191890.078382:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.084000:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812376704 00000100:00100000:2.0:1784191890.084036:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812376704 00000100:00100000:2.0:1784191890.084105:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 537 00000100:00100000:2.0:1784191890.084117:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:123690:x1870858812376704:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191890.084143:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191890.084168:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6400/0xfeec3c2dc5a4b676 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b9e2 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.084238:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4b67d lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.084254:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4b67d lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.084267:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4b67d lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.084282:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4b684 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.084290:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4b684 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.084296:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4b684 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.084339:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4b67d lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.084347:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4b67d lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.084352:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4b67d lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.084366:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4b67d lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.084373:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.084378:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4b67d lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.084385:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4b67d lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.084397:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.084400:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.084404:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4b67d lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.084411:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4b67d lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.084427:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4b684 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.084433:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4b684 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.084439:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4b684 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.086654:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d6600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.086661:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4b684 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.086715:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4b684 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.086734:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x151c8ac3 (ffff8af207498100) 00010000:00010000:2.0:1784191890.086738:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.086743:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4b684 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.086751:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4b684 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.087095:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6400/0xfeec3c2dc5a4b676 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9e2 expref: 41 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.087108:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.087111:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.087115:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6400/0xfeec3c2dc5a4b676 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9e2 expref: 41 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.087125:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6400, rc 0) 00000100:00100000:2.0:1784191890.087270:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:123690:x1870858812376704:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3153us (8895us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191890.087281:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 537 00000100:00100000:1.0:1784191890.099029:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191890.108942:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812376960 00000100:00100000:0.0:1784191890.108961:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812376960 00000100:00100000:0.0:1784191890.109059:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 538 00000100:00100000:0.0:1784191890.109072:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:123690:x1870858812376960:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191890.109096:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191890.109124:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b68b lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b9e9 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.109284:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b692 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.109301:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b692 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.109314:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b692 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.109329:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532200/0xfeec3c2dc5a4b699 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.110678:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532200/0xfeec3c2dc5a4b699 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.110720:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532200/0xfeec3c2dc5a4b699 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191890.112044:0:158665:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x249:0x0], index 0: 0 00080000:00000400:0.0:1784191890.112062:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:0.0:1784191890.112067:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:0.0:1784191890.112069:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191890.112071:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191890.112073:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191890.112075:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191890.112094:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:0.0:1784191890.112096:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:0.0:1784191890.112098:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191890.112100:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191890.112102:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191890.112123:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191890.112168:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:0.0:1784191890.112170:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:0.0:1784191890.112173:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191890.112175:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191890.112177:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191890.112179:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191890.112313:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533c00/0xfeec3c2dc5a4b6a0 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.112331:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533c00/0xfeec3c2dc5a4b6a0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.112342:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533c00/0xfeec3c2dc5a4b6a0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.112379:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b692 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.112387:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b692 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.112393:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b692 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.112400:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b692 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.112406:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341b000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191890.112411:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b692 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.112418:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b692 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.112440:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191890.112444:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191890.112449:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b692 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.112456:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4b692 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191890.112475:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000272646f4 reply state 000000003f96ffd5 transno 34359738666 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532200/0xfeec3c2dc5a4b699 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.112486:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532200/0xfeec3c2dc5a4b699 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.112492:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x151c8ac3 (ffff8af203904700) 00010000:00010000:0.0:1784191890.116796:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191890.116957:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191890.117050:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4b68b lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9e9 expref: 43 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.117085:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533c00/0xfeec3c2dc5a4b6a0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9e9 expref: 42 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.117096:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x8:0x0].0x0 (ffff8af203904d00) 00010000:00010000:0.0:1784191890.117098:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191890.117101:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d533c00, rc 0) 00000100:00100000:0.0:1784191890.117185:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:123690:x1870858812376960:12345-192.168.204.16@tcp:101:cp.0 Request processed in 8114us (18163us total) trans 34359738666 rc 0/0 00000100:00100000:0.0:1784191890.117194:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 538 00000100:00100000:1.0:1784191890.128786:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191890.129035:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812377088 00000100:00100000:3.0:1784191890.129047:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812377088 00000100:00100000:3.0:1784191890.129108:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 259 00000100:00100000:3.0:1784191890.129118:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69110:x1870858812377088:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191890.129137:0:162391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191890.129158:0:162391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b6ae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b9f0 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191890.129186:0:162391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x249:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784191890.129207:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x249:0x0].0x0 since=5510s v=(0 0) 00010000:00010000:3.0:1784191890.129211:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x249:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191890.129221:0:162391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b6ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9f0 expref: 10 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.129240:0:162391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b6ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9f0 expref: 10 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.129252:0:162391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3600, rc 0) 00000100:00100000:3.0:1784191890.138353:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+10:69110:x1870858812377088:12345-192.168.204.16@tcp:101:cp.0 Request processed in 8683us (9027us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191890.138371:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 259 00000100:00100000:1.0:1784191890.147218:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.147321:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812377216 00000100:00100000:2.0:1784191890.147333:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812377216 00000100:00100000:2.0:1784191890.147394:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 260 00000100:00100000:2.0:1784191890.147404:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+10:123690:x1870858812377216:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191890.147441:0:162387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191890.147472:0:162387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d67af17a/0xfeec3c2dc5a4b6b5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x249:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b9f7 expref: -99 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.147508:0:162387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b6ae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9f0 expref: 11 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.147519:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x249:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.147523:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x249:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.147528:0:162387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d67af17a/0xfeec3c2dc5a4b6b5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x249:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9f7 expref: 11 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.147564:0:162387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b6ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9f0 expref: 11 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.147578:0:162387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b6ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9f0 expref: 11 pid: 162391 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191890.147603:0:162387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d635880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:162387:1870858827957248:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191890.147729:0:162387:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191890.153584:0:162387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d635880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:162387:1870858827957248:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191890.153635:0:162387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d67af17a/0xfeec3c2dc5a4b6b5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x249:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9f7 expref: 11 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.153659:0:162387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6400, rc 0) 00000100:00100000:2.0:1784191890.154562:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:123690:x1870858812377216:12345-192.168.204.16@tcp:101:cp.0 Request processed in 7151us (7347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191890.154573:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 260 00000100:00100000:3.0:1784191890.155750:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191890.155852:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812377344 00000100:00100000:0.0:1784191890.155862:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812377344 00010000:00010000:0.0:1784191890.155902:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b6ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9f0 expref: 11 pid: 162391 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191890.155938:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 137 00000100:00100000:0.0:1784191890.155948:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210303800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:69111:x1870858812377344:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191890.155961:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191890.155986:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b6ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9f0 expref: 11 pid: 162391 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.156000:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b6ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9f0 expref: 11 pid: 162391 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.156023:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b6ae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9f0 expref: 11 pid: 162391 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.156039:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x249:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191890.156044:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x249:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191890.156052:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d67af17a/0xfeec3c2dc5a4b6b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9f7 expref: 10 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.156062:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d67af17a/0xfeec3c2dc5a4b6b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9f7 expref: 10 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.156098:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d67af17a/0xfeec3c2dc5a4b6b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9f7 expref: 10 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191890.156129:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233157480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827957376:192.168.204.16@tcp:105: 00000100:00100000:0.0:1784191890.156215:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233dd7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784191890.175274:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.175456:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812377600 00000100:00100000:2.0:1784191890.175466:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812377600 00000100:00100000:2.0:1784191890.175536:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 144 00000100:00100000:2.0:1784191890.175548:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1099f4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:123690:x1870858812377600:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191890.175974:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1099f4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:123690:x1870858812377600:12345-192.168.204.16@tcp:35:cp.0 Request processed in 427us (711us total) trans 34359738667 rc 0/0 00000100:00100000:2.0:1784191890.175983:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 144 00000100:00100000:0.0:1784191890.184070:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233157480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827957376:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191890.184105:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191890.184317:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210303800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+10:69111:x1870858812377344:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 28367us (28572us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191890.184331:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 137 00000100:00100000:2.0:1784191890.185125:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.185550:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812377728 00000100:00100000:1.0:1784191890.185560:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812377728 00000100:00100000:1.0:1784191890.185641:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 539 00000100:00100000:1.0:1784191890.185651:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:123690:x1870858812377728:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.185679:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.185739:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4b6bc lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b9fe expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.185946:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b6c3 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.185961:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b6c3 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.185974:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b6c3 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.185989:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b6ca lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.185995:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b6ca lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.186001:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b6ca lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.186045:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b6c3 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.186067:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b6c3 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.186074:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b6c3 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.186081:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b6c3 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.186087:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.186091:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b6c3 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.186099:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b6c3 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.186112:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.186115:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.186120:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b6c3 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.186127:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b6c3 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.186142:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b6ca lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.186148:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b6ca lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.186153:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b6ca lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.186164:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.186167:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b6ca lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.186173:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b6ca lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.186182:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x15c8a56e (ffff8af20db3d500) 00010000:00010000:1.0:1784191890.186184:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.186187:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b6ca lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.186193:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b6ca lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.186227:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4b6bc lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9fe expref: 45 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.186237:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.186239:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.186243:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4b6bc lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9fe expref: 45 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.186252:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4800, rc 0) 00000100:00100000:1.0:1784191890.186312:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:123690:x1870858812377728:12345-192.168.204.16@tcp:101:cp.0 Request processed in 662us (1192us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191890.186319:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 539 00000100:00100000:3.0:1784191890.190087:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.190289:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812377856 00000100:00100000:2.0:1784191890.190302:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812377856 00000100:00100000:2.0:1784191890.190366:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 540 00000100:00100000:2.0:1784191890.190377:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:123690:x1870858812377856:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191890.190402:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191890.190426:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b6d1 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba05 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.190519:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b6d8 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.190535:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b6d8 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.190547:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b6d8 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.190575:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b6df lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.190583:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b6df lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.190601:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b6df lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.190649:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b6d8 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.190656:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b6d8 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.190663:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b6d8 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.190669:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b6d8 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.190675:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.190680:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b6d8 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.190732:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b6d8 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.190748:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.190750:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.190766:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b6d8 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.190780:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b6d8 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.190798:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b6df lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.190804:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b6df lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.190809:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b6df lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.191511:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.191515:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b6df lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.191522:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b6df lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.191534:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x15c8a56e (ffff8af207498100) 00010000:00010000:2.0:1784191890.191537:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.191540:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b6df lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.191546:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b6df lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.191604:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b6d1 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba05 expref: 45 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.191631:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.191634:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.191638:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b6d1 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba05 expref: 45 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.191648:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6000, rc 0) 00000100:00100000:2.0:1784191890.192638:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:123690:x1870858812377856:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2253us (2554us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191890.192651:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 540 00000100:00100000:2.0:1784191890.197803:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191890.197960:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812378112 00000100:00100000:0.0:1784191890.197972:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812378112 00000100:00100000:0.0:1784191890.198041:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 541 00000100:00100000:0.0:1784191890.198052:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:123690:x1870858812378112:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191890.198075:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191890.198096:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532600/0xfeec3c2dc5a4b6e6 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba0c expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.198229:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4b6ed lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.198246:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4b6ed lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.198258:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4b6ed lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.198275:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4b6f4 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.198282:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4b6f4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.198287:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4b6f4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191890.202092:0:158665:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1c6:0x0], index 1: 0 00080000:00000400:0.0:1784191890.202113:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191890.202117:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191890.202120:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191890.202122:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191890.202124:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191890.202126:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191890.202144:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191890.202147:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191890.202149:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191890.202151:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191890.202153:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191890.202155:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191890.202191:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191890.202194:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191890.202196:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191890.202197:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191890.202199:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191890.202201:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191890.202332:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533600/0xfeec3c2dc5a4b6fb lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.202350:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533600/0xfeec3c2dc5a4b6fb lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.202361:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533600/0xfeec3c2dc5a4b6fb lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.202400:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4b6ed lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.202428:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4b6ed lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.202434:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4b6ed lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.202452:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4b6ed lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.202458:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d532000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191890.202463:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4b6ed lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.202471:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4b6ed lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.202486:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191890.202490:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191890.202494:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4b6ed lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.202501:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4b6ed lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191890.202521:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000068f00710 reply state 00000000d4c3c9ab transno 34359738668 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4b6f4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.202533:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4b6f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.202538:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x15c8a56e (ffff8af203904300) 00010000:00010000:0.0:1784191890.202546:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191890.202549:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191890.202599:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532600/0xfeec3c2dc5a4b6e6 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba0c expref: 47 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.202616:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533600/0xfeec3c2dc5a4b6fb lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba0c expref: 46 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.202624:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x9:0x0].0x0 (ffff8af203904100) 00010000:00010000:0.0:1784191890.202627:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191890.202629:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d533600, rc 0) 00000100:00100000:0.0:1784191890.202758:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+47:123690:x1870858812378112:12345-192.168.204.16@tcp:101:cp.0 Request processed in 4707us (4968us total) trans 34359738668 rc 0/0 00000100:00100000:0.0:1784191890.202768:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 541 00000100:00100000:3.0:1784191890.207639:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.213904:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812378240 00000100:00100000:1.0:1784191890.213941:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812378240 00000100:00100000:1.0:1784191890.214008:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 261 00000100:00100000:1.0:1784191890.214019:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69111:x1870858812378240:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.214039:0:162395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.214061:0:162395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4b709 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba13 expref: -99 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784191890.214089:0:162395:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191890.214111:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c6:0x0].0x0 since=5510s v=(0 0) 00010000:00010000:1.0:1784191890.214115:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191890.214127:0:162395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4b709 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba13 expref: 10 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.214147:0:162395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4b709 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba13 expref: 10 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.214161:0:162395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4800, rc 0) 00000100:00100000:1.0:1784191890.214262:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+10:69111:x1870858812378240:12345-192.168.204.16@tcp:101:cp.0 Request processed in 245us (6636us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191890.214270:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 261 00000100:00100000:3.0:1784191890.228392:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191890.228576:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812378368 00000100:00100000:0.0:1784191890.228595:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812378368 00000100:00100000:0.0:1784191890.228673:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 262 00000100:00100000:0.0:1784191890.228683:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+10:123690:x1870858812378368:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191890.228744:0:162385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191890.228766:0:162385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003b5ef39/0xfeec3c2dc5a4b710 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba1a expref: -99 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.228803:0:162385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4b709 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba13 expref: 11 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.228823:0:162385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191890.228828:0:162385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191890.228853:0:162385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003b5ef39/0xfeec3c2dc5a4b710 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba1a expref: 11 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.228932:0:162385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4b709 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba13 expref: 11 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.228952:0:162385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4b709 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba13 expref: 11 pid: 162395 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191890.228984:0:162385:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:162385:1870858827957504:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191890.229081:0:162385:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10d302300 going to sleep for 11 seconds 00000100:00100000:3.0:1784191890.233878:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.233968:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812378496 00000100:00100000:2.0:1784191890.233978:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812378496 00000100:00100000:1.0:1784191890.234007:0:162385:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:162385:1870858827957504:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191890.234027:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4b709 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba13 expref: 12 pid: 162395 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.234043:0:162385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000003b5ef39/0xfeec3c2dc5a4b710 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba1a expref: 12 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.234064:0:162385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d532600, rc 0) 00000100:00100000:2.0:1784191890.234078:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 138 00000100:00100000:2.0:1784191890.234090:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:69110:x1870858812378496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1784191890.234139:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:123690:x1870858812378368:12345-192.168.204.16@tcp:101:cp.0 Request processed in 5457us (5758us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191890.234148:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 262 00010000:00010000:2.0:1784191890.234882:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191890.234914:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4b709 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba13 expref: 11 pid: 162395 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.234931:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4b709 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba13 expref: 11 pid: 162395 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.234957:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4b709 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba13 expref: 11 pid: 162395 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.234992:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.234997:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.235004:0:158652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000003b5ef39/0xfeec3c2dc5a4b710 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba1a expref: 10 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.235014:0:158652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003b5ef39/0xfeec3c2dc5a4b710 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba1a expref: 10 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.235050:0:158652:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000003b5ef39/0xfeec3c2dc5a4b710 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba1a expref: 10 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191890.235065:0:158652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de44e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:158652:1870858827957632:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191890.235273:0:158652:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db180 going to sleep for 11 seconds 00000100:00100000:2.0:1784191890.247143:0:158652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de44e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:158652:1870858827957632:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191890.247175:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191890.247238:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+10:69110:x1870858812378496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 13149us (13371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191890.247250:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 138 00000100:00100000:3.0:1784191890.248055:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.248178:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812378752 00000100:00100000:2.0:1784191890.248185:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812378752 00000100:00100000:2.0:1784191890.248238:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 145 00000100:00100000:2.0:1784191890.248247:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+47:123690:x1870858812378752:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191890.248563:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+48:123690:x1870858812378752:12345-192.168.204.16@tcp:35:cp.0 Request processed in 315us (509us total) trans 34359738669 rc 0/0 00000100:00100000:2.0:1784191890.248580:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 145 00000100:00100000:0.0:1784191890.258605:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.258808:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812378880 00000100:00100000:2.0:1784191890.258930:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812378880 00000100:00100000:2.0:1784191890.259011:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 542 00000100:00100000:2.0:1784191890.259022:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+48:123690:x1870858812378880:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191890.259051:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191890.259073:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b717 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba21 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259159:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b71e lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259173:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b71e lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259186:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b71e lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259200:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b725 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259206:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b725 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259213:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b725 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259260:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b71e lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259290:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b71e lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259296:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b71e lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259302:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b71e lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259307:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.259312:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b71e lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259318:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b71e lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259331:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.259334:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.259338:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b71e lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259343:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b71e lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259358:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b725 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259363:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b725 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259367:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b725 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259378:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.259381:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b725 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259385:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b725 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259393:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe7eb4718 (ffff8af207498100) 00010000:00010000:2.0:1784191890.259395:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.259398:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b725 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259403:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b725 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259438:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b717 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba21 expref: 49 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259448:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.259451:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.259454:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b717 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba21 expref: 49 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.259463:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6000, rc 0) 00000100:00100000:2.0:1784191890.259533:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+48:123690:x1870858812378880:12345-192.168.204.16@tcp:101:cp.0 Request processed in 512us (948us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191890.259541:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 542 00000100:00100000:0.0:1784191890.265210:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.265547:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812379008 00000100:00100000:2.0:1784191890.265572:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812379008 00000100:00100000:2.0:1784191890.265646:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 543 00000100:00100000:2.0:1784191890.265656:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+48:123690:x1870858812379008:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191890.265680:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191890.265721:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b72c lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba28 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.265996:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b733 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266012:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b733 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266024:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b733 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266039:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b73a lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266046:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b73a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266052:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b73a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266183:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b733 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266191:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b733 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266197:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b733 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266212:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b733 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266218:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.266222:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b733 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266230:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b733 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266242:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.266245:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.266250:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b733 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266257:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b733 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266271:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b73a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266277:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b73a lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266283:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b73a lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266287:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.266290:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b73a lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266306:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b73a lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266314:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe7eb4718 (ffff8af207498100) 00010000:00010000:2.0:1784191890.266317:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.266319:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b73a lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266325:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b73a lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266358:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b72c lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba28 expref: 49 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266368:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.266371:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.266375:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b72c lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba28 expref: 49 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.266384:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6000, rc 0) 00000100:00100000:2.0:1784191890.266443:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+48:123690:x1870858812379008:12345-192.168.204.16@tcp:101:cp.0 Request processed in 788us (1246us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191890.266451:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 543 00000100:00100000:3.0:1784191890.272161:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191890.272307:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812379264 00000100:00100000:0.0:1784191890.272318:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812379264 00000100:00100000:0.0:1784191890.272389:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 544 00000100:00100000:0.0:1784191890.272400:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+48:123690:x1870858812379264:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191890.272423:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191890.272444:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532400/0xfeec3c2dc5a4b741 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba2f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.272565:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b748 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.272582:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b748 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.272611:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b748 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.272628:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4b74f lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.272636:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4b74f lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.272641:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4b74f lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191890.273408:0:158665:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x24a:0x0], index 0: 0 00080000:00000400:0.0:1784191890.273422:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191890.273425:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191890.273427:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191890.273429:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191890.273431:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191890.273433:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191890.273450:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191890.273453:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191890.273455:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191890.273457:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191890.273459:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191890.273460:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191890.273487:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191890.273490:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191890.273492:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191890.273494:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191890.273496:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191890.273498:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191890.273605:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533000/0xfeec3c2dc5a4b756 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.273618:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533000/0xfeec3c2dc5a4b756 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.273626:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533000/0xfeec3c2dc5a4b756 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.273663:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b748 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.273683:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b748 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.274036:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b748 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.274043:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b748 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.274050:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191890.274055:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b748 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.274062:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b748 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.274074:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191890.274078:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191890.274082:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b748 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.274089:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b748 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191890.274681:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f67ce51 reply state 00000000f3254081 transno 34359738670 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4b74f lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.274915:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4b74f lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.274923:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe7eb4718 (ffff8af203904900) 00010000:00010000:0.0:1784191890.274936:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191890.274940:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191890.274987:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532400/0xfeec3c2dc5a4b741 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba2f expref: 51 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.275005:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533000/0xfeec3c2dc5a4b756 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba2f expref: 50 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.275013:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0xa:0x0].0x0 (ffff8af203904a00) 00010000:00010000:0.0:1784191890.275014:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191890.275017:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d533000, rc 0) 00000100:00100000:0.0:1784191890.275894:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+51:123690:x1870858812379264:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2697us (2943us total) trans 34359738670 rc 0/0 00000100:00100000:0.0:1784191890.275906:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 544 00000100:00100000:0.0:1784191890.286663:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.286964:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812379392 00000100:00100000:2.0:1784191890.286975:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812379392 00000100:00100000:2.0:1784191890.287042:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 263 00000100:00100000:2.0:1784191890.287051:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+10:69109:x1870858812379392:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191890.287088:0:160166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191890.287111:0:160166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b764 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba36 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191890.287135:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191890.287156:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24a:0x0].0x0 since=5510s v=(0 0) 00010000:00010000:2.0:1784191890.287161:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.287171:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b764 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba36 expref: 11 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.287189:0:160166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b764 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba36 expref: 11 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.287203:0:160166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6000, rc 0) 00000100:00100000:2.0:1784191890.287270:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:69109:x1870858812379392:12345-192.168.204.16@tcp:101:cp.0 Request processed in 219us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191890.287278:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 263 00000100:00100000:3.0:1784191890.294848:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191890.295304:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812379520 00000100:00100000:0.0:1784191890.295317:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812379520 00000100:00100000:0.0:1784191890.295391:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 264 00000100:00100000:0.0:1784191890.295403:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:123690:x1870858812379520:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191890.295423:0:162396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191890.295444:0:162396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009548de5/0xfeec3c2dc5a4b76b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba3d expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.295481:0:162396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b764 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba36 expref: 12 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.295492:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191890.295509:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191890.295515:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009548de5/0xfeec3c2dc5a4b76b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba3d expref: 12 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.295555:0:162396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b764 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba36 expref: 12 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.295571:0:162396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b764 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba36 expref: 12 pid: 160166 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191890.295596:0:162396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:162396:1870858827957760:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191890.299031:0:162396:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111502780 going to sleep for 11 seconds 00000100:00100000:1.0:1784191890.300251:0:162396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:162396:1870858827957760:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191890.300293:0:162396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000009548de5/0xfeec3c2dc5a4b76b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba3d expref: 12 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.300316:0:162396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d532400, rc 0) 00000100:00100000:1.0:1784191890.300435:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:123690:x1870858812379520:12345-192.168.204.16@tcp:101:cp.0 Request processed in 5033us (5598us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191890.300445:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 264 00000100:00100000:3.0:1784191890.304678:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.305249:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812379648 00000100:00100000:2.0:1784191890.305265:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812379648 00010000:00010000:2.0:1784191890.305311:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b764 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba36 expref: 12 pid: 160166 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191890.305353:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 139 00000100:00100000:2.0:1784191890.305363:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af202d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:69112:x1870858812379648:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191890.305380:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191890.305421:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b764 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba36 expref: 12 pid: 160166 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.305437:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b764 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba36 expref: 12 pid: 160166 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.305463:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fc68669/0xfeec3c2dc5a4b764 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba36 expref: 12 pid: 160166 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.305481:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.305486:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.305494:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000009548de5/0xfeec3c2dc5a4b76b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba3d expref: 11 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.305504:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009548de5/0xfeec3c2dc5a4b76b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba3d expref: 11 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.305541:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000009548de5/0xfeec3c2dc5a4b76b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba3d expref: 11 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191890.305557:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de44e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827957888:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191890.305659:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db180 going to sleep for 11 seconds 00000100:00100000:3.0:1784191890.309412:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.309551:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de44e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827957888:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191890.309592:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191890.309667:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af202d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:69112:x1870858812379648:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4303us (4998us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191890.309747:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 139 00000100:00100000:0.0:1784191890.311745:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812379904 00000100:00100000:0.0:1784191890.311761:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812379904 00000100:00100000:0.0:1784191890.311844:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 146 00000100:00100000:0.0:1784191890.311855:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+51:123690:x1870858812379904:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:1.0:1784191890.312580:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+52:123690:x1870858812379904:12345-192.168.204.16@tcp:35:cp.0 Request processed in 723us (3180us total) trans 34359738671 rc 0/0 00000100:00100000:1.0:1784191890.312599:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 146 00000100:00100000:1.0:1784191890.328107:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191890.328287:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812380032 00000100:00100000:0.0:1784191890.328302:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812380032 00000100:00100000:0.0:1784191890.328373:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 545 00000100:00100000:0.0:1784191890.328384:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+52:123690:x1870858812380032:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191890.328412:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191890.328441:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4b772 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba44 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328511:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b779 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328528:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b779 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328554:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b779 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328570:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533800/0xfeec3c2dc5a4b780 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328577:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533800/0xfeec3c2dc5a4b780 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328595:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533800/0xfeec3c2dc5a4b780 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328645:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b779 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328652:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b779 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328659:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b779 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328666:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b779 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328673:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191890.328678:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b779 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328686:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b779 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328747:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191890.328756:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191890.328762:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b779 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328770:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b779 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328787:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533800/0xfeec3c2dc5a4b780 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328793:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533800/0xfeec3c2dc5a4b780 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328798:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533800/0xfeec3c2dc5a4b780 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328803:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191890.328806:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533800/0xfeec3c2dc5a4b780 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328821:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533800/0xfeec3c2dc5a4b780 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328829:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x48840fb6 (ffff8af203904000) 00010000:00010000:0.0:1784191890.328831:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191890.328834:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533800/0xfeec3c2dc5a4b780 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328840:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533800/0xfeec3c2dc5a4b780 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328875:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4b772 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba44 expref: 53 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328893:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191890.328895:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191890.328899:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4b772 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba44 expref: 53 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.328910:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d532800, rc 0) 00000100:00100000:0.0:1784191890.328977:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+52:123690:x1870858812380032:12345-192.168.204.16@tcp:101:cp.0 Request processed in 595us (895us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191890.328984:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 545 00000100:00100000:0.0:1784191890.343522:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.343784:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812380160 00000100:00100000:2.0:1784191890.343794:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812380160 00000100:00100000:2.0:1784191890.343871:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 546 00000100:00100000:2.0:1784191890.343883:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+52:123690:x1870858812380160:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191890.343907:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191890.343928:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b787 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba4b expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.343996:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b78e lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344011:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b78e lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344024:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b78e lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344038:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b795 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344045:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b795 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344051:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b795 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344093:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b78e lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344133:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b78e lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344139:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b78e lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344145:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b78e lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344151:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.344155:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b78e lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344163:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b78e lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344176:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.344179:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.344183:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b78e lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344190:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b78e lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344203:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b795 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344208:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b795 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344213:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b795 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344224:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.344227:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b795 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344233:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b795 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344241:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x48840fb6 (ffff8af207498200) 00010000:00010000:2.0:1784191890.344244:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.344246:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b795 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344253:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b795 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344291:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b787 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba4b expref: 53 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344301:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.344303:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.344306:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b787 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba4b expref: 53 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.344316:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6000, rc 0) 00000100:00100000:2.0:1784191890.344393:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+52:123690:x1870858812380160:12345-192.168.204.16@tcp:101:cp.0 Request processed in 511us (890us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191890.344400:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 546 00000100:00100000:3.0:1784191890.347891:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191890.349475:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812380416 00000100:00100000:0.0:1784191890.349489:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812380416 00000100:00100000:1.0:1784191890.349944:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 547 00000100:00100000:1.0:1784191890.349957:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+52:123690:x1870858812380416:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.349982:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.350006:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4b79c lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba52 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.350179:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b7a3 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.350195:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b7a3 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.350208:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b7a3 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.350223:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4b7aa lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.350229:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4b7aa lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.350235:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4b7aa lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191890.350615:0:158665:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1c7:0x0], index 1: 0 00080000:00000400:1.0:1784191890.350632:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191890.350635:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191890.350637:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191890.350639:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191890.350641:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191890.350643:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191890.350671:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191890.350674:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191890.350676:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191890.350678:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191890.350680:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191890.350681:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191890.350748:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191890.350750:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191890.350763:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191890.350765:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191890.350767:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191890.350769:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191890.351337:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4b7b1 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.351353:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4b7b1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.351363:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4b7b1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.351401:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b7a3 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.351409:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b7a3 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.351415:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b7a3 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.351422:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b7a3 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.351428:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.351442:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b7a3 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.351450:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b7a3 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.351463:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.351467:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.351471:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b7a3 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.351478:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b7a3 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191890.351492:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004b3cee98 reply state 00000000c9849328 transno 34359738672 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4b7aa lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.351930:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4b7aa lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.351939:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x48840fb6 (ffff8af20db3d300) 00010000:00010000:1.0:1784191890.351941:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191890.351944:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191890.351988:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4b79c lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba52 expref: 55 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.352004:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4b7b1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba52 expref: 54 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.352012:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0xb:0x0].0x0 (ffff8af20db3d200) 00010000:00010000:1.0:1784191890.352014:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191890.352026:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4000, rc 0) 00000100:00100000:1.0:1784191890.352303:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+55:123690:x1870858812380416:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2347us (4426us total) trans 34359738672 rc 0/0 00000100:00100000:1.0:1784191890.352312:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 547 00000100:00100000:3.0:1784191890.360425:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191890.360562:0:162390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812380544 00000100:00100000:0.0:1784191890.360572:0:162390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812380544 00000100:00100000:0.0:1784191890.360651:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 265 00000100:00100000:0.0:1784191890.360661:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+10:69111:x1870858812380544:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191890.360680:0:162390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191890.360729:0:162390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b7bf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba59 expref: -99 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191890.360767:0:162390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191890.360788:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c7:0x0].0x0 since=5510s v=(0 0) 00010000:00010000:0.0:1784191890.360793:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191890.360804:0:162390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b7bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba59 expref: 11 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.360855:0:162390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b7bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba59 expref: 11 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.360869:0:162390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d532800, rc 0) 00000100:00100000:0.0:1784191890.360939:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:69111:x1870858812380544:12345-192.168.204.16@tcp:101:cp.0 Request processed in 279us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191890.360946:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 265 00000100:00100000:3.0:1784191890.377464:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191890.377575:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812380672 00000100:00100000:0.0:1784191890.377595:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812380672 00000100:00100000:0.0:1784191890.377669:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 266 00000100:00100000:0.0:1784191890.377682:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:123690:x1870858812380672:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191890.377742:0:160165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191890.377776:0:160165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002354354a/0xfeec3c2dc5a4b7c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba60 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.377824:0:160165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b7bf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba59 expref: 12 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.377833:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191890.377837:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191890.377842:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002354354a/0xfeec3c2dc5a4b7c6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba60 expref: 12 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.377883:0:160165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b7bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba59 expref: 12 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.377916:0:160165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b7bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba59 expref: 12 pid: 162390 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191890.377933:0:160165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:160165:1870858827958016:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191890.378030:0:160165:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111502300 going to sleep for 11 seconds 00000100:00100000:3.0:1784191890.381540:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.381617:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812380800 00000100:00100000:1.0:1784191890.381627:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812380800 00010000:00010000:1.0:1784191890.381669:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b7bf lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba59 expref: 13 pid: 162390 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191890.381753:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 140 00000100:00100000:1.0:1784191890.381775:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:69110:x1870858812380800:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191890.381795:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191890.381833:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b7bf lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba59 expref: 13 pid: 162390 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.381851:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b7bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba59 expref: 13 pid: 162390 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.381880:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191890.381884:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191890.381893:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002354354a/0xfeec3c2dc5a4b7c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba60 expref: 13 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.381902:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002354354a/0xfeec3c2dc5a4b7c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba60 expref: 13 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.381965:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002354354a/0xfeec3c2dc5a4b7c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba60 expref: 13 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191890.381980:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827958144:192.168.204.16@tcp:105: 00000100:00100000:1.0:1784191890.382058:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2065f0180 going to sleep for 11 seconds 00010000:00010000:0.0:1784191890.382361:0:160165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b7bf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba59 expref: 13 pid: 162390 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191890.382377:0:160165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:160165:1870858827958016:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191890.382405:0:160165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002354354a/0xfeec3c2dc5a4b7c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba60 expref: 12 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.382416:0:160165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d533800, rc 0) 00000100:00100000:0.0:1784191890.382450:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:123690:x1870858812380672:12345-192.168.204.16@tcp:101:cp.0 Request processed in 4771us (4998us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191890.382459:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 266 00000100:00100000:1.0:1784191890.391410:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191890.391492:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812381056 00000100:00100000:3.0:1784191890.391503:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812381056 00000100:00100000:3.0:1784191890.391565:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 147 00000100:00100000:3.0:1784191890.391575:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+55:123690:x1870858812381056:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191890.392064:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+56:123690:x1870858812381056:12345-192.168.204.16@tcp:35:cp.0 Request processed in 488us (662us total) trans 34359738673 rc 0/0 00000100:00100000:3.0:1784191890.392074:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 147 00000100:00100000:2.0:1784191890.392759:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827958144:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191890.392818:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191890.392868:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:69110:x1870858812380800:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 11095us (11338us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191890.392878:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 140 00000100:00100000:1.0:1784191890.396994:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.398962:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812381184 00000100:00100000:2.0:1784191890.398977:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812381184 00000100:00100000:2.0:1784191890.399062:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 548 00000100:00100000:2.0:1784191890.399081:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+56:123690:x1870858812381184:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191890.399110:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191890.399134:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b7cd lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba67 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399207:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b7d4 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399222:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b7d4 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399232:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b7d4 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399246:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6c00/0xfeec3c2dc5a4b7db lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399253:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6c00/0xfeec3c2dc5a4b7db lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399260:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6c00/0xfeec3c2dc5a4b7db lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399330:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b7d4 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399337:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b7d4 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399344:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b7d4 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399350:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b7d4 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399356:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.399360:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b7d4 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399367:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b7d4 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399380:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.399383:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.399387:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b7d4 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399395:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b7d4 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399410:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6c00/0xfeec3c2dc5a4b7db lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399418:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6c00/0xfeec3c2dc5a4b7db lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399432:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6c00/0xfeec3c2dc5a4b7db lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399437:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d6c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.399440:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6c00/0xfeec3c2dc5a4b7db lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399446:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6c00/0xfeec3c2dc5a4b7db lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399454:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x48e4a31f (ffff8af207498200) 00010000:00010000:2.0:1784191890.399456:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.399459:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6c00/0xfeec3c2dc5a4b7db lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399465:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6c00/0xfeec3c2dc5a4b7db lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399499:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b7cd lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba67 expref: 57 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399510:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.399512:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.399515:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b7cd lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba67 expref: 57 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.399523:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7000, rc 0) 00000100:00100000:2.0:1784191890.399606:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+56:123690:x1870858812381184:12345-192.168.204.16@tcp:101:cp.0 Request processed in 527us (2623us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191890.399623:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 548 00000100:00100000:3.0:1784191890.402905:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191890.403016:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812381312 00000100:00100000:0.0:1784191890.403027:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812381312 00000100:00100000:0.0:1784191890.403101:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 549 00000100:00100000:0.0:1784191890.403112:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+56:123690:x1870858812381312:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191890.403133:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191890.403155:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4b7e2 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba6e expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403263:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4b7e9 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403279:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4b7e9 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403290:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4b7e9 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403307:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b7f0 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403314:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b7f0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403320:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b7f0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403364:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4b7e9 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403371:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4b7e9 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403377:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4b7e9 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403384:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4b7e9 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403390:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d532800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191890.403400:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4b7e9 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403409:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4b7e9 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403423:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191890.403426:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191890.403431:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4b7e9 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403437:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4b7e9 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403454:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b7f0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403461:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b7f0 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403466:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b7f0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403470:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191890.403473:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b7f0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403479:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b7f0 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403484:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x48e4a31f (ffff8af203904e00) 00010000:00010000:0.0:1784191890.403486:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191890.403495:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b7f0 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403501:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b7f0 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403548:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4b7e2 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba6e expref: 57 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403559:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191890.403561:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191890.403564:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4b7e2 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba6e expref: 57 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.403573:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d532000, rc 0) 00000100:00100000:0.0:1784191890.403648:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+56:123690:x1870858812381312:12345-192.168.204.16@tcp:101:cp.0 Request processed in 538us (753us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191890.403655:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 549 00000100:00100000:1.0:1784191890.416010:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191890.416332:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812381568 00000100:00100000:3.0:1784191890.416345:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812381568 00000100:00100000:3.0:1784191890.416420:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 550 00000100:00100000:3.0:1784191890.416433:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+56:123690:x1870858812381568:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191890.416458:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191890.416489:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b7f7 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba75 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.419078:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b7fe lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.419105:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b7fe lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.419120:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b7fe lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.419142:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4b805 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.419150:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4b805 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.419157:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4b805 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191890.420186:0:158665:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x24b:0x0], index 0: 0 00080000:00000400:3.0:1784191890.420207:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191890.420211:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191890.420214:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191890.420216:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191890.420218:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191890.420219:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191890.420240:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191890.420243:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191890.420245:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191890.420247:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191890.420248:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191890.420269:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191890.420314:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191890.420318:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191890.420319:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191890.420321:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191890.420323:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191890.420325:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191890.420454:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4b80c lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.420467:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4b80c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.420477:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4b80c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.431995:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b7fe lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.432014:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b7fe lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.432022:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b7fe lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.432029:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b7fe lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.432034:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af110db3c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.432039:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b7fe lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.432047:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b7fe lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.432063:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.432066:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.432070:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b7fe lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.432076:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4b7fe lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191890.432093:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000064dc8462 reply state 00000000ba4c2bd1 transno 34359738674 ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4b805 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.432127:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4b805 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.432134:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x48e4a31f (ffff8af110071f00) 00010000:00010000:2.0:1784191890.432137:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191890.432140:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191890.432191:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4b7f7 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba75 expref: 59 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.432206:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4b80c lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba75 expref: 58 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.432214:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0xc:0x0].0x0 (ffff8af110071200) 00010000:00010000:2.0:1784191890.432216:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191890.432218:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db2c00, rc 0) 00000100:00100000:2.0:1784191890.432292:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+59:123690:x1870858812381568:12345-192.168.204.16@tcp:101:cp.0 Request processed in 15861us (16294us total) trans 34359738674 rc 0/0 00000100:00100000:2.0:1784191890.432300:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 550 00000100:00100000:2.0:1784191890.451993:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.452216:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812381696 00000100:00100000:1.0:1784191890.452231:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812381696 00000100:00100000:1.0:1784191890.452367:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 267 00000100:00100000:1.0:1784191890.452380:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:69109:x1870858812381696:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.452400:0:162389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.452424:0:162389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4b81a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba7c expref: -99 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784191890.452450:0:162389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191890.452471:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24b:0x0].0x0 since=5510s v=(0 0) 00010000:00010000:1.0:1784191890.452476:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191890.452487:0:162389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4b81a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba7c expref: 12 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.452517:0:162389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4b81a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba7c expref: 12 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.452553:0:162389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4400, rc 0) 00000100:00100000:1.0:1784191890.452634:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:69109:x1870858812381696:12345-192.168.204.16@tcp:101:cp.0 Request processed in 256us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191890.452641:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 267 00000100:00100000:3.0:1784191890.460000:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.460261:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812381824 00000100:00100000:2.0:1784191890.460275:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812381824 00000100:00100000:2.0:1784191890.460346:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 268 00000100:00100000:2.0:1784191890.460357:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:123690:x1870858812381824:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191890.460378:0:162392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191890.460398:0:162392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f090523/0xfeec3c2dc5a4b821 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba83 expref: -99 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.460446:0:162392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4b81a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba7c expref: 13 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.460455:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.460459:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.460464:0:162392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f090523/0xfeec3c2dc5a4b821 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba83 expref: 13 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.463805:0:162392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4b81a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba7c expref: 13 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.463840:0:162392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4b81a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba7c expref: 13 pid: 162389 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191890.463871:0:162392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:162392:1870858827958272:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191890.463979:0:162392:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db600 going to sleep for 11 seconds 00000100:00100000:2.0:1784191890.480934:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.481070:0:162392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:162392:1870858827958272:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191890.481109:0:162392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f090523/0xfeec3c2dc5a4b821 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba83 expref: 13 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.481134:0:162392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6c00, rc 0) 00000100:00100000:1.0:1784191890.481206:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:123690:x1870858812381824:12345-192.168.204.16@tcp:101:cp.0 Request processed in 20851us (21220us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191890.481216:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 268 00000100:00100000:3.0:1784191890.486026:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812381952 00000100:00100000:3.0:1784191890.486044:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812381952 00010000:00010000:3.0:1784191890.486103:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4b81a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba7c expref: 13 pid: 162389 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191890.486159:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 141 00000100:00100000:3.0:1784191890.486169:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:69112:x1870858812381952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191890.486186:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191890.486213:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4b81a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba7c expref: 13 pid: 162389 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.486230:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4b81a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba7c expref: 13 pid: 162389 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.486283:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4b81a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba7c expref: 13 pid: 162389 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.486303:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191890.486308:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191890.486317:0:158652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f090523/0xfeec3c2dc5a4b821 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba83 expref: 12 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.486328:0:158652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f090523/0xfeec3c2dc5a4b821 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba83 expref: 12 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.487074:0:158652:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002f090523/0xfeec3c2dc5a4b821 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba83 expref: 12 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191890.487094:0:158652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1010bb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:158652:1870858827958400:192.168.204.16@tcp:105: 00000100:00100000:3.0:1784191890.487214:0:158652:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35240 going to sleep for 11 seconds 00000100:00100000:3.0:1784191890.495159:0:158652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1010bb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:158652:1870858827958400:192.168.204.16@tcp:105: 00010000:00010000:3.0:1784191890.495190:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191890.495257:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:69112:x1870858812381952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 9089us (14335us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191890.495270:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 141 00000100:00100000:0.0:1784191890.497123:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191890.497217:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812382208 00000100:00100000:3.0:1784191890.497227:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812382208 00000100:00100000:3.0:1784191890.497290:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 148 00000100:00100000:3.0:1784191890.497319:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+59:123690:x1870858812382208:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191890.497988:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+60:123690:x1870858812382208:12345-192.168.204.16@tcp:35:cp.0 Request processed in 666us (871us total) trans 34359738675 rc 0/0 00000100:00100000:3.0:1784191890.497998:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 148 00000100:00100000:2.0:1784191890.510116:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1784191890.510280:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191890.512408:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812382336 00000100:00100000:0.0:1784191890.512426:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812382336 00000100:00100000:1.0:1784191890.515372:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 551 00000100:00100000:1.0:1784191890.515389:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+60:123690:x1870858812382336:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.515419:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.515445:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4b828 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba8a expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515521:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4b82f lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515538:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4b82f lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515572:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4b82f lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515599:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b836 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515606:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b836 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515613:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b836 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515677:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4b82f lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515685:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4b82f lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515726:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4b82f lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515733:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4b82f lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515740:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.515745:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4b82f lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515761:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4b82f lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515775:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.515785:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.515790:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4b82f lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515798:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4b82f lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515815:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b836 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515822:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b836 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515827:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b836 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515831:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.515834:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b836 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515840:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b836 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515847:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xbf79d746 (ffff8af202c46a00) 00010000:00010000:1.0:1784191890.515861:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.515864:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b836 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515869:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4b836 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515908:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4b828 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba8a expref: 61 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515928:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.515930:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.515934:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4b828 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba8a expref: 61 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.515945:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5c00, rc 0) 00000100:00100000:1.0:1784191890.516030:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+60:123690:x1870858812382336:12345-192.168.204.16@tcp:101:cp.0 Request processed in 645us (5928us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191890.516038:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 551 00000100:00100000:0.0:1784191890.529476:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.529551:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812382464 00000100:00100000:1.0:1784191890.529562:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812382464 00000100:00100000:1.0:1784191890.529636:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 552 00000100:00100000:1.0:1784191890.529655:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af112196c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+60:123690:x1870858812382464:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.529676:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.529728:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4b83d lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba91 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.529794:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b844 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.529807:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b844 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.529818:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b844 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.529833:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b84b lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.529985:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b84b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.529992:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b84b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.530036:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b844 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.530043:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b844 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.530049:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b844 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.530055:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b844 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.530061:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.530065:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b844 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.530072:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b844 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.530084:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.530087:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.530092:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b844 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.530100:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4b844 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.530125:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b84b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.530131:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b84b lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.530149:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b84b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.530154:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.530158:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b84b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.530163:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b84b lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.530171:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xbf79d746 (ffff8af202c46e00) 00010000:00010000:1.0:1784191890.530173:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.530176:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b84b lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.530181:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4b84b lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.530219:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4b83d lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba91 expref: 61 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.530233:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.530236:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.530248:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4b83d lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba91 expref: 61 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.530261:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5800, rc 0) 00000100:00100000:1.0:1784191890.530381:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af112196c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+60:123690:x1870858812382464:12345-192.168.204.16@tcp:101:cp.0 Request processed in 736us (915us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191890.530389:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 552 00000100:00100000:2.0:1784191890.547444:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.547523:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812382720 00000100:00100000:1.0:1784191890.547535:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812382720 00000100:00100000:1.0:1784191890.547606:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 553 00000100:00100000:1.0:1784191890.547617:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+60:123690:x1870858812382720:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.547640:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.547674:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b852 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba98 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.547828:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b859 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.547844:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b859 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.548029:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b859 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.548046:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4b860 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.548054:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4b860 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.548059:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4b860 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191890.548413:0:158665:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1c8:0x0], index 1: 0 00080000:00000400:1.0:1784191890.548427:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191890.548431:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191890.548433:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191890.548435:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191890.548437:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191890.548439:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191890.548456:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191890.548459:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191890.548461:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191890.548463:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191890.548465:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191890.548467:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191890.548496:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191890.548499:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191890.548500:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191890.548502:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191890.548504:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191890.548506:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191890.548616:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5400/0xfeec3c2dc5a4b867 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.548627:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5400/0xfeec3c2dc5a4b867 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.548635:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5400/0xfeec3c2dc5a4b867 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.548673:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b859 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.549020:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b859 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.549030:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b859 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.549038:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b859 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.549044:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.549048:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b859 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.549057:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b859 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.549071:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.549074:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.549079:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b859 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.549087:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4b859 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191890.549103:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ddb74cae reply state 000000002f9e4d82 transno 34359738676 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4b860 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.549115:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4b860 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.549121:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xbf79d746 (ffff8af202c46400) 00010000:00010000:1.0:1784191890.549130:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191890.549263:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191890.549305:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4b852 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba98 expref: 63 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.549322:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5400/0xfeec3c2dc5a4b867 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba98 expref: 62 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.549330:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0xd:0x0].0x0 (ffff8af202c46200) 00010000:00010000:1.0:1784191890.549332:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191890.549334:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5400, rc 0) 00000100:00100000:1.0:1784191890.549466:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+63:123690:x1870858812382720:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1849us (2031us total) trans 34359738676 rc 0/0 00000100:00100000:1.0:1784191890.549475:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 553 00000100:00100000:2.0:1784191890.559025:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.559232:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812382848 00000100:00100000:1.0:1784191890.559244:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812382848 00000100:00100000:1.0:1784191890.559316:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 269 00000100:00100000:1.0:1784191890.559328:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:69112:x1870858812382848:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.559351:0:162395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.559394:0:162395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4b875 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8ba9f expref: -99 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784191890.559426:0:162395:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191890.559448:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c8:0x0].0x0 since=5510s v=(0 0) 00010000:00010000:1.0:1784191890.559453:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191890.559465:0:162395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4b875 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba9f expref: 12 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.559518:0:162395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4b875 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba9f expref: 12 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.559534:0:162395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4200, rc 0) 00000100:00100000:1.0:1784191890.559614:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:69112:x1870858812382848:12345-192.168.204.16@tcp:101:cp.0 Request processed in 288us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191890.559622:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 269 00000100:00100000:0.0:1784191890.569296:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.572975:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812382976 00000100:00100000:2.0:1784191890.572995:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812382976 00000100:00100000:2.0:1784191890.573166:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 270 00000100:00100000:2.0:1784191890.573181:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:123690:x1870858812382976:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191890.573229:0:160163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191890.573256:0:160163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098710056/0xfeec3c2dc5a4b87c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8baa6 expref: -99 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.573294:0:160163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4b875 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba9f expref: 13 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.573305:0:160163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.573309:0:160163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.573315:0:160163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098710056/0xfeec3c2dc5a4b87c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8baa6 expref: 13 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.573356:0:160163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4b875 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba9f expref: 13 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.573372:0:160163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4b875 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba9f expref: 13 pid: 162395 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191890.573388:0:160163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:160163:1870858827958528:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191890.573512:0:160163:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2dbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784191890.581001:0:160163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:160163:1870858827958528:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191890.581044:0:160163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000098710056/0xfeec3c2dc5a4b87c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8baa6 expref: 13 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.581067:0:160163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6a00, rc 0) 00000100:00100000:3.0:1784191890.585072:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:123690:x1870858812382976:12345-192.168.204.16@tcp:101:cp.0 Request processed in 11878us (15770us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191890.585088:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 270 00000100:00100000:3.0:1784191890.597111:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.599990:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812383104 00000100:00100000:2.0:1784191890.600014:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812383104 00010000:00010000:2.0:1784191890.600087:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4b875 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba9f expref: 13 pid: 162395 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191890.600991:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 142 00000100:00100000:2.0:1784191890.601031:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:69109:x1870858812383104:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191890.601057:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191890.601088:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4b875 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba9f expref: 13 pid: 162395 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.601108:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4b875 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba9f expref: 13 pid: 162395 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.601138:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4b875 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba9f expref: 13 pid: 162395 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.601157:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.601162:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.601173:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000098710056/0xfeec3c2dc5a4b87c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8baa6 expref: 12 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.601183:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098710056/0xfeec3c2dc5a4b87c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8baa6 expref: 12 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.601229:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000098710056/0xfeec3c2dc5a4b87c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8baa6 expref: 12 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191890.601245:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210303480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827958656:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191890.601412:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db840 going to sleep for 11 seconds 00000100:00100000:0.0:1784191890.612832:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.613022:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210303480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827958656:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191890.613070:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191890.613147:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:69109:x1870858812383104:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 12122us (16047us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191890.613161:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 142 00000100:00100000:3.0:1784191890.613336:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812383360 00000100:00100000:3.0:1784191890.613345:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812383360 00000100:00100000:3.0:1784191890.613392:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 149 00000100:00100000:3.0:1784191890.613403:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+63:123690:x1870858812383360:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191890.613768:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+64:123690:x1870858812383360:12345-192.168.204.16@tcp:35:cp.0 Request processed in 366us (948us total) trans 34359738677 rc 0/0 00000100:00100000:3.0:1784191890.613776:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 149 00000100:00100000:0.0:1784191890.634040:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.645829:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812383488 00000100:00100000:1.0:1784191890.645851:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812383488 00000100:00100000:1.0:1784191890.645939:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 554 00000100:00100000:1.0:1784191890.645951:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+64:123690:x1870858812383488:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.645982:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.646008:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b883 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8baad expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646089:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b88a lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646104:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b88a lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646115:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b88a lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646130:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b891 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646158:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b891 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646167:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b891 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646216:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b88a lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646224:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b88a lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646230:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b88a lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646237:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b88a lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646243:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.646248:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b88a lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646255:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b88a lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646266:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.646269:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.646274:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b88a lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646281:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b88a lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646304:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b891 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646310:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b891 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646316:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b891 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646321:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.646324:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b891 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646330:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b891 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646338:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xb34b709f (ffff8af202c46e00) 00010000:00010000:1.0:1784191890.646340:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.646343:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b891 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646348:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b891 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646397:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b883 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8baad expref: 65 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646409:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.646411:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.646420:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b883 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8baad expref: 65 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.646429:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5a00, rc 0) 00000100:00100000:1.0:1784191890.646501:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+64:123690:x1870858812383488:12345-192.168.204.16@tcp:101:cp.0 Request processed in 551us (12474us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191890.646509:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 554 00000100:00100000:0.0:1784191890.651652:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.654602:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812383616 00000100:00100000:1.0:1784191890.654624:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812383616 00000100:00100000:1.0:1784191890.654739:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 555 00000100:00100000:1.0:1784191890.654752:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+64:123690:x1870858812383616:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.654775:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.654800:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b898 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bab4 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.654871:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b89f lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.654886:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b89f lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.654897:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b89f lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.654912:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8a6 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.654919:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8a6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.654926:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8a6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.654990:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b89f lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.654998:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b89f lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.655006:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b89f lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.655013:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b89f lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.655020:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.655025:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b89f lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.655033:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b89f lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.655046:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.655049:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.655055:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b89f lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.655063:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b89f lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.655076:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8a6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.655083:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8a6 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.655094:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8a6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.655100:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.655102:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8a6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.655109:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8a6 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.655117:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xb34b709f (ffff8af202c46e00) 00010000:00010000:1.0:1784191890.655120:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.655122:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8a6 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.655128:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8a6 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.655162:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b898 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bab4 expref: 65 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.655172:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.655175:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.655178:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b898 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bab4 expref: 65 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.655188:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5a00, rc 0) 00000100:00100000:0.0:1784191890.656289:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+64:123690:x1870858812383616:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1529us (4637us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191890.656300:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 555 00000100:00100000:0.0:1784191890.661920:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.662599:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812383872 00000100:00100000:1.0:1784191890.662614:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812383872 00000100:00100000:1.0:1784191890.662786:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 556 00000100:00100000:1.0:1784191890.662800:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+64:123690:x1870858812383872:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.662826:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.662864:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4b8ad lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8babb expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.662991:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b8b4 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.663009:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b8b4 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.663021:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b8b4 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.663038:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4b8bb lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.663045:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4b8bb lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.663052:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4b8bb lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191890.663420:0:158665:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x24c:0x0], index 0: 0 00080000:00000400:1.0:1784191890.663448:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191890.663452:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191890.663455:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191890.663457:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191890.663459:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191890.663462:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191890.663495:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191890.663497:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191890.663499:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191890.663501:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191890.663503:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191890.663504:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191890.663537:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191890.663539:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191890.663541:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191890.663543:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191890.663546:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191890.663548:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191890.663676:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4b8c2 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.663722:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4b8c2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.663732:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4b8c2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.663775:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b8b4 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.663782:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b8b4 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.663788:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b8b4 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.663794:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b8b4 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.663801:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.663814:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b8b4 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.663822:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b8b4 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.663836:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.663840:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.663846:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b8b4 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.663853:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b8b4 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191890.663869:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000004a2da5f reply state 000000006c46c0a3 transno 34359738678 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4b8bb lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.663881:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4b8bb lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.663888:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xb34b709f (ffff8af202c46900) 00010000:00010000:1.0:1784191890.663890:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191890.663892:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191890.663929:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4b8ad lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8babb expref: 67 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.663944:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4b8c2 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8babb expref: 66 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.663953:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0xe:0x0].0x0 (ffff8af202c46300) 00010000:00010000:1.0:1784191890.663955:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191890.663965:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5e00, rc 0) 00000100:00100000:1.0:1784191890.664040:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+67:123690:x1870858812383872:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1244us (2133us total) trans 34359738678 rc 0/0 00000100:00100000:1.0:1784191890.664049:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 556 00000100:00100000:3.0:1784191890.669606:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191890.670079:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812384000 00000100:00100000:0.0:1784191890.670105:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812384000 00000100:00100000:0.0:1784191890.670174:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 271 00000100:00100000:0.0:1784191890.670184:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:69109:x1870858812384000:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191890.670206:0:160166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191890.670230:0:160166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b8d0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bac2 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191890.670256:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191890.670953:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24c:0x0].0x0 since=5510s v=(0 0) 00010000:00010000:0.0:1784191890.670960:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191890.670973:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b8d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bac2 expref: 13 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.670994:0:160166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b8d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bac2 expref: 13 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.671007:0:160166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d532800, rc 0) 00000100:00100000:0.0:1784191890.671092:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:69109:x1870858812384000:12345-192.168.204.16@tcp:101:cp.0 Request processed in 908us (1498us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191890.671111:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 271 00000100:00100000:0.0:1784191890.690956:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.691190:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812384128 00000100:00100000:2.0:1784191890.691204:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812384128 00000100:00100000:2.0:1784191890.691269:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 272 00000100:00100000:2.0:1784191890.691281:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:123690:x1870858812384128:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191890.691302:0:162386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191890.691325:0:162386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bff4aa4/0xfeec3c2dc5a4b8d7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bac9 expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.691361:0:162386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b8d0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bac2 expref: 14 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.691370:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.691375:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.691381:0:162386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bff4aa4/0xfeec3c2dc5a4b8d7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bac9 expref: 14 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.691415:0:162386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b8d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bac2 expref: 14 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.691442:0:162386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b8d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bac2 expref: 14 pid: 160166 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191890.691480:0:162386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210303480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:162386:1870858827958784:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191890.691568:0:162386:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db840 going to sleep for 11 seconds 00000100:00100000:1.0:1784191890.695534:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191890.695743:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812384256 00000100:00100000:3.0:1784191890.695760:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812384256 00010000:00010000:3.0:1784191890.695801:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b8d0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bac2 expref: 15 pid: 160166 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191890.695871:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 143 00000100:00100000:3.0:1784191890.695882:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:69111:x1870858812384256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191890.695898:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191890.695925:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b8d0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bac2 expref: 15 pid: 160166 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.695942:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b8d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bac2 expref: 15 pid: 160166 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.695970:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191890.695975:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191890.695984:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008bff4aa4/0xfeec3c2dc5a4b8d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bac9 expref: 15 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.695994:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bff4aa4/0xfeec3c2dc5a4b8d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bac9 expref: 15 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.696031:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008bff4aa4/0xfeec3c2dc5a4b8d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bac9 expref: 15 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191890.696046:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1010b9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827958912:192.168.204.16@tcp:105: 00000100:00100000:3.0:1784191890.696135:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35240 going to sleep for 11 seconds 00010000:00010000:2.0:1784191890.696501:0:162386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b8d0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bac2 expref: 15 pid: 160166 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191890.696518:0:162386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210303480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:162386:1870858827958784:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191890.696546:0:162386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008bff4aa4/0xfeec3c2dc5a4b8d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bac9 expref: 14 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.696557:0:162386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6800, rc 0) 00000100:00100000:2.0:1784191890.696616:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:123690:x1870858812384128:12345-192.168.204.16@tcp:101:cp.0 Request processed in 5336us (5670us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191890.696624:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 272 00000100:00100000:0.0:1784191890.709805:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.710259:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812384512 00000100:00100000:1.0:1784191890.710270:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812384512 00000100:00100000:1.0:1784191890.710334:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 150 00000100:00100000:1.0:1784191890.710345:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105326450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+67:123690:x1870858812384512:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:1.0:1784191890.710750:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105326450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+68:123690:x1870858812384512:12345-192.168.204.16@tcp:35:cp.0 Request processed in 403us (953us total) trans 34359738679 rc 0/0 00000100:00100000:1.0:1784191890.710759:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 150 00000100:00100000:3.0:1784191890.714588:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1010b9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827958912:192.168.204.16@tcp:105: 00010000:00010000:3.0:1784191890.714637:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191890.714716:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:69111:x1870858812384256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 18835us (19194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191890.714728:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 143 00000100:00100000:0.0:1784191890.719190:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.719361:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812384640 00000100:00100000:1.0:1784191890.719372:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812384640 00000100:00100000:1.0:1784191890.719449:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 557 00000100:00100000:1.0:1784191890.719461:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+68:123690:x1870858812384640:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.719490:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.719514:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b8de lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bad0 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719598:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b8e5 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719613:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b8e5 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719626:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b8e5 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719664:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8ec lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719671:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8ec lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719678:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8ec lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719781:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b8e5 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719790:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b8e5 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719797:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b8e5 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719804:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b8e5 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719811:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.719815:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b8e5 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719823:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b8e5 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719836:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.719840:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.719845:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b8e5 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719859:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b8e5 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719873:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8ec lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719879:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8ec lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719885:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8ec lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719889:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.719893:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8ec lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719898:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8ec lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719905:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9b815f19 (ffff8af202c46e00) 00010000:00010000:1.0:1784191890.719908:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.719911:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8ec lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719916:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b8ec lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719947:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b8de lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bad0 expref: 69 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.719970:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.719973:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.719978:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b8de lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bad0 expref: 69 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.720354:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5000, rc 0) 00000100:00100000:1.0:1784191890.720423:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+68:123690:x1870858812384640:12345-192.168.204.16@tcp:101:cp.0 Request processed in 963us (1243us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191890.721805:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 557 00000100:00100000:2.0:1784191890.725890:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191890.733829:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812384768 00000100:00100000:0.0:1784191890.733849:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812384768 00000100:00100000:0.0:1784191890.733941:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 558 00000100:00100000:0.0:1784191890.733952:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+68:123690:x1870858812384768:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191890.733978:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191890.734006:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4b8f3 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bad7 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734085:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b8fa lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734101:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b8fa lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734112:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b8fa lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734128:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b901 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734136:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b901 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734142:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b901 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734188:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b8fa lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734196:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b8fa lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734203:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b8fa lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734221:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b8fa lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734228:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191890.734232:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b8fa lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734240:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b8fa lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734254:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191890.734257:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191890.734262:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b8fa lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734269:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4b8fa lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734287:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b901 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734294:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b901 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734299:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b901 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734304:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191890.734306:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b901 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734324:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b901 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734332:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9b815f19 (ffff8af203904200) 00010000:00010000:0.0:1784191890.734335:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191890.734337:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b901 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734343:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533a00/0xfeec3c2dc5a4b901 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734378:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4b8f3 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bad7 expref: 69 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734389:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191890.734391:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191890.734395:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4b8f3 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bad7 expref: 69 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.734404:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d532800, rc 0) 00000100:00100000:0.0:1784191890.734492:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+68:123690:x1870858812384768:12345-192.168.204.16@tcp:101:cp.0 Request processed in 542us (8613us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191890.734500:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 558 00000100:00100000:2.0:1784191890.737650:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.737810:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812385024 00000100:00100000:1.0:1784191890.737823:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812385024 00000100:00100000:1.0:1784191890.737890:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 559 00000100:00100000:1.0:1784191890.737900:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+68:123690:x1870858812385024:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.737925:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.737952:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b908 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bade expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.738087:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b90f lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.738104:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b90f lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.738117:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b90f lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.738134:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b916 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.738160:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b916 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.738168:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b916 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191890.738528:0:158665:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1c9:0x0], index 1: 0 00080000:00000400:1.0:1784191890.738542:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191890.738546:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191890.738548:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191890.738550:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191890.738552:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191890.738553:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191890.738572:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191890.738588:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191890.738589:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191890.738592:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191890.738594:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191890.738595:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191890.738628:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191890.738631:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191890.738633:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191890.738635:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191890.738637:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191890.738638:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191890.738788:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4b91d lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.738800:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4b91d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.738822:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4b91d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.738863:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b90f lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.738869:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b90f lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.738875:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b90f lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.738882:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b90f lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.738888:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.738893:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b90f lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.738900:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b90f lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.738914:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.738917:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.738922:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b90f lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.738928:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b90f lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191890.738943:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fb12d8e4 reply state 00000000462a0e48 transno 34359738680 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b916 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.738961:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b916 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.738967:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9b815f19 (ffff8af202c46e00) 00010000:00010000:1.0:1784191890.738969:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191890.738972:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191890.739008:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b908 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bade expref: 71 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.739025:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4b91d lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bade expref: 70 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.739032:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0xf:0x0].0x0 (ffff8af202c46000) 00010000:00010000:1.0:1784191890.739034:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191890.739036:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5200, rc 0) 00000100:00100000:1.0:1784191890.739126:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+71:123690:x1870858812385024:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1227us (1488us total) trans 34359738680 rc 0/0 00000100:00100000:1.0:1784191890.739135:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 559 00000100:00100000:1.0:1784191890.747493:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191890.747673:0:162390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812385152 00000100:00100000:0.0:1784191890.747686:0:162390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812385152 00000100:00100000:0.0:1784191890.747790:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 273 00000100:00100000:0.0:1784191890.747802:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:69111:x1870858812385152:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191890.747842:0:162390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191890.747862:0:162390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b92b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bae5 expref: -99 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191890.747891:0:162390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191890.747912:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c9:0x0].0x0 since=5510s v=(0 0) 00010000:00010000:0.0:1784191890.747917:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191890.747927:0:162390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b92b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bae5 expref: 13 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.747946:0:162390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b92b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bae5 expref: 13 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.747959:0:162390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d532800, rc 0) 00000100:00100000:0.0:1784191890.748033:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:69111:x1870858812385152:12345-192.168.204.16@tcp:101:cp.0 Request processed in 233us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191890.748041:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 273 00000100:00100000:3.0:1784191890.765891:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191890.766071:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812385280 00000100:00100000:0.0:1784191890.766082:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812385280 00000100:00100000:0.0:1784191890.766157:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 274 00000100:00100000:0.0:1784191890.766170:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:123690:x1870858812385280:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191890.766191:0:162398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191890.766211:0:162398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f16b6d98/0xfeec3c2dc5a4b932 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8baec expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.766248:0:162398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b92b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bae5 expref: 14 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.766274:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191890.766278:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191890.766284:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f16b6d98/0xfeec3c2dc5a4b932 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8baec expref: 14 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.766322:0:162398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b92b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bae5 expref: 14 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.766339:0:162398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b92b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bae5 expref: 14 pid: 162390 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191890.766354:0:162398:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:162398:1870858827959040:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191890.767097:0:162398:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111502300 going to sleep for 11 seconds 00000100:00100000:3.0:1784191890.778841:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.778959:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812385408 00000100:00100000:2.0:1784191890.778968:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812385408 00000100:00100000:0.0:1784191890.778997:0:162398:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:162398:1870858827959040:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191890.779010:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b92b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bae5 expref: 15 pid: 162390 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.779034:0:162398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f16b6d98/0xfeec3c2dc5a4b932 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8baec expref: 15 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.779054:0:162398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d533a00, rc 0) 00000100:00100000:2.0:1784191890.779058:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 144 00000100:00100000:2.0:1784191890.779069:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:69109:x1870858812385408:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191890.779085:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784191890.779129:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:123690:x1870858812385280:12345-192.168.204.16@tcp:101:cp.0 Request processed in 12960us (13249us total) trans 0 rc 0/0 00010000:00010000:2.0:1784191890.779152:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b92b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bae5 expref: 15 pid: 162390 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191890.779154:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 274 00010000:00010000:2.0:1784191890.779172:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b92b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bae5 expref: 15 pid: 162390 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.779196:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4b92b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bae5 expref: 14 pid: 162390 timeout: 5610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.779214:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.779220:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.779230:0:158652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f16b6d98/0xfeec3c2dc5a4b932 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8baec expref: 13 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.779241:0:158652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f16b6d98/0xfeec3c2dc5a4b932 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8baec expref: 13 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.779278:0:158652:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f16b6d98/0xfeec3c2dc5a4b932 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8baec expref: 13 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191890.779294:0:158652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210302300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:158652:1870858827959168:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191890.779352:0:158652:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db840 going to sleep for 11 seconds 00000100:00100000:0.0:1784191890.796905:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.797032:0:158652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210302300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:158652:1870858827959168:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191890.797057:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191890.797115:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:69109:x1870858812385408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 18048us (18287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191890.797152:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 144 00000100:00100000:1.0:1784191890.798520:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812385664 00000100:00100000:1.0:1784191890.798534:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812385664 00000100:00100000:1.0:1784191890.798607:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 151 00000100:00100000:1.0:1784191890.798617:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+71:123690:x1870858812385664:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:1.0:1784191890.799031:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+72:123690:x1870858812385664:12345-192.168.204.16@tcp:35:cp.0 Request processed in 414us (2137us total) trans 34359738681 rc 0/0 00000100:00100000:1.0:1784191890.799042:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 151 00000100:00100000:0.0:1784191890.809469:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.813326:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812385792 00000100:00100000:2.0:1784191890.813346:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812385792 00000100:00100000:2.0:1784191890.813447:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 560 00000100:00100000:2.0:1784191890.813458:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+72:123690:x1870858812385792:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191890.813486:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191890.813509:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4b939 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8baf3 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813599:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b940 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813617:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b940 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813632:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b940 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813649:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b947 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813657:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b947 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813664:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b947 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813752:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b940 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813781:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b940 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813787:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b940 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813794:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b940 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813800:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.813804:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b940 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813812:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b940 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813825:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.813828:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.813832:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b940 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813839:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b940 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813855:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b947 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813862:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b947 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813867:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b947 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813879:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.813883:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b947 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813889:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b947 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813896:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe9fa0db8 (ffff8af207498200) 00010000:00010000:2.0:1784191890.813899:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.813901:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b947 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813907:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b947 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813945:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4b939 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8baf3 expref: 73 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813956:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.813958:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.813961:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4b939 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8baf3 expref: 73 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.813972:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6e00, rc 0) 00000100:00100000:2.0:1784191890.814055:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+72:123690:x1870858812385792:12345-192.168.204.16@tcp:101:cp.0 Request processed in 598us (4598us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191890.814063:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 560 00000100:00100000:2.0:1784191890.821895:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.821990:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812385920 00000100:00100000:1.0:1784191890.822000:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812385920 00000100:00100000:1.0:1784191890.822064:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 561 00000100:00100000:1.0:1784191890.822073:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+72:123690:x1870858812385920:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.822093:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.822112:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4e00/0xfeec3c2dc5a4b94e lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bafa expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822192:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b955 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822207:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b955 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822221:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b955 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822240:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b95c lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822247:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b95c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822253:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b95c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822297:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b955 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822304:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b955 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822322:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b955 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822329:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b955 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822336:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.822340:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b955 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822347:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b955 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822361:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.822364:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.822368:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b955 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822374:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b955 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822386:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b95c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822393:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b95c lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822399:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b95c lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822404:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.822414:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b95c lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822420:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b95c lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822428:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe9fa0db8 (ffff8af202c46c00) 00010000:00010000:1.0:1784191890.822431:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.822433:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b95c lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822438:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b95c lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822475:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4e00/0xfeec3c2dc5a4b94e lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bafa expref: 73 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822485:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.822487:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.822490:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4e00/0xfeec3c2dc5a4b94e lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bafa expref: 73 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.822498:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4e00, rc 0) 00000100:00100000:1.0:1784191890.822557:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+72:123690:x1870858812385920:12345-192.168.204.16@tcp:101:cp.0 Request processed in 484us (672us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191890.822565:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 561 00000100:00100000:2.0:1784191890.832284:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.834888:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812386176 00000100:00100000:1.0:1784191890.834907:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812386176 00000100:00100000:1.0:1784191890.834986:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 562 00000100:00100000:1.0:1784191890.834997:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+72:123690:x1870858812386176:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.835035:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.835059:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4e00/0xfeec3c2dc5a4b963 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb01 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.835180:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b96a lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.835196:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b96a lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.835207:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b96a lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.835221:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b971 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.835227:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b971 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.835234:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b971 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191890.835616:0:164531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x24d:0x0], index 0: 0 00080000:00000400:1.0:1784191890.835630:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:1.0:1784191890.835634:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191890.835637:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191890.835639:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191890.835641:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191890.835643:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191890.835661:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:1.0:1784191890.835664:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191890.835672:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191890.835674:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191890.835676:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191890.835678:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191890.835732:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:1.0:1784191890.835735:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191890.835737:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191890.835739:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191890.835741:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191890.835743:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191890.835847:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b978 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.835858:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b978 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.835865:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b978 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.835900:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b96a lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.835907:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b96a lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.835913:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b96a lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.835918:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b96a lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.835924:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.835928:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b96a lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.835942:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b96a lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.835955:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.835958:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.835963:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b96a lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.835970:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b96a lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191890.835984:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a0d42ddb reply state 000000008c3d80da transno 34359738682 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b971 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.835994:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b971 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.836001:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe9fa0db8 (ffff8af202c46c00) 00010000:00010000:1.0:1784191890.836003:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191890.836005:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191890.836033:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4e00/0xfeec3c2dc5a4b963 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb01 expref: 75 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.836047:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b978 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb01 expref: 74 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.836054:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x10:0x0].0x0 (ffff8af202c46d00) 00010000:00010000:1.0:1784191890.836056:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191890.836058:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5000, rc 0) 00000100:00100000:1.0:1784191890.836152:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+75:123690:x1870858812386176:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1156us (3879us total) trans 34359738682 rc 0/0 00000100:00100000:1.0:1784191890.836161:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 562 00000100:00100000:0.0:1784191890.842186:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191890.842272:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812386304 00000100:00100000:3.0:1784191890.842283:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812386304 00000100:00100000:3.0:1784191890.842346:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 275 00000100:00100000:3.0:1784191890.842356:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:69110:x1870858812386304:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191890.842374:0:162391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191890.842396:0:162391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b986 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb08 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191890.842421:0:162391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784191890.842440:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24d:0x0].0x0 since=5511s v=(0 0) 00010000:00010000:3.0:1784191890.842444:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191890.842454:0:162391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b986 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb08 expref: 14 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.842474:0:162391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b986 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb08 expref: 14 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.842486:0:162391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3600, rc 0) 00000100:00100000:3.0:1784191890.842560:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:69110:x1870858812386304:12345-192.168.204.16@tcp:101:cp.0 Request processed in 206us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191890.842593:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 275 00000100:00100000:3.0:1784191890.856547:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.856647:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812386432 00000100:00100000:1.0:1784191890.856663:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812386432 00000100:00100000:1.0:1784191890.856788:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 276 00000100:00100000:1.0:1784191890.856802:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:123690:x1870858812386432:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.856828:0:162389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.856857:0:162389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de80b18d/0xfeec3c2dc5a4b98d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb0f expref: -99 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.856897:0:162389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b986 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb08 expref: 15 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.856908:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191890.856913:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191890.856918:0:162389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de80b18d/0xfeec3c2dc5a4b98d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb0f expref: 15 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.856962:0:162389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b986 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb08 expref: 15 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.856978:0:162389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b986 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb08 expref: 15 pid: 162391 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191890.856996:0:162389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:162389:1870858827959296:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191890.857106:0:162389:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2170f9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784191890.863330:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191890.863439:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812386560 00000100:00100000:0.0:1784191890.863450:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812386560 00010000:00010000:0.0:1784191890.863501:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b986 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb08 expref: 16 pid: 162391 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191890.863550:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 145 00000100:00100000:0.0:1784191890.863560:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+16:69112:x1870858812386560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191890.863585:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191890.863617:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b986 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb08 expref: 16 pid: 162391 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.863633:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b986 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb08 expref: 16 pid: 162391 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.863663:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191890.863668:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191890.863676:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000de80b18d/0xfeec3c2dc5a4b98d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb0f expref: 16 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.863729:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de80b18d/0xfeec3c2dc5a4b98d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb0f expref: 16 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.863768:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000de80b18d/0xfeec3c2dc5a4b98d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb0f expref: 16 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191890.863806:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827959424:192.168.204.16@tcp:105: 00000100:00100000:0.0:1784191890.863890:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111502300 going to sleep for 11 seconds 00010000:00010000:1.0:1784191890.864373:0:162389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4b986 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb08 expref: 16 pid: 162391 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191890.864393:0:162389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:162389:1870858827959296:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191890.864421:0:162389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000de80b18d/0xfeec3c2dc5a4b98d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb0f expref: 15 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.864432:0:162389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4e00, rc 0) 00000100:00100000:1.0:1784191890.864477:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:123690:x1870858812386432:12345-192.168.204.16@tcp:101:cp.0 Request processed in 7679us (7945us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191890.864486:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 276 00000100:00100000:2.0:1784191890.871030:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.876776:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812386816 00000100:00100000:1.0:1784191890.876795:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812386816 00000100:00100000:1.0:1784191890.876868:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 152 00000100:00100000:1.0:1784191890.876879:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+75:123690:x1870858812386816:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:1.0:1784191890.877254:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+76:123690:x1870858812386816:12345-192.168.204.16@tcp:35:cp.0 Request processed in 374us (6235us total) trans 34359738683 rc 0/0 00000100:00100000:1.0:1784191890.877262:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 152 00000100:00100000:0.0:1784191890.877388:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827959424:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191890.877420:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191890.877464:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:69112:x1870858812386560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 13906us (14148us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191890.877472:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 145 00000100:00100000:0.0:1784191890.885818:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.885955:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812386944 00000100:00100000:2.0:1784191890.885968:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812386944 00000100:00100000:2.0:1784191890.886027:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 563 00000100:00100000:2.0:1784191890.886036:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+76:123690:x1870858812386944:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191890.886063:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191890.886087:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b994 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb16 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886157:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b99b lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886172:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b99b lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886184:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b99b lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886198:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9a2 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886205:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9a2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886211:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9a2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886255:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b99b lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886282:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b99b lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886289:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b99b lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886295:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b99b lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886301:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.886306:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b99b lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886314:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b99b lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886326:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.886329:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.886334:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b99b lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886340:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b99b lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886354:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9a2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886359:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9a2 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886365:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9a2 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886377:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.886381:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9a2 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886386:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9a2 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886395:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xc025ca7 (ffff8af207498200) 00010000:00010000:2.0:1784191890.886397:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.886400:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9a2 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886405:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9a2 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886441:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b994 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb16 expref: 77 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886453:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.886455:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.886458:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b994 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb16 expref: 77 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.886468:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7000, rc 0) 00000100:00100000:2.0:1784191890.886547:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+76:123690:x1870858812386944:12345-192.168.204.16@tcp:101:cp.0 Request processed in 511us (742us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191890.886555:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 563 00000100:00100000:2.0:1784191890.891251:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.893391:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812387072 00000100:00100000:1.0:1784191890.893409:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812387072 00000100:00100000:1.0:1784191890.893614:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 564 00000100:00100000:1.0:1784191890.893628:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+76:123690:x1870858812387072:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.893650:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.893673:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b9a9 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb1d expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.893779:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9b0 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.893796:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9b0 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.893809:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9b0 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.893824:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4b9b7 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.893831:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4b9b7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.893838:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4b9b7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.893882:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9b0 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.893890:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9b0 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.893896:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9b0 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.893903:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9b0 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.893910:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.893920:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9b0 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.893929:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9b0 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.893942:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.893945:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.893950:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9b0 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.893956:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9b0 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.893971:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4b9b7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.893977:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4b9b7 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.893983:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4b9b7 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.893989:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.893991:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4b9b7 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.893998:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4b9b7 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.894004:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xc025ca7 (ffff8af202c46b00) 00010000:00010000:1.0:1784191890.894006:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.894016:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4b9b7 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.894022:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4b9b7 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.894065:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b9a9 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb1d expref: 77 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.894077:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.894079:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.894083:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4400/0xfeec3c2dc5a4b9a9 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb1d expref: 77 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.894092:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4400, rc 0) 00000100:00100000:1.0:1784191890.894192:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+76:123690:x1870858812387072:12345-192.168.204.16@tcp:101:cp.0 Request processed in 567us (2951us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191890.894201:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 564 00000100:00100000:3.0:1784191890.909268:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.909565:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812387328 00000100:00100000:2.0:1784191890.909588:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812387328 00000100:00100000:2.0:1784191890.909662:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 565 00000100:00100000:2.0:1784191890.909673:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+76:123690:x1870858812387328:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191890.909853:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191890.909876:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b9be lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb24 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.910000:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9c5 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.910016:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9c5 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.910028:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9c5 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.910041:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b9cc lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.910047:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b9cc lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.910053:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b9cc lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191890.912476:0:158666:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1ca:0x0], index 1: 0 00080000:00000400:2.0:1784191890.912505:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191890.912509:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191890.912512:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191890.912514:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191890.912536:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191890.912538:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191890.912595:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191890.912598:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191890.912600:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191890.912602:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191890.912604:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191890.912606:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191890.912649:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191890.912651:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191890.912653:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191890.912655:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191890.912657:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191890.912659:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191890.912814:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b9d3 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.912832:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b9d3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.912845:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b9d3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.912886:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9c5 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.912895:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9c5 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.912902:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9c5 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.912910:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9c5 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.912925:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191890.912931:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9c5 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.912939:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9c5 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.912952:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191890.912955:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191890.912959:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9c5 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.912967:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4b9c5 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191890.912983:0:158666:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000221ad171 reply state 00000000ed87fa6c transno 34359738684 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b9cc lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.912996:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b9cc lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.913002:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xc025ca7 (ffff8af207498200) 00010000:00010000:2.0:1784191890.913005:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191890.913008:0:158666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191890.913052:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4b9be lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb24 expref: 79 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.913069:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b9d3 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb24 expref: 78 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.913091:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x11:0x0].0x0 (ffff8af207498700) 00010000:00010000:2.0:1784191890.913094:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191890.913096:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6000, rc 0) 00000100:00100000:2.0:1784191890.914398:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+79:123690:x1870858812387328:12345-192.168.204.16@tcp:101:cp.0 Request processed in 4717us (5129us total) trans 34359738684 rc 0/0 00000100:00100000:2.0:1784191890.914410:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 565 00000100:00100000:0.0:1784191890.929504:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.929616:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812387456 00000100:00100000:2.0:1784191890.929628:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812387456 00000100:00100000:2.0:1784191890.929750:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 277 00000100:00100000:2.0:1784191890.929763:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:69112:x1870858812387456:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191890.929783:0:161232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191890.929811:0:161232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c46a14a/0xfeec3c2dc5a4b9e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb2b expref: -99 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191890.929840:0:161232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191890.929863:0:161232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ca:0x0].0x0 since=5511s v=(0 0) 00010000:00010000:2.0:1784191890.929867:0:161232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191890.929879:0:161232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c46a14a/0xfeec3c2dc5a4b9e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb2b expref: 14 pid: 161232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.929899:0:161232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c46a14a/0xfeec3c2dc5a4b9e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb2b expref: 14 pid: 161232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.929915:0:161232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7000, rc 0) 00000100:00100000:2.0:1784191890.930010:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:69112:x1870858812387456:12345-192.168.204.16@tcp:101:cp.0 Request processed in 250us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191890.930019:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 277 00000100:00100000:3.0:1784191890.936117:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.936377:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812387584 00000100:00100000:1.0:1784191890.936388:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812387584 00000100:00100000:1.0:1784191890.936453:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 278 00000100:00100000:1.0:1784191890.936464:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:123690:x1870858812387584:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.936484:0:162385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.936502:0:162385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4b9e8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb32 expref: -99 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.936534:0:162385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c46a14a/0xfeec3c2dc5a4b9e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb2b expref: 15 pid: 161232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.936563:0:162385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191890.936568:0:162385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191890.936586:0:162385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4b9e8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb32 expref: 15 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.936626:0:162385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c46a14a/0xfeec3c2dc5a4b9e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb2b expref: 15 pid: 161232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.936642:0:162385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c46a14a/0xfeec3c2dc5a4b9e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb2b expref: 15 pid: 161232 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191890.936658:0:162385:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:162385:1870858827959552:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191890.936947:0:162385:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2065f0180 going to sleep for 11 seconds 00000100:00100000:1.0:1784191890.959781:0:162385:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:162385:1870858827959552:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191890.959825:0:162385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4b9e8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb32 expref: 15 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.959852:0:162385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4400, rc 0) 00000100:00100000:1.0:1784191890.959945:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:123690:x1870858812387584:12345-192.168.204.16@tcp:101:cp.0 Request processed in 23482us (23838us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191890.959955:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 278 00000100:00100000:0.0:1784191890.961455:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191890.961544:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812387712 00000100:00100000:3.0:1784191890.961555:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812387712 00010000:00010000:3.0:1784191890.961631:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c46a14a/0xfeec3c2dc5a4b9e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb2b expref: 15 pid: 161232 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191890.961686:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 146 00000100:00100000:3.0:1784191890.961719:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af202d71050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:69109:x1870858812387712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191890.961734:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191890.961773:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c46a14a/0xfeec3c2dc5a4b9e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb2b expref: 15 pid: 161232 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.961790:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c46a14a/0xfeec3c2dc5a4b9e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb2b expref: 15 pid: 161232 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.961824:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c46a14a/0xfeec3c2dc5a4b9e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb2b expref: 15 pid: 161232 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.961843:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191890.961848:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191890.961856:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4b9e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb32 expref: 14 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.961893:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4b9e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb32 expref: 14 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.961937:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4b9e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb32 expref: 14 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191890.961951:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1010b8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827959680:192.168.204.16@tcp:105: 00000100:00100000:3.0:1784191890.962038:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35240 going to sleep for 11 seconds 00000100:00100000:3.0:1784191890.965756:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.965779:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1010b8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827959680:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191890.965815:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191890.965889:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af202d71050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:69109:x1870858812387712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4171us (4441us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191890.965902:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 146 00000100:00100000:1.0:1784191890.966056:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812387968 00000100:00100000:1.0:1784191890.966063:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812387968 00000100:00100000:1.0:1784191890.966122:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 153 00000100:00100000:1.0:1784191890.966161:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+79:123690:x1870858812387968:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:1.0:1784191890.966468:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+80:123690:x1870858812387968:12345-192.168.204.16@tcp:35:cp.0 Request processed in 308us (730us total) trans 34359738685 rc 0/0 00000100:00100000:1.0:1784191890.966475:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 153 00000100:00100000:3.0:1784191890.971156:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.971286:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812388096 00000100:00100000:1.0:1784191890.971296:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812388096 00000100:00100000:1.0:1784191890.971366:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 566 00000100:00100000:1.0:1784191890.971376:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+80:123690:x1870858812388096:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.971404:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.971426:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4b9ef lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb39 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971499:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9f6 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971514:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9f6 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971527:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9f6 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971541:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4b9fd lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971548:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4b9fd lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971555:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4b9fd lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971636:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9f6 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971643:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9f6 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971648:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9f6 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971654:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9f6 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971659:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.971663:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9f6 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971670:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9f6 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971684:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.971739:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.971753:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9f6 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971759:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4b9f6 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971775:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4b9fd lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971780:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4b9fd lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971792:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4b9fd lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971797:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.971800:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4b9fd lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971806:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4b9fd lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971814:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xecc4f14 (ffff8af202c46b00) 00010000:00010000:1.0:1784191890.971816:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.971819:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4b9fd lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971824:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4b9fd lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971859:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4b9ef lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb39 expref: 81 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971869:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.971871:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.971874:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4b9ef lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb39 expref: 81 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.971883:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5600, rc 0) 00000100:00100000:1.0:1784191890.971943:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+80:123690:x1870858812388096:12345-192.168.204.16@tcp:101:cp.0 Request processed in 568us (798us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191890.971960:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 566 00000100:00100000:3.0:1784191890.974250:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191890.974338:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812388224 00000100:00100000:1.0:1784191890.974347:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812388224 00000100:00100000:1.0:1784191890.974408:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 567 00000100:00100000:1.0:1784191890.974418:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+80:123690:x1870858812388224:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191890.974439:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191890.974459:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4ba04 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb40 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974521:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4ba0b lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974535:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4ba0b lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974545:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4ba0b lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974558:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ba12 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974565:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ba12 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974582:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ba12 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974620:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4ba0b lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974645:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4ba0b lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974651:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4ba0b lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974657:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4ba0b lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974663:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.974667:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4ba0b lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974674:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4ba0b lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974685:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.974718:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.974722:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4ba0b lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974729:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4ba0b lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974744:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ba12 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974750:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ba12 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974755:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ba12 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974766:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191890.974770:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ba12 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974776:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ba12 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974784:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xecc4f14 (ffff8af2331f1d00) 00010000:00010000:1.0:1784191890.974787:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.974789:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ba12 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974796:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4ba12 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974829:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4ba04 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb40 expref: 81 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974839:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191890.974841:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191890.974845:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4ba04 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb40 expref: 81 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191890.974853:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4200, rc 0) 00000100:00100000:1.0:1784191890.974900:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+80:123690:x1870858812388224:12345-192.168.204.16@tcp:101:cp.0 Request processed in 484us (659us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191890.974907:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 567 00000100:00100000:0.0:1784191890.982453:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191890.982754:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812388480 00000100:00100000:2.0:1784191890.982766:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812388480 00000100:00100000:2.0:1784191890.982822:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 568 00000100:00100000:2.0:1784191890.982832:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+80:123690:x1870858812388480:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191890.982855:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191890.982878:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4ba19 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb47 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.982997:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba20 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.983015:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba20 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.983027:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba20 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.983043:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4ba27 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.983049:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4ba27 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191890.983074:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4ba27 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191890.987421:0:158666:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x24e:0x0], index 0: 0 00080000:00000400:3.0:1784191890.987448:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191890.987452:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191890.987454:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191890.987456:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191890.987458:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191890.987460:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191890.987481:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191890.987484:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191890.987486:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191890.987488:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191890.987490:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191890.987492:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191890.987533:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191890.987536:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191890.987537:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191890.987557:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191890.987559:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191890.987561:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191890.987928:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3a00/0xfeec3c2dc5a4ba2e lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.987945:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3a00/0xfeec3c2dc5a4ba2e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.987956:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3a00/0xfeec3c2dc5a4ba2e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.987998:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba20 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.988005:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba20 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.988012:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba20 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.988019:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba20 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.988026:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191890.988030:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba20 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.988037:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba20 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.988052:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191890.988055:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191890.988068:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba20 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.988075:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba20 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191890.988090:0:158666:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000904246af reply state 0000000064559929 transno 34359738686 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4ba27 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.988484:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4ba27 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.988491:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xecc4f14 (ffff8af219b92600) 00010000:00010000:3.0:1784191890.988494:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191890.988497:0:158666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784191890.988547:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4ba19 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb47 expref: 83 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.988565:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3a00/0xfeec3c2dc5a4ba2e lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb47 expref: 82 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191890.988583:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x12:0x0].0x0 (ffff8af110071000) 00010000:00010000:3.0:1784191890.988585:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784191890.988588:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3a00, rc 0) 00000100:00100000:3.0:1784191890.988664:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+83:123690:x1870858812388480:12345-192.168.204.16@tcp:101:cp.0 Request processed in 5832us (6221us total) trans 34359738686 rc 0/0 00000100:00100000:3.0:1784191890.988673:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 568 00000100:00100000:3.0:1784191890.995829:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191890.995919:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812388608 00000100:00100000:0.0:1784191890.995930:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812388608 00000100:00100000:0.0:1784191890.995994:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 279 00000100:00100000:0.0:1784191890.996005:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:69109:x1870858812388608:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191890.996025:0:160166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191890.996048:0:160166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4ba3c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb4e expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191890.996075:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191890.996109:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24e:0x0].0x0 since=5511s v=(0 0) 00010000:00010000:0.0:1784191890.996115:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191890.996126:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4ba3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb4e expref: 15 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.996170:0:160166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4ba3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb4e expref: 15 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191890.996185:0:160166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d532800, rc 0) 00000100:00100000:0.0:1784191890.996260:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:69109:x1870858812388608:12345-192.168.204.16@tcp:101:cp.0 Request processed in 255us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191890.996267:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 279 00000100:00100000:0.0:1784191891.003007:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191891.003297:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812388736 00000100:00100000:1.0:1784191891.003317:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812388736 00000100:00100000:1.0:1784191891.003391:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 280 00000100:00100000:1.0:1784191891.003402:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1051f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:123690:x1870858812388736:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191891.003420:0:162396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191891.003438:0:162396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008deb768f/0xfeec3c2dc5a4ba43 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb55 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.003469:0:162396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4ba3c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb4e expref: 16 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.003477:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191891.003481:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191891.003486:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008deb768f/0xfeec3c2dc5a4ba43 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb55 expref: 16 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.003521:0:162396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4ba3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb4e expref: 16 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.003535:0:162396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4ba3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb4e expref: 16 pid: 160166 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191891.003550:0:162396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:162396:1870858827959808:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191891.003637:0:162396:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2065f00c0 going to sleep for 11 seconds 00000100:00080000:3.0:1784191891.006535:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784191891.014881:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191891.014941:0:162396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:162396:1870858827959808:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191891.015005:0:162396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008deb768f/0xfeec3c2dc5a4ba43 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb55 expref: 16 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.015033:0:162396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9200, rc 0) 00000100:00100000:0.0:1784191891.015202:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1051f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+16:123690:x1870858812388736:12345-192.168.204.16@tcp:101:cp.0 Request processed in 11800us (12208us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191891.015212:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 280 00000100:00100000:2.0:1784191891.016023:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812388864 00000100:00100000:2.0:1784191891.016033:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812388864 00010000:00010000:2.0:1784191891.016076:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4ba3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb4e expref: 16 pid: 160166 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191891.016132:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 147 00000100:00100000:2.0:1784191891.016143:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+16:69111:x1870858812388864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191891.016158:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191891.016181:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4ba3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x24e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb4e expref: 16 pid: 160166 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.016199:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4ba3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb4e expref: 16 pid: 160166 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.016224:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4ba3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x24e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb4e expref: 16 pid: 160166 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.016241:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.016246:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.016256:0:158652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008deb768f/0xfeec3c2dc5a4ba43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb55 expref: 15 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.016286:0:158652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008deb768f/0xfeec3c2dc5a4ba43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb55 expref: 15 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.016329:0:158652:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008deb768f/0xfeec3c2dc5a4ba43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb55 expref: 15 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191891.016345:0:158652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210300380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:158652:1870858827959936:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191891.016424:0:158652:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191891.021710:0:158652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210300380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:158652:1870858827959936:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191891.021812:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191891.021891:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:69111:x1870858812388864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5749us (7024us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191891.021902:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 147 00000100:00100000:3.0:1784191891.036163:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191891.037091:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812389120 00000100:00100000:1.0:1784191891.037105:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812389120 00000100:00100000:1.0:1784191891.037212:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 154 00000100:00100000:1.0:1784191891.037224:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+83:123690:x1870858812389120:12345-192.168.204.16@tcp:35:cp.0 00000100:00080000:3.0:1784191891.038176:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784191891.038860:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+84:123690:x1870858812389120:12345-192.168.204.16@tcp:35:cp.0 Request processed in 1630us (2703us total) trans 34359738687 rc 0/0 00000100:00100000:1.0:1784191891.038875:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 154 00000100:00100000:3.0:1784191891.051940:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.055879:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812389248 00000100:00100000:2.0:1784191891.055899:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812389248 00000100:00100000:2.0:1784191891.055983:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 569 00000100:00100000:2.0:1784191891.055994:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+84:123690:x1870858812389248:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.056022:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.056047:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4ba4a lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb5c expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056136:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4ba51 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056152:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4ba51 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056182:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4ba51 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056200:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba58 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056209:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba58 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056215:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba58 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056262:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4ba51 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056270:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4ba51 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056276:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4ba51 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056283:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4ba51 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056289:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.056293:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4ba51 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056300:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4ba51 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056313:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.056323:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.056329:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4ba51 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056335:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4ba51 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056353:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba58 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056359:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba58 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056366:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba58 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056371:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.056374:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba58 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056380:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba58 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056387:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x712be7d1 (ffff8af219b92c00) 00010000:00010000:2.0:1784191891.056389:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.056392:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba58 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056397:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4ba58 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056431:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4ba4a lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb5c expref: 85 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056448:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.056451:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.056455:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4ba4a lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb5c expref: 85 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.056465:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7e00, rc 0) 00000100:00100000:2.0:1784191891.056578:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+84:123690:x1870858812389248:12345-192.168.204.16@tcp:101:cp.0 Request processed in 577us (4640us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191891.056586:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 569 00000100:00100000:0.0:1784191891.061203:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.061290:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812389376 00000100:00100000:2.0:1784191891.061302:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812389376 00000100:00100000:2.0:1784191891.061364:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 570 00000100:00100000:2.0:1784191891.061374:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+84:123690:x1870858812389376:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.061397:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.061422:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4ba5f lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb63 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061518:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4ba66 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061533:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4ba66 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061545:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4ba66 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061560:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ba6d lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061594:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ba6d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061601:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ba6d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061647:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4ba66 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061654:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4ba66 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061661:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4ba66 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061667:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4ba66 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061673:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d6e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.061677:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4ba66 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061684:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4ba66 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061749:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.061752:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.061757:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4ba66 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061764:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4ba66 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061786:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ba6d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061792:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ba6d lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061797:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ba6d lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061801:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d6200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.061803:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ba6d lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061809:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ba6d lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061817:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x712be7d1 (ffff8af219b92200) 00010000:00010000:2.0:1784191891.061820:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.061822:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ba6d lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061828:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ba6d lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061866:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4ba5f lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb63 expref: 85 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061876:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.061878:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.061889:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4ba5f lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb63 expref: 85 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.061899:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7000, rc 0) 00000100:00100000:2.0:1784191891.061961:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+84:123690:x1870858812389376:12345-192.168.204.16@tcp:101:cp.0 Request processed in 588us (769us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191891.061967:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 570 00000100:00100000:3.0:1784191891.065936:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191891.066132:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812389632 00000100:00100000:0.0:1784191891.066144:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812389632 00000100:00100000:0.0:1784191891.066215:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 571 00000100:00100000:0.0:1784191891.066227:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+84:123690:x1870858812389632:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191891.066252:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191891.066274:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4ba74 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb6a expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.066390:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4ba7b lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.066405:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4ba7b lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.066438:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4ba7b lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.066455:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ba82 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.066462:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ba82 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.066469:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ba82 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191891.067477:0:158666:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1cb:0x0], index 1: 0 00080000:00000400:0.0:1784191891.067495:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191891.067498:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191891.067501:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191891.067503:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191891.067505:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191891.067507:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191891.067525:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191891.067527:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191891.067528:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191891.067530:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191891.067532:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191891.067534:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191891.067563:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191891.067565:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191891.067578:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191891.067581:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191891.067583:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191891.067595:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191891.069954:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4ba89 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.069981:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4ba89 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.069994:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4ba89 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.070058:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4ba7b lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.070066:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4ba7b lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.070072:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4ba7b lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.070080:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4ba7b lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.070087:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191891.070092:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4ba7b lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.070100:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4ba7b lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.070113:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191891.070116:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191891.070121:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4ba7b lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.070150:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4ba7b lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191891.070173:0:158666:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec2d31d9 reply state 000000003b5446d6 transno 34359738688 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ba82 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.070185:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ba82 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.070191:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x712be7d1 (ffff8af207499f00) 00010000:00010000:0.0:1784191891.070193:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191891.070196:0:158666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191891.070246:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4ba74 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb6a expref: 87 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.070263:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4ba89 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb6a expref: 86 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.070270:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x13:0x0].0x0 (ffff8af207499700) 00010000:00010000:0.0:1784191891.070272:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191891.070275:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341b000, rc 0) 00000100:00100000:0.0:1784191891.070632:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+87:123690:x1870858812389632:12345-192.168.204.16@tcp:101:cp.0 Request processed in 4406us (4708us total) trans 34359738688 rc 0/0 00000100:00100000:0.0:1784191891.070641:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 571 00000100:00100000:1.0:1784191891.077159:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191891.077245:0:162390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812389760 00000100:00100000:0.0:1784191891.077256:0:162390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812389760 00000100:00100000:0.0:1784191891.077361:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 281 00000100:00100000:0.0:1784191891.077374:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:69112:x1870858812389760:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191891.077411:0:162390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191891.077449:0:162390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4ba97 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb71 expref: -99 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191891.077476:0:162390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191891.077514:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cb:0x0].0x0 since=5511s v=(0 0) 00010000:00010000:0.0:1784191891.077519:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.077533:0:162390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4ba97 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb71 expref: 15 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.077553:0:162390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4ba97 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb71 expref: 15 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.077578:0:162390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874ac00, rc 0) 00000100:00100000:0.0:1784191891.077653:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:69112:x1870858812389760:12345-192.168.204.16@tcp:101:cp.0 Request processed in 282us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191891.077660:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 281 00000100:00080000:3.0:1784191891.081334:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784191891.081444:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191891.081674:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812389888 00000100:00100000:3.0:1784191891.081907:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812389888 00000100:00100000:3.0:1784191891.082008:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 282 00000100:00100000:3.0:1784191891.082019:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:123690:x1870858812389888:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191891.082042:0:160165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191891.082063:0:160165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4ba9e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb78 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.082096:0:160165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4ba97 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb71 expref: 16 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.082106:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191891.082110:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191891.082115:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4ba9e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb78 expref: 16 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.082152:0:160165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4ba97 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb71 expref: 16 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.082188:0:160165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4ba97 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb71 expref: 16 pid: 162390 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191891.082203:0:160165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1010b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:160165:1870858827960064:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191891.082297:0:160165:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35540 going to sleep for 11 seconds 00000100:00100000:3.0:1784191891.084902:0:160165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1010b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:160165:1870858827960064:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191891.084942:0:160165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4ba9e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb78 expref: 16 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.084963:0:160165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3600, rc 0) 00000100:00100000:3.0:1784191891.085019:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+16:123690:x1870858812389888:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3000us (3581us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191891.085027:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 282 00000100:00100000:1.0:1784191891.088110:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191891.088181:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812390016 00000100:00100000:0.0:1784191891.088192:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812390016 00010000:00010000:0.0:1784191891.088239:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4ba97 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb71 expref: 16 pid: 162390 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191891.088284:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 148 00000100:00100000:0.0:1784191891.088294:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+16:69109:x1870858812390016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191891.088310:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191891.088347:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4ba97 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb71 expref: 16 pid: 162390 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.088361:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4ba97 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb71 expref: 16 pid: 162390 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.088387:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4ba97 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb71 expref: 16 pid: 162390 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.088404:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.088408:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.088417:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4ba9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb78 expref: 15 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.088427:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4ba9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb78 expref: 15 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.088465:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4ba9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb78 expref: 15 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191891.088495:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827960192:192.168.204.16@tcp:105: 00000100:00100000:0.0:1784191891.088588:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111502000 going to sleep for 11 seconds 00000100:00100000:0.0:1784191891.092317:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827960192:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191891.092364:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191891.092434:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:69109:x1870858812390016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4140us (4342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191891.092468:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 148 00000100:00100000:1.0:1784191891.094581:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.094680:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812390272 00000100:00100000:2.0:1784191891.094722:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812390272 00000100:00100000:2.0:1784191891.094792:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 155 00000100:00100000:2.0:1784191891.094804:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+87:123690:x1870858812390272:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191891.095280:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+88:123690:x1870858812390272:12345-192.168.204.16@tcp:35:cp.0 Request processed in 475us (715us total) trans 34359738689 rc 0/0 00000100:00100000:2.0:1784191891.095288:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 155 00000100:00100000:1.0:1784191891.099774:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.100014:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812390400 00000100:00100000:2.0:1784191891.100025:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812390400 00000100:00100000:2.0:1784191891.100103:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 572 00000100:00100000:2.0:1784191891.100115:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+88:123690:x1870858812390400:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.100144:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.100169:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4baa5 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb7f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100248:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4baac lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100264:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4baac lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100294:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4baac lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100311:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4bab3 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100319:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4bab3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100325:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4bab3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100371:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4baac lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100379:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4baac lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100385:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4baac lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100392:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4baac lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100399:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d6e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.100403:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4baac lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100411:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4baac lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100424:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.100434:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.100439:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4baac lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100445:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4baac lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100461:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4bab3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100467:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4bab3 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100473:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4bab3 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100478:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.100481:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4bab3 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100498:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4bab3 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100507:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x4ee593e6 (ffff8af219b92200) 00010000:00010000:2.0:1784191891.100509:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.100512:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4bab3 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100517:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7600/0xfeec3c2dc5a4bab3 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100553:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4baa5 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb7f expref: 89 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100580:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.100583:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.100587:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4baa5 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb7f expref: 89 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.100597:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6200, rc 0) 00000100:00100000:2.0:1784191891.100663:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+88:123690:x1870858812390400:12345-192.168.204.16@tcp:101:cp.0 Request processed in 550us (900us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191891.100671:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 572 00000100:00100000:0.0:1784191891.105039:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191891.105761:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812390528 00000100:00100000:1.0:1784191891.105775:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812390528 00000100:00100000:1.0:1784191891.105850:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 573 00000100:00100000:1.0:1784191891.105860:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+88:123690:x1870858812390528:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191891.105884:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191891.105909:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4baba lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb86 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.105983:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bac1 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.105999:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bac1 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.106014:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bac1 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.106029:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4bac8 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.106060:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4bac8 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.106066:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4bac8 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.106438:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bac1 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.106447:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bac1 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.106454:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bac1 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.106462:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bac1 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.106468:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191891.106472:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bac1 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.106554:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bac1 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.106577:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191891.106580:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.106585:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bac1 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.106592:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bac1 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.106624:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4bac8 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.106629:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4bac8 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.106635:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4bac8 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.106640:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191891.106643:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4bac8 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.106649:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4bac8 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.106657:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x4ee593e6 (ffff8af2331f1d00) 00010000:00010000:1.0:1784191891.106659:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.106661:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4bac8 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.106666:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4bac8 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.107225:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4baba lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb86 expref: 89 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.107239:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191891.107242:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.107256:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4baba lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb86 expref: 89 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.107267:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8e00, rc 0) 00000100:00100000:1.0:1784191891.107350:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+88:123690:x1870858812390528:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1490us (2321us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191891.107359:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 573 00000100:00100000:1.0:1784191891.130628:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191891.130891:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812390784 00000100:00100000:0.0:1784191891.130904:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812390784 00000100:00100000:0.0:1784191891.130980:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 574 00000100:00100000:0.0:1784191891.130992:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+88:123690:x1870858812390784:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191891.131024:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191891.131051:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ae00/0xfeec3c2dc5a4bacf lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb8d expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.131191:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bad6 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.131208:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bad6 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.131220:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bad6 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.131235:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4badd lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.131242:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4badd lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.131248:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4badd lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191891.131635:0:158666:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x24f:0x0], index 0: 0 00080000:00000400:0.0:1784191891.131652:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:0.0:1784191891.131675:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:0.0:1784191891.131678:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191891.131681:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191891.131683:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191891.131685:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191891.131783:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:0.0:1784191891.131787:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:0.0:1784191891.131789:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191891.131791:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191891.131793:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191891.131795:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191891.131833:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:0.0:1784191891.131836:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:0.0:1784191891.131838:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191891.131840:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191891.131843:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191891.131845:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191891.131969:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874aa00/0xfeec3c2dc5a4bae4 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.131983:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874aa00/0xfeec3c2dc5a4bae4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.131993:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874aa00/0xfeec3c2dc5a4bae4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.132037:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bad6 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.132045:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bad6 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.132052:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bad6 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.132067:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bad6 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.132073:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874a200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191891.132078:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bad6 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.132085:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bad6 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.132099:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191891.132102:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191891.132107:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bad6 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.132114:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bad6 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191891.132134:0:158666:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d81bbf3 reply state 00000000aeadc2bd transno 34359738690 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4badd lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.132146:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4badd lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.132152:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x4ee593e6 (ffff8af207499a00) 00010000:00010000:0.0:1784191891.132155:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191891.132158:0:158666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191891.132194:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ae00/0xfeec3c2dc5a4bacf lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb8d expref: 91 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.132223:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874aa00/0xfeec3c2dc5a4bae4 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb8d expref: 90 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.132230:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x14:0x0].0x0 (ffff8af207499b00) 00010000:00010000:0.0:1784191891.132232:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191891.132234:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874aa00, rc 0) 00000100:00100000:0.0:1784191891.132313:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+91:123690:x1870858812390784:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1324us (1700us total) trans 34359738690 rc 0/0 00000100:00100000:0.0:1784191891.132322:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 574 00000100:00100000:0.0:1784191891.141831:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.141978:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812390912 00000100:00100000:2.0:1784191891.141989:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812390912 00000100:00100000:2.0:1784191891.142048:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 283 00000100:00100000:2.0:1784191891.142058:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:69109:x1870858812390912:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.142077:0:162387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.142099:0:162387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036f78f4a/0xfeec3c2dc5a4baf2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb94 expref: -99 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191891.142125:0:162387:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191891.142145:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24f:0x0].0x0 since=5511s v=(0 0) 00010000:00010000:2.0:1784191891.142149:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.142160:0:162387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036f78f4a/0xfeec3c2dc5a4baf2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb94 expref: 16 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.142176:0:162387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036f78f4a/0xfeec3c2dc5a4baf2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb94 expref: 16 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.142214:0:162387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6200, rc 0) 00000100:00100000:2.0:1784191891.142275:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+16:69109:x1870858812390912:12345-192.168.204.16@tcp:101:cp.0 Request processed in 219us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191891.142281:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 283 00000100:00100000:1.0:1784191891.145589:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.149289:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812391040 00000100:00100000:2.0:1784191891.149306:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812391040 00000100:00100000:2.0:1784191891.149454:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 284 00000100:00100000:2.0:1784191891.149467:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+16:123690:x1870858812391040:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.149490:0:162392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.149515:0:162392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095cd9ea3/0xfeec3c2dc5a4baf9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bb9b expref: -99 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.149553:0:162392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036f78f4a/0xfeec3c2dc5a4baf2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb94 expref: 17 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.149565:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.149580:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.149586:0:162392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095cd9ea3/0xfeec3c2dc5a4baf9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x24f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb9b expref: 17 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.149628:0:162392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000036f78f4a/0xfeec3c2dc5a4baf2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb94 expref: 17 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.149646:0:162392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000036f78f4a/0xfeec3c2dc5a4baf2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb94 expref: 17 pid: 162387 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191891.149680:0:162392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210300000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:162392:1870858827960320:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191891.149828:0:162392:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191891.155525:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191891.155919:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812391168 00000100:00100000:0.0:1784191891.155932:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812391168 00010000:00010000:0.0:1784191891.155982:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000036f78f4a/0xfeec3c2dc5a4baf2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb94 expref: 18 pid: 162387 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191891.156035:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 149 00000100:00100000:0.0:1784191891.156047:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:69112:x1870858812391168:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191891.156065:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191891.156088:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000036f78f4a/0xfeec3c2dc5a4baf2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb94 expref: 18 pid: 162387 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.156116:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000036f78f4a/0xfeec3c2dc5a4baf2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb94 expref: 18 pid: 162387 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.156148:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.156169:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.156179:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095cd9ea3/0xfeec3c2dc5a4baf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb9b expref: 18 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.156190:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095cd9ea3/0xfeec3c2dc5a4baf9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb9b expref: 18 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.156234:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000095cd9ea3/0xfeec3c2dc5a4baf9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb9b expref: 18 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191891.156249:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827960448:192.168.204.16@tcp:105: 00000100:00100000:0.0:1784191891.156334:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1115026c0 going to sleep for 11 seconds 00010000:00010000:2.0:1784191891.157064:0:162392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036f78f4a/0xfeec3c2dc5a4baf2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb94 expref: 18 pid: 162387 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191891.157084:0:162392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210300000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:162392:1870858827960320:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191891.157135:0:162392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095cd9ea3/0xfeec3c2dc5a4baf9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb9b expref: 17 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.157147:0:162392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7600, rc 0) 00000100:00100000:2.0:1784191891.157192:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:123690:x1870858812391040:12345-192.168.204.16@tcp:101:cp.0 Request processed in 7728us (11622us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191891.157202:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 284 00000100:00100000:1.0:1784191891.162053:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827960448:192.168.204.16@tcp:105: 00010000:00010000:1.0:1784191891.162096:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191891.162172:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+16:69112:x1870858812391168:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6127us (6658us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191891.162184:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 149 00000100:00100000:0.0:1784191891.169756:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.169846:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812391424 00000100:00100000:2.0:1784191891.169858:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812391424 00000100:00100000:2.0:1784191891.169924:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 156 00000100:00100000:2.0:1784191891.169935:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105324050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+91:123690:x1870858812391424:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191891.170260:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105324050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+92:123690:x1870858812391424:12345-192.168.204.16@tcp:35:cp.0 Request processed in 326us (524us total) trans 34359738691 rc 0/0 00000100:00100000:2.0:1784191891.170269:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 156 00000100:00100000:3.0:1784191891.180657:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191891.181877:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812391552 00000100:00100000:0.0:1784191891.181892:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812391552 00000100:00100000:0.0:1784191891.181986:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 575 00000100:00100000:0.0:1784191891.181998:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+92:123690:x1870858812391552:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191891.182027:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191891.182053:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4bb00 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bba2 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182140:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bb07 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182157:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bb07 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182171:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bb07 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182207:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874be00/0xfeec3c2dc5a4bb0e lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182216:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874be00/0xfeec3c2dc5a4bb0e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182222:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874be00/0xfeec3c2dc5a4bb0e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182271:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bb07 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182278:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bb07 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182284:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bb07 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182291:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bb07 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182296:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874b800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191891.182301:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bb07 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182308:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bb07 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182321:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191891.182324:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191891.182329:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bb07 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182343:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bb07 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182361:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874be00/0xfeec3c2dc5a4bb0e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182366:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874be00/0xfeec3c2dc5a4bb0e lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182372:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874be00/0xfeec3c2dc5a4bb0e lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182378:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874be00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191891.182381:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874be00/0xfeec3c2dc5a4bb0e lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182387:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874be00/0xfeec3c2dc5a4bb0e lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182395:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xf0a46efb (ffff8af207499e00) 00010000:00010000:0.0:1784191891.182397:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191891.182400:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874be00/0xfeec3c2dc5a4bb0e lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182405:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874be00/0xfeec3c2dc5a4bb0e lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182441:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4bb00 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bba2 expref: 93 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182465:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191891.182467:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191891.182472:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4bb00 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bba2 expref: 93 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.182482:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874a800, rc 0) 00000100:00100000:0.0:1784191891.182592:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+92:123690:x1870858812391552:12345-192.168.204.16@tcp:101:cp.0 Request processed in 594us (1946us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191891.182600:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 575 00000100:00100000:0.0:1784191891.188304:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191891.191738:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812391680 00000100:00100000:1.0:1784191891.191757:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812391680 00000100:00100000:1.0:1784191891.191841:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 576 00000100:00100000:1.0:1784191891.191853:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+92:123690:x1870858812391680:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191891.191880:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191891.191910:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4bb15 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bba9 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192002:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bb1c lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192022:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bb1c lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192059:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bb1c lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192076:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bb23 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192084:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bb23 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192105:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bb23 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192159:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bb1c lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192167:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bb1c lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192173:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bb1c lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192179:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bb1c lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192186:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191891.192191:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bb1c lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192199:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bb1c lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192213:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191891.192223:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.192230:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bb1c lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192237:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bb1c lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192254:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bb23 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192259:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bb23 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192265:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bb23 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192269:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191891.192271:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bb23 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192277:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bb23 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192284:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xf0a46efb (ffff8af2331f1d00) 00010000:00010000:1.0:1784191891.192286:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.192288:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bb23 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192293:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bb23 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192331:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4bb15 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bba9 expref: 93 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192348:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191891.192350:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.192354:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4bb15 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bba9 expref: 93 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.192363:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4a00, rc 0) 00000100:00100000:1.0:1784191891.192446:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+92:123690:x1870858812391680:12345-192.168.204.16@tcp:101:cp.0 Request processed in 595us (4155us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191891.192454:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 576 00000100:00100000:1.0:1784191891.220151:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.220259:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812391936 00000100:00100000:2.0:1784191891.220272:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812391936 00000100:00100000:2.0:1784191891.220343:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 577 00000100:00100000:2.0:1784191891.220372:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+92:123690:x1870858812391936:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.220398:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.220421:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bb2a lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bbb0 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.220545:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb31 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.220562:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb31 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.220588:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb31 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.220604:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4bb38 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.220610:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4bb38 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.220616:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4bb38 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191891.221034:0:158665:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1cc:0x0], index 1: 0 00080000:00000400:2.0:1784191891.221050:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191891.221054:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191891.221056:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191891.221059:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191891.221061:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191891.221063:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191891.221085:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191891.221118:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191891.221120:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191891.221122:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191891.221124:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191891.221126:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191891.221164:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191891.221167:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191891.221169:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191891.221171:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191891.221173:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191891.221175:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191891.221295:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7200/0xfeec3c2dc5a4bb3f lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.221307:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7200/0xfeec3c2dc5a4bb3f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.221315:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7200/0xfeec3c2dc5a4bb3f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.221359:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb31 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.221367:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb31 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.221373:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb31 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.221380:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb31 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.221385:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d6e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.221399:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb31 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.221406:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb31 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.221418:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.221421:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.221426:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb31 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.221432:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb31 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191891.221447:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c047dbec reply state 0000000015519fa2 transno 34359738692 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4bb38 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.221459:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4bb38 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.221465:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xf0a46efb (ffff8af219b92b00) 00010000:00010000:2.0:1784191891.221468:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191891.221470:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191891.221504:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bb2a lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbb0 expref: 95 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.221518:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7200/0xfeec3c2dc5a4bb3f lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbb0 expref: 94 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.221526:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x15:0x0].0x0 (ffff8af219b92400) 00010000:00010000:2.0:1784191891.221528:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191891.221536:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7200, rc 0) 00000100:00100000:2.0:1784191891.221618:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+95:123690:x1870858812391936:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1248us (1476us total) trans 34359738692 rc 0/0 00000100:00100000:2.0:1784191891.221627:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 577 00000100:00100000:3.0:1784191891.226979:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.227259:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812392064 00000100:00100000:2.0:1784191891.227270:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812392064 00000100:00100000:2.0:1784191891.227338:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 285 00000100:00100000:2.0:1784191891.227348:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:69112:x1870858812392064:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.227369:0:162395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.227392:0:162395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea8ca811/0xfeec3c2dc5a4bb4d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bbb7 expref: -99 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191891.227423:0:162395:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191891.227444:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cc:0x0].0x0 since=5511s v=(0 0) 00010000:00010000:2.0:1784191891.227448:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.227459:0:162395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8ca811/0xfeec3c2dc5a4bb4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbb7 expref: 16 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.227478:0:162395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea8ca811/0xfeec3c2dc5a4bb4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbb7 expref: 16 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.227505:0:162395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7400, rc 0) 00000100:00100000:2.0:1784191891.227581:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+16:69112:x1870858812392064:12345-192.168.204.16@tcp:101:cp.0 Request processed in 234us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191891.227589:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 285 00000100:00100000:1.0:1784191891.240272:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191891.240587:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812392192 00000100:00100000:3.0:1784191891.240599:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812392192 00000100:00100000:3.0:1784191891.240658:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 286 00000100:00100000:3.0:1784191891.240668:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+16:123690:x1870858812392192:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191891.240725:0:160163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191891.240751:0:160163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2deb7eb/0xfeec3c2dc5a4bb54 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bbbe expref: -99 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.240804:0:160163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea8ca811/0xfeec3c2dc5a4bb4d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbb7 expref: 17 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.240814:0:160163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191891.240818:0:160163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191891.240824:0:160163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2deb7eb/0xfeec3c2dc5a4bb54 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbbe expref: 17 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.240856:0:160163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea8ca811/0xfeec3c2dc5a4bb4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbb7 expref: 17 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.240871:0:160163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea8ca811/0xfeec3c2dc5a4bb4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbb7 expref: 17 pid: 162395 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191891.240884:0:160163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1010b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:160163:1870858827960576:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191891.240961:0:160163:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35540 going to sleep for 11 seconds 00000100:00100000:0.0:1784191891.246833:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.246942:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812392320 00000100:00100000:2.0:1784191891.246971:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812392320 00010000:00010000:2.0:1784191891.247014:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8ca811/0xfeec3c2dc5a4bb4d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbb7 expref: 18 pid: 162395 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191891.247063:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 150 00000100:00100000:2.0:1784191891.247073:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:69110:x1870858812392320:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191891.247089:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191891.247119:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea8ca811/0xfeec3c2dc5a4bb4d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbb7 expref: 18 pid: 162395 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.247136:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea8ca811/0xfeec3c2dc5a4bb4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbb7 expref: 18 pid: 162395 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.247166:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.247171:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.247180:0:158652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2deb7eb/0xfeec3c2dc5a4bb54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbbe expref: 18 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.247191:0:158652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2deb7eb/0xfeec3c2dc5a4bb54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbbe expref: 18 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.247234:0:158652:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c2deb7eb/0xfeec3c2dc5a4bb54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbbe expref: 18 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191891.247249:0:158652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:158652:1870858827960704:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191891.247552:0:158652:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af203b79300 going to sleep for 11 seconds 00010000:00010000:3.0:1784191891.247964:0:160163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea8ca811/0xfeec3c2dc5a4bb4d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbb7 expref: 18 pid: 162395 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191891.247981:0:160163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1010b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:160163:1870858827960576:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191891.248011:0:160163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2deb7eb/0xfeec3c2dc5a4bb54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbbe expref: 17 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.248038:0:160163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3e00, rc 0) 00000100:00100000:3.0:1784191891.248076:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:123690:x1870858812392192:12345-192.168.204.16@tcp:101:cp.0 Request processed in 7408us (7812us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191891.248083:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 286 00000100:00100000:2.0:1784191891.256034:0:158652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:158652:1870858827960704:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191891.256060:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191891.256134:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+16:69110:x1870858812392320:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 9061us (9318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191891.256147:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 150 00000100:00100000:1.0:1784191891.259064:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.259440:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812392576 00000100:00100000:2.0:1784191891.259450:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812392576 00000100:00100000:2.0:1784191891.259513:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 157 00000100:00100000:2.0:1784191891.259523:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+95:123690:x1870858812392576:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191891.260644:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+96:123690:x1870858812392576:12345-192.168.204.16@tcp:35:cp.0 Request processed in 1115us (1583us total) trans 34359738693 rc 0/0 00000100:00100000:2.0:1784191891.260654:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 157 00000100:00100000:0.0:1784191891.301626:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.301747:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812392704 00000100:00100000:2.0:1784191891.301760:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812392704 00000100:00100000:2.0:1784191891.301843:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 578 00000100:00100000:2.0:1784191891.301855:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+96:123690:x1870858812392704:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.301887:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.301913:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bb5b lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bbc5 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.301989:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb62 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302008:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb62 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302025:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb62 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302071:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bb69 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302080:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bb69 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302088:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bb69 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302139:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb62 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302147:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb62 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302154:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb62 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302161:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb62 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302167:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d6e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.302171:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb62 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302179:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb62 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302193:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.302196:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.302202:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb62 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302217:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bb62 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302235:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bb69 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302241:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bb69 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302247:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bb69 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302252:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.302254:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bb69 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302261:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bb69 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302269:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x267dbf88 (ffff8af219b92e00) 00010000:00010000:2.0:1784191891.302272:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.302275:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bb69 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302281:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bb69 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302317:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bb5b lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbc5 expref: 97 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302339:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.302341:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.302345:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bb5b lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbc5 expref: 97 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.302354:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6200, rc 0) 00000100:00100000:2.0:1784191891.302430:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+96:123690:x1870858812392704:12345-192.168.204.16@tcp:101:cp.0 Request processed in 577us (817us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191891.302438:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 578 00000100:00100000:0.0:1784191891.305925:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191891.306097:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812392832 00000100:00100000:3.0:1784191891.306110:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812392832 00000100:00100000:3.0:1784191891.306176:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 579 00000100:00100000:3.0:1784191891.306189:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+96:123690:x1870858812392832:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191891.306219:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191891.306247:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4bb70 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bbcc expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306323:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bb77 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306338:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bb77 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306349:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bb77 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306364:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4bb7e lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306371:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4bb7e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306377:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4bb7e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306449:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bb77 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306456:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bb77 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306463:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bb77 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306472:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bb77 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306477:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af110db3c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191891.306481:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bb77 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306501:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bb77 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306514:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191891.306516:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191891.306521:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bb77 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306528:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bb77 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306543:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4bb7e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306549:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4bb7e lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306573:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4bb7e lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306578:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d532800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191891.306581:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4bb7e lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306587:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4bb7e lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306595:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x267dbf88 (ffff8af110071300) 00010000:00010000:3.0:1784191891.306598:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191891.306601:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4bb7e lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306606:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532800/0xfeec3c2dc5a4bb7e lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306649:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4bb70 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbcc expref: 97 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306660:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191891.306663:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191891.306667:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4bb70 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbcc expref: 97 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.306677:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db2200, rc 0) 00000100:00100000:3.0:1784191891.306812:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+96:123690:x1870858812392832:12345-192.168.204.16@tcp:101:cp.0 Request processed in 625us (900us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191891.306839:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 579 00000100:00100000:0.0:1784191891.317593:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.317849:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812393088 00000100:00100000:2.0:1784191891.317861:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812393088 00000100:00100000:2.0:1784191891.317929:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 580 00000100:00100000:2.0:1784191891.317940:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+96:123690:x1870858812393088:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.317963:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.317987:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bb85 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bbd3 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318107:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bb8c lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318125:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bb8c lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318136:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bb8c lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318152:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4bb93 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318177:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4bb93 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318185:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4bb93 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191891.318501:0:158667:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x250:0x0], index 0: 0 00080000:00000400:2.0:1784191891.318516:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191891.318520:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191891.318522:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191891.318524:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191891.318526:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191891.318528:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191891.318546:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191891.318549:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191891.318550:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191891.318552:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191891.318554:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191891.318556:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191891.318595:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191891.318598:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191891.318600:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191891.318602:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191891.318604:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191891.318605:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191891.318728:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4bb9a lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318737:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4bb9a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318772:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4bb9a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318808:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bb8c lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318815:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bb8c lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318822:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bb8c lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318828:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bb8c lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318834:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.318838:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bb8c lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318846:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bb8c lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318858:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.318861:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.318866:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bb8c lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318872:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bb8c lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191891.318886:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001b7890d5 reply state 00000000a55a414a transno 34359738694 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4bb93 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318904:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4bb93 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318911:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x267dbf88 (ffff8af219b92300) 00010000:00010000:2.0:1784191891.318913:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191891.318916:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191891.318946:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bb85 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbd3 expref: 99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318961:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4bb9a lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbd3 expref: 98 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.318968:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x16:0x0].0x0 (ffff8af210e98700) 00010000:00010000:2.0:1784191891.318970:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191891.318972:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7fa00, rc 0) 00000100:00100000:2.0:1784191891.319029:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+99:123690:x1870858812393088:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1090us (1451us total) trans 34359738694 rc 0/0 00000100:00100000:2.0:1784191891.319036:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 580 00000100:00100000:0.0:1784191891.340239:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.340344:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812393216 00000100:00100000:2.0:1784191891.340354:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812393216 00000100:00100000:2.0:1784191891.340417:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 287 00000100:00100000:2.0:1784191891.340429:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+16:69110:x1870858812393216:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.340452:0:160166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.340475:0:160166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eae2b368/0xfeec3c2dc5a4bba8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bbda expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191891.340513:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x250:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191891.340552:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x250:0x0].0x0 since=5511s v=(0 0) 00010000:00010000:2.0:1784191891.340556:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x250:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.340579:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eae2b368/0xfeec3c2dc5a4bba8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbda expref: 17 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.340602:0:160166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eae2b368/0xfeec3c2dc5a4bba8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbda expref: 17 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.340616:0:160166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ea00, rc 0) 00000100:00100000:2.0:1784191891.340681:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:69110:x1870858812393216:12345-192.168.204.16@tcp:101:cp.0 Request processed in 254us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191891.340742:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 287 00000100:00100000:0.0:1784191891.383831:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.384009:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812393344 00000100:00100000:2.0:1784191891.384019:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812393344 00000100:00100000:2.0:1784191891.384080:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 288 00000100:00100000:2.0:1784191891.384091:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:123690:x1870858812393344:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.384111:0:162386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.384131:0:162386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e62983b5/0xfeec3c2dc5a4bbaf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x250:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bbe1 expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.384163:0:162386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eae2b368/0xfeec3c2dc5a4bba8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbda expref: 18 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.384173:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x250:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.384177:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x250:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.384183:0:162386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e62983b5/0xfeec3c2dc5a4bbaf lrc: 4/0,0 mode: --/PW res: [0x280000401:0x250:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbe1 expref: 18 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.384231:0:162386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eae2b368/0xfeec3c2dc5a4bba8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbda expref: 18 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.384245:0:162386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eae2b368/0xfeec3c2dc5a4bba8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbda expref: 18 pid: 160166 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191891.384259:0:162386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:162386:1870858827960832:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191891.384437:0:162386:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af203b79840 going to sleep for 11 seconds 00000100:00100000:2.0:1784191891.399224:0:162386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:162386:1870858827960832:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191891.399264:0:162386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e62983b5/0xfeec3c2dc5a4bbaf lrc: 3/0,0 mode: --/PW res: [0x280000401:0x250:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbe1 expref: 18 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.399286:0:162386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e200, rc 0) 00000100:00100000:2.0:1784191891.399351:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:123690:x1870858812393344:12345-192.168.204.16@tcp:101:cp.0 Request processed in 15262us (15530us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191891.399361:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 288 00000100:00100000:1.0:1784191891.401324:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191891.401422:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812393472 00000100:00100000:0.0:1784191891.401433:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812393472 00010000:00010000:0.0:1784191891.401488:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eae2b368/0xfeec3c2dc5a4bba8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbda expref: 18 pid: 160166 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191891.401533:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 151 00000100:00100000:0.0:1784191891.401544:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:69112:x1870858812393472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191891.401559:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191891.401595:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eae2b368/0xfeec3c2dc5a4bba8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x250:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbda expref: 18 pid: 160166 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.401625:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eae2b368/0xfeec3c2dc5a4bba8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x250:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbda expref: 18 pid: 160166 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.401654:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eae2b368/0xfeec3c2dc5a4bba8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x250:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbda expref: 18 pid: 160166 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.401675:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x250:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.401680:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x250:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.401738:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e62983b5/0xfeec3c2dc5a4bbaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbe1 expref: 17 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.401750:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e62983b5/0xfeec3c2dc5a4bbaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbe1 expref: 17 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.401795:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e62983b5/0xfeec3c2dc5a4bbaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbe1 expref: 17 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191891.401810:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827960960:192.168.204.16@tcp:105: 00000100:00100000:0.0:1784191891.401907:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111502b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784191891.409404:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191891.409503:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812393728 00000100:00100000:1.0:1784191891.409513:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812393728 00000100:00100000:1.0:1784191891.409587:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 158 00000100:00100000:1.0:1784191891.409598:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+99:123690:x1870858812393728:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:1.0:1784191891.409978:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+100:123690:x1870858812393728:12345-192.168.204.16@tcp:35:cp.0 Request processed in 381us (584us total) trans 34359738695 rc 0/0 00000100:00100000:1.0:1784191891.409987:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 158 00000100:00100000:2.0:1784191891.411200:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827960960:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191891.411242:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191891.411301:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:69112:x1870858812393472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 9758us (9987us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191891.411310:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 151 00000100:00100000:0.0:1784191891.416439:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191891.416926:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812393856 00000100:00100000:1.0:1784191891.416937:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812393856 00000100:00100000:1.0:1784191891.417006:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 581 00000100:00100000:1.0:1784191891.417017:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+100:123690:x1870858812393856:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191891.417041:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191891.417079:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4bbb6 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bbe8 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417166:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbbd lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417181:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbbd lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417195:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbbd lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417213:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbc4 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417220:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbc4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417228:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbc4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417274:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbbd lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417280:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbbd lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417286:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbbd lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417293:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbbd lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417311:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191891.417315:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbbd lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417323:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbbd lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417335:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191891.417338:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.417342:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbbd lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417349:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbbd lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417363:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbc4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417369:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbc4 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417374:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbc4 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417380:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191891.417383:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbc4 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417389:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbc4 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417408:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xd946e4d2 (ffff8af2331f1d00) 00010000:00010000:1.0:1784191891.417411:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.417414:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbc4 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417419:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbc4 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417457:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4bbb6 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbe8 expref: 101 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417469:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191891.417470:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.417474:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4bbb6 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbe8 expref: 101 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.417496:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4200, rc 0) 00000100:00100000:1.0:1784191891.417582:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+100:123690:x1870858812393856:12345-192.168.204.16@tcp:101:cp.0 Request processed in 566us (1155us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191891.417591:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 581 00000100:00100000:0.0:1784191891.425486:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.425607:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812393984 00000100:00100000:2.0:1784191891.425620:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812393984 00000100:00100000:2.0:1784191891.425771:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 582 00000100:00100000:2.0:1784191891.425784:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+100:123690:x1870858812393984:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.425809:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.425845:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4bbcb lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bbef expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.425917:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4bbd2 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.425932:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4bbd2 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.425945:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4bbd2 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.425964:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bbd9 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.425971:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bbd9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.425978:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bbd9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.426020:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4bbd2 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.426029:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4bbd2 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.426035:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4bbd2 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.426053:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4bbd2 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.426060:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.426064:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4bbd2 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.426072:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4bbd2 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.426085:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.426088:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.426106:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4bbd2 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.426113:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4bbd2 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.426128:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bbd9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.426134:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bbd9 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.426139:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bbd9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.426143:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.426146:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bbd9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.426173:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bbd9 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.426182:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xd946e4d2 (ffff8af210e98e00) 00010000:00010000:2.0:1784191891.426184:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.426187:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bbd9 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.426193:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bbd9 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.426231:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4bbcb lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbef expref: 101 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.426241:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.426244:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.426247:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4bbcb lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbef expref: 101 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.426257:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ea00, rc 0) 00000100:00100000:2.0:1784191891.426333:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+100:123690:x1870858812393984:12345-192.168.204.16@tcp:101:cp.0 Request processed in 553us (858us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191891.426340:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 582 00000100:00100000:0.0:1784191891.446834:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191891.446991:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812394240 00000100:00100000:1.0:1784191891.447002:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812394240 00000100:00100000:1.0:1784191891.447072:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 583 00000100:00100000:1.0:1784191891.447083:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+100:123690:x1870858812394240:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191891.447107:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191891.447131:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4bbe0 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bbf6 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.447292:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbe7 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.447310:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbe7 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.447323:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbe7 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.447339:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbee lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.447346:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbee lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.447352:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbee lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191891.447788:0:164531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1cd:0x0], index 1: 0 00080000:00000400:1.0:1784191891.447805:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191891.447809:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191891.447811:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191891.447813:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191891.447816:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191891.447817:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191891.447836:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191891.447838:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191891.447840:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191891.447842:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191891.447844:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191891.447854:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191891.447891:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191891.447895:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191891.447897:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191891.447899:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191891.447900:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191891.447902:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191891.448008:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4bbf5 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.448019:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4bbf5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.448025:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4bbf5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.448057:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbe7 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.448064:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbe7 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.448069:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbe7 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.448075:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbe7 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.448081:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191891.448085:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbe7 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.448092:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbe7 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.448111:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191891.448114:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.448119:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbe7 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.448125:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5600/0xfeec3c2dc5a4bbe7 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191891.448138:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009e8e6aa3 reply state 00000000ecbad9e3 transno 34359738696 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbee lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.448149:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbee lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.448154:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xd946e4d2 (ffff8af2331f1d00) 00010000:00010000:1.0:1784191891.448156:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191891.448160:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191891.448194:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4200/0xfeec3c2dc5a4bbe0 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbf6 expref: 103 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.448209:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4bbf5 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbf6 expref: 102 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.448216:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x17:0x0].0x0 (ffff8af2331f1a00) 00010000:00010000:1.0:1784191891.448219:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191891.448221:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4a00, rc 0) 00000100:00100000:1.0:1784191891.448292:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+103:123690:x1870858812394240:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1210us (1469us total) trans 34359738696 rc 0/0 00000100:00100000:1.0:1784191891.448300:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 583 00000100:00100000:3.0:1784191891.457568:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191891.458044:0:162390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812394368 00000100:00100000:0.0:1784191891.458073:0:162390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812394368 00000100:00100000:0.0:1784191891.458160:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 289 00000100:00100000:0.0:1784191891.458171:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+16:69112:x1870858812394368:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191891.458190:0:162390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191891.458212:0:162390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002eee783d/0xfeec3c2dc5a4bc03 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bbfd expref: -99 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191891.458240:0:162390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191891.458260:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cd:0x0].0x0 since=5511s v=(0 0) 00010000:00010000:0.0:1784191891.458265:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.458275:0:162390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002eee783d/0xfeec3c2dc5a4bc03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbfd expref: 17 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.458293:0:162390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002eee783d/0xfeec3c2dc5a4bc03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbfd expref: 17 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.458306:0:162390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874bc00, rc 0) 00000100:00100000:0.0:1784191891.458373:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:69112:x1870858812394368:12345-192.168.204.16@tcp:101:cp.0 Request processed in 203us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191891.458380:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 289 00000100:00100000:3.0:1784191891.468109:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784191891.468145:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827961088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784191891.468221:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191891.468355:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827961088 00000100:00100000:2.0:1784191891.468364:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827961088 00000100:00100000:2.0:1784191891.468446:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784191891.468457:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827961088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784191891.468497:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8227648 pending 0 free 71049216 avail 63881216 00000100:00100000:2.0:1784191891.468578:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827961088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191891.468586:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:3.0:1784191891.469205:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784191891.469255:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827961088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784191891.481409:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191891.481875:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812394496 00000100:00100000:3.0:1784191891.481886:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812394496 00000100:00100000:3.0:1784191891.481955:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 290 00000100:00100000:3.0:1784191891.481967:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:123690:x1870858812394496:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191891.481991:0:162398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191891.482013:0:162398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4bc0a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc04 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.482051:0:162398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002eee783d/0xfeec3c2dc5a4bc03 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbfd expref: 18 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.482061:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191891.482066:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191891.482072:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4bc0a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc04 expref: 18 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.482114:0:162398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002eee783d/0xfeec3c2dc5a4bc03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbfd expref: 18 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.482165:0:162398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002eee783d/0xfeec3c2dc5a4bc03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbfd expref: 18 pid: 162390 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191891.482181:0:162398:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1010b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:162398:1870858827961216:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191891.482283:0:162398:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35540 going to sleep for 11 seconds 00000100:00100000:1.0:1784191891.485650:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191891.485760:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812394624 00000100:00100000:0.0:1784191891.485770:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812394624 00010000:00010000:0.0:1784191891.485809:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002eee783d/0xfeec3c2dc5a4bc03 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbfd expref: 19 pid: 162390 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191891.485853:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 152 00000100:00100000:0.0:1784191891.485877:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:69110:x1870858812394624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191891.485893:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191891.485918:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002eee783d/0xfeec3c2dc5a4bc03 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbfd expref: 19 pid: 162390 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.485935:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002eee783d/0xfeec3c2dc5a4bc03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbfd expref: 19 pid: 162390 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.485962:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.485966:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.485974:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4bc0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc04 expref: 19 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.485985:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4bc0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc04 expref: 19 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.486024:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4bc0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc04 expref: 19 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191891.486038:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827961344:192.168.204.16@tcp:105: 00000100:00100000:0.0:1784191891.486354:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111502a80 going to sleep for 11 seconds 00010000:00010000:3.0:1784191891.488342:0:162398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002eee783d/0xfeec3c2dc5a4bc03 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbfd expref: 19 pid: 162390 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191891.488367:0:162398:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1010b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:162398:1870858827961216:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191891.488404:0:162398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4bc0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc04 expref: 18 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.488419:0:162398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d532800, rc 0) 00000100:00100000:3.0:1784191891.489720:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:123690:x1870858812394496:12345-192.168.204.16@tcp:101:cp.0 Request processed in 7745us (8311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191891.489748:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 290 00000100:00100000:0.0:1784191891.510496:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827961344:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191891.510538:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191891.510625:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:69110:x1870858812394624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 24747us (24983us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191891.510663:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 152 00000100:00100000:2.0:1784191891.525498:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191891.525662:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812394880 00000100:00100000:1.0:1784191891.525676:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812394880 00000100:00100000:1.0:1784191891.525800:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 159 00000100:00100000:1.0:1784191891.525814:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+103:123690:x1870858812394880:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:1.0:1784191891.526213:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+104:123690:x1870858812394880:12345-192.168.204.16@tcp:35:cp.0 Request processed in 401us (733us total) trans 34359738697 rc 0/0 00000100:00100000:1.0:1784191891.526221:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 159 00000100:00100000:1.0:1784191891.530496:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191891.530603:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812395008 00000100:00100000:3.0:1784191891.530614:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812395008 00000100:00100000:3.0:1784191891.530679:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 584 00000100:00100000:3.0:1784191891.530727:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+104:123690:x1870858812395008:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191891.530764:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191891.530790:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4bc11 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc0b expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.530887:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4bc18 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.530902:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4bc18 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.530914:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4bc18 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.530931:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4bc1f lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.530937:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4bc1f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.530944:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4bc1f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.530983:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4bc18 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.530990:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4bc18 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.530997:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4bc18 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.531003:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4bc18 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.531009:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d532000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191891.531020:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4bc18 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.531029:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4bc18 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.531043:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191891.531046:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191891.531052:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4bc18 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.531059:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4bc18 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.531075:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4bc1f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.531081:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4bc1f lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.531087:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4bc1f lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.531093:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af110db2200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191891.531096:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4bc1f lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.531102:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4bc1f lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.531108:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x7584afcd (ffff8af110071300) 00010000:00010000:3.0:1784191891.531111:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191891.531120:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4bc1f lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.531126:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4bc1f lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.531162:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4bc11 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc0b expref: 105 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.531172:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191891.531174:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191891.531178:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4bc11 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc0b expref: 105 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.531186:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d533e00, rc 0) 00000100:00100000:3.0:1784191891.531254:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+104:123690:x1870858812395008:12345-192.168.204.16@tcp:101:cp.0 Request processed in 566us (777us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191891.531262:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 584 00010000:00010000:3.0:1784191891.534149:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191891.536379:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.536494:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812395136 00000100:00100000:2.0:1784191891.536505:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812395136 00000100:00100000:2.0:1784191891.536588:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 585 00000100:00100000:2.0:1784191891.536600:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+104:123690:x1870858812395136:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.536627:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.536649:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bc26 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc12 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.536781:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bc2d lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.536798:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bc2d lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.536808:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bc2d lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.536822:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bc34 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.536828:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bc34 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.536835:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bc34 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.536878:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bc2d lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.536902:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bc2d lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.536910:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bc2d lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.536917:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bc2d lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.536924:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d6200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.536930:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bc2d lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.536938:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bc2d lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.536951:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.536955:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.536959:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bc2d lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.536967:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bc2d lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.536982:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bc34 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.536989:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bc34 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.536996:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bc34 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.537008:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.537012:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bc34 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.537019:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bc34 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.537028:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x7584afcd (ffff8af210e98e00) 00010000:00010000:2.0:1784191891.537030:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.537033:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bc34 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.537039:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bc34 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.537071:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bc26 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc12 expref: 105 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.537082:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.537084:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.537087:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bc26 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc12 expref: 105 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.537096:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7e00, rc 0) 00000100:00100000:2.0:1784191891.537166:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+104:123690:x1870858812395136:12345-192.168.204.16@tcp:101:cp.0 Request processed in 569us (798us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191891.537174:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 585 00000100:00100000:0.0:1784191891.545937:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.546017:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812395392 00000100:00100000:2.0:1784191891.546043:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812395392 00000100:00100000:2.0:1784191891.546106:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 586 00000100:00100000:2.0:1784191891.546117:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+104:123690:x1870858812395392:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.546145:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.546170:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bc3b lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc19 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.546301:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc42 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.546319:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc42 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.546332:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc42 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.546351:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4bc49 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.546358:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4bc49 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.546365:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4bc49 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191891.546805:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x251:0x0], index 0: 0 00080000:00000400:2.0:1784191891.546820:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:2.0:1784191891.546823:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:2.0:1784191891.546825:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191891.546827:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191891.546829:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191891.546842:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191891.546866:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:2.0:1784191891.546869:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:2.0:1784191891.546871:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191891.546872:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191891.546874:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191891.546876:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191891.546910:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:2.0:1784191891.546913:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:2.0:1784191891.546915:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191891.546917:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191891.546918:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191891.546919:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191891.547023:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4bc50 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.547034:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4bc50 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.547041:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4bc50 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.547075:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc42 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.547083:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc42 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.547090:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc42 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.547097:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc42 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.547114:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.547119:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc42 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.547126:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc42 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.547138:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.547141:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.547145:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc42 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.547151:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc42 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191891.547167:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b7be1b59 reply state 000000001fc715ea transno 34359738698 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4bc49 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.547178:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4bc49 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.547184:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x7584afcd (ffff8af210e98000) 00010000:00010000:2.0:1784191891.547187:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191891.547189:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191891.547222:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bc3b lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc19 expref: 107 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.547238:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4bc50 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc19 expref: 106 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.547257:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x18:0x0].0x0 (ffff8af210e98200) 00010000:00010000:2.0:1784191891.547259:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191891.547262:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7e800, rc 0) 00000100:00100000:2.0:1784191891.547331:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+107:123690:x1870858812395392:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1216us (1404us total) trans 34359738698 rc 0/0 00000100:00100000:2.0:1784191891.547340:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 586 00000100:00100000:0.0:1784191891.573273:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.573542:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812395520 00000100:00100000:2.0:1784191891.573555:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812395520 00000100:00100000:2.0:1784191891.573636:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 291 00000100:00100000:2.0:1784191891.573646:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:69109:x1870858812395520:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.573671:0:162387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.573728:0:162387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c9ea05c/0xfeec3c2dc5a4bc5e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc20 expref: -99 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191891.573758:0:162387:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x251:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191891.573782:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x251:0x0].0x0 since=5511s v=(0 0) 00010000:00010000:2.0:1784191891.573788:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x251:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.573799:0:162387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c9ea05c/0xfeec3c2dc5a4bc5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc20 expref: 18 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.573817:0:162387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c9ea05c/0xfeec3c2dc5a4bc5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc20 expref: 18 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.573832:0:162387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6e00, rc 0) 00000100:00100000:2.0:1784191891.573912:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:69109:x1870858812395520:12345-192.168.204.16@tcp:101:cp.0 Request processed in 268us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191891.573919:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 291 00000100:00100000:0.0:1784191891.579153:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191891.579267:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812395648 00000100:00100000:1.0:1784191891.579279:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812395648 00000100:00100000:1.0:1784191891.579350:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 292 00000100:00100000:1.0:1784191891.579361:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:123690:x1870858812395648:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191891.579380:0:162389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191891.579404:0:162389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4bc65 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x251:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc27 expref: -99 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.579437:0:162389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c9ea05c/0xfeec3c2dc5a4bc5e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc20 expref: 19 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.579446:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x251:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191891.579451:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x251:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191891.579457:0:162389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4bc65 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x251:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc27 expref: 19 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.579501:0:162389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c9ea05c/0xfeec3c2dc5a4bc5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc20 expref: 19 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.579539:0:162389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c9ea05c/0xfeec3c2dc5a4bc5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc20 expref: 19 pid: 162387 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191891.579555:0:162389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:162389:1870858827961472:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191891.579660:0:162389:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e69e480 going to sleep for 11 seconds 00000100:00100000:2.0:1784191891.594936:0:162389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:162389:1870858827961472:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191891.594986:0:162389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4bc65 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x251:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc27 expref: 19 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.595011:0:162389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4200, rc 0) 00000100:00100000:2.0:1784191891.595087:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:123690:x1870858812395648:12345-192.168.204.16@tcp:101:cp.0 Request processed in 15727us (15943us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191891.595097:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 292 00000100:00100000:0.0:1784191891.600426:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.600625:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812395776 00000100:00100000:2.0:1784191891.600638:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812395776 00010000:00010000:2.0:1784191891.600727:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c9ea05c/0xfeec3c2dc5a4bc5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc20 expref: 19 pid: 162387 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191891.600772:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 153 00000100:00100000:2.0:1784191891.600782:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af202d70850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:69111:x1870858812395776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191891.600801:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191891.600824:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c9ea05c/0xfeec3c2dc5a4bc5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc20 expref: 19 pid: 162387 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.600841:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c9ea05c/0xfeec3c2dc5a4bc5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc20 expref: 19 pid: 162387 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.600869:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c9ea05c/0xfeec3c2dc5a4bc5e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc20 expref: 19 pid: 162387 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.600907:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x251:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.600912:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x251:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.600922:0:158652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4bc65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc27 expref: 18 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.600934:0:158652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4bc65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc27 expref: 18 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.600980:0:158652:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4bc65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc27 expref: 18 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191891.600997:0:158652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:158652:1870858827961600:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191891.601082:0:158652:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af203b79b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784191891.604320:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191891.604610:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812396032 00000100:00100000:1.0:1784191891.604623:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812396032 00000100:00100000:1.0:1784191891.604728:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 160 00000100:00100000:1.0:1784191891.604740:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+107:123690:x1870858812396032:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:1.0:1784191891.605259:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+108:123690:x1870858812396032:12345-192.168.204.16@tcp:35:cp.0 Request processed in 517us (946us total) trans 34359738699 rc 0/0 00000100:00100000:1.0:1784191891.605269:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 160 00000100:00100000:2.0:1784191891.606333:0:158652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:158652:1870858827961600:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191891.606361:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191891.606403:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af202d70850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:69111:x1870858812395776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5622us (5990us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191891.606412:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 153 00000100:00100000:0.0:1784191891.623863:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.624851:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812396160 00000100:00100000:2.0:1784191891.624866:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812396160 00000100:00100000:2.0:1784191891.624941:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 587 00000100:00100000:2.0:1784191891.624952:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+108:123690:x1870858812396160:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.624979:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.625001:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bc6c lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc2e expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625100:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc73 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625117:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc73 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625132:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc73 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625148:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bc7a lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625156:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bc7a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625162:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bc7a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625212:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc73 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625219:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc73 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625226:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc73 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625231:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc73 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625238:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.625249:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc73 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625258:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc73 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625272:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.625275:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.625280:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc73 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625287:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bc73 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625304:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bc7a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625311:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bc7a lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625317:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bc7a lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625328:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.625331:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bc7a lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625336:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bc7a lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625343:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xf4c8ca43 (ffff8af210e98400) 00010000:00010000:2.0:1784191891.625346:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.625356:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bc7a lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625363:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bc7a lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625403:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bc6c lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc2e expref: 109 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625414:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.625416:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.625420:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bc6c lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc2e expref: 109 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.625429:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6e00, rc 0) 00000100:00100000:2.0:1784191891.625517:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+108:123690:x1870858812396160:12345-192.168.204.16@tcp:101:cp.0 Request processed in 567us (1668us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191891.625526:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 587 00000100:00100000:0.0:1784191891.634122:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191891.634335:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812396288 00000100:00100000:3.0:1784191891.634347:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812396288 00000100:00100000:3.0:1784191891.634414:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 588 00000100:00100000:3.0:1784191891.634427:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+108:123690:x1870858812396288:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191891.634450:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191891.634473:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4bc81 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc35 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634550:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bc88 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634591:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bc88 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634604:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bc88 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634623:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4bc8f lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634629:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4bc8f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634635:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4bc8f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634677:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bc88 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634684:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bc88 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634741:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bc88 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634748:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bc88 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634754:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af110db3c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191891.634758:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bc88 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634766:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bc88 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634785:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191891.634788:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191891.634792:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bc88 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634798:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3c00/0xfeec3c2dc5a4bc88 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634811:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4bc8f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634817:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4bc8f lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634822:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4bc8f lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634827:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191891.634830:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4bc8f lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634836:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4bc8f lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634843:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xf4c8ca43 (ffff8af110071300) 00010000:00010000:3.0:1784191891.634846:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191891.634849:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4bc8f lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634854:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533e00/0xfeec3c2dc5a4bc8f lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634902:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4bc81 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc35 expref: 109 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634914:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191891.634916:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191891.634920:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2200/0xfeec3c2dc5a4bc81 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc35 expref: 109 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.634929:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db2200, rc 0) 00000100:00100000:3.0:1784191891.634987:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+108:123690:x1870858812396288:12345-192.168.204.16@tcp:101:cp.0 Request processed in 563us (880us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191891.634994:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 588 00000100:00100000:1.0:1784191891.639663:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191891.639918:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812396544 00000100:00100000:3.0:1784191891.639933:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812396544 00000100:00100000:3.0:1784191891.640020:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 589 00000100:00100000:3.0:1784191891.640032:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+108:123690:x1870858812396544:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191891.640060:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191891.640087:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4bc96 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc3c expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.640224:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bc9d lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.640241:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bc9d lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.640254:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bc9d lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.640288:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4bca4 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.640296:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4bca4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.640302:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4bca4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191891.640661:0:158666:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1ce:0x0], index 1: 0 00080000:00000400:3.0:1784191891.640677:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191891.640681:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191891.640684:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191891.640686:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191891.644467:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191891.644471:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191891.644541:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191891.644545:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191891.644547:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191891.644549:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191891.644550:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191891.644552:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191891.653037:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191891.653050:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191891.653053:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191891.653055:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191891.653057:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191891.653059:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191891.654116:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bcab lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.654160:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bcab lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.654176:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bcab lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.654244:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bc9d lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.654252:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bc9d lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.654258:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bc9d lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.654266:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bc9d lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.654272:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3fa00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.654277:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bc9d lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.654285:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bc9d lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.654300:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.654303:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.654309:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bc9d lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.654317:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bc9d lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191891.654333:0:158666:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d2c9cc7e reply state 00000000d2cc0e46 transno 34359738700 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4bca4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.654345:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4bca4 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.656208:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xf4c8ca43 (ffff8af110071c00) 00010000:00010000:2.0:1784191891.656212:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191891.656218:0:158666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191891.656293:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532000/0xfeec3c2dc5a4bc96 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc3c expref: 111 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.656320:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bcab lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc3c expref: 110 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.656329:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x19:0x0].0x0 (ffff8af210e98400) 00010000:00010000:2.0:1784191891.656331:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191891.656333:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6e00, rc 0) 00000100:00100000:2.0:1784191891.656446:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+111:123690:x1870858812396544:12345-192.168.204.16@tcp:101:cp.0 Request processed in 16415us (16796us total) trans 34359738700 rc 0/0 00000100:00100000:2.0:1784191891.656458:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 589 00000100:00100000:0.0:1784191891.663042:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.663154:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812396672 00000100:00100000:2.0:1784191891.663165:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812396672 00000100:00100000:2.0:1784191891.663238:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 293 00000100:00100000:2.0:1784191891.663249:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:69112:x1870858812396672:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.663268:0:162395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.663294:0:162395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026647aae/0xfeec3c2dc5a4bcb9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc43 expref: -99 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191891.663319:0:162395:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191891.663339:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ce:0x0].0x0 since=5511s v=(0 0) 00010000:00010000:2.0:1784191891.663344:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.663380:0:162395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026647aae/0xfeec3c2dc5a4bcb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc43 expref: 18 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.663399:0:162395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000026647aae/0xfeec3c2dc5a4bcb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc43 expref: 18 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.663411:0:162395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7e00, rc 0) 00000100:00100000:2.0:1784191891.663481:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:69112:x1870858812396672:12345-192.168.204.16@tcp:101:cp.0 Request processed in 222us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191891.663489:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 293 00000100:00100000:0.0:1784191891.670804:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191891.670911:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812396800 00000100:00100000:1.0:1784191891.670921:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812396800 00000100:00100000:1.0:1784191891.670978:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 294 00000100:00100000:1.0:1784191891.670987:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:123690:x1870858812396800:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191891.671008:0:162385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191891.671029:0:162385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073e3f816/0xfeec3c2dc5a4bcc0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc4a expref: -99 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.671063:0:162385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000026647aae/0xfeec3c2dc5a4bcb9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc43 expref: 19 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.671093:0:162385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191891.671098:0:162385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191891.671104:0:162385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073e3f816/0xfeec3c2dc5a4bcc0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc4a expref: 19 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.671151:0:162385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000026647aae/0xfeec3c2dc5a4bcb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc43 expref: 19 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.671167:0:162385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000026647aae/0xfeec3c2dc5a4bcb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc43 expref: 19 pid: 162395 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191891.671181:0:162385:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:162385:1870858827961728:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191891.671276:0:162385:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e69eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784191891.678394:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.678638:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812396928 00000100:00100000:2.0:1784191891.678647:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812396928 00010000:00010000:2.0:1784191891.678732:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000026647aae/0xfeec3c2dc5a4bcb9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc43 expref: 20 pid: 162395 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191891.678774:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 154 00000100:00100000:2.0:1784191891.678785:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+20:69109:x1870858812396928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191891.678802:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191891.678830:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000026647aae/0xfeec3c2dc5a4bcb9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc43 expref: 20 pid: 162395 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.678846:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000026647aae/0xfeec3c2dc5a4bcb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc43 expref: 20 pid: 162395 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.678875:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.678880:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.678905:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073e3f816/0xfeec3c2dc5a4bcc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc4a expref: 20 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.678915:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073e3f816/0xfeec3c2dc5a4bcc0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc4a expref: 20 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.678952:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000073e3f816/0xfeec3c2dc5a4bcc0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc4a expref: 20 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191891.678967:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827961856:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191891.679058:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af203b79180 going to sleep for 11 seconds 00010000:00010000:1.0:1784191891.679137:0:162385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026647aae/0xfeec3c2dc5a4bcb9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc43 expref: 20 pid: 162395 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191891.679154:0:162385:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:162385:1870858827961728:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191891.679186:0:162385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000073e3f816/0xfeec3c2dc5a4bcc0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc4a expref: 19 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.679196:0:162385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5600, rc 0) 00000100:00100000:1.0:1784191891.679227:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:123690:x1870858812396800:12345-192.168.204.16@tcp:101:cp.0 Request processed in 8241us (8436us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191891.679245:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 294 00000100:00100000:2.0:1784191891.686537:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827961856:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191891.686580:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191891.686654:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:69109:x1870858812396928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7869us (8271us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191891.686666:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 154 00000100:00100000:3.0:1784191891.693523:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191891.693840:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812397184 00000100:00100000:1.0:1784191891.693851:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812397184 00000100:00100000:1.0:1784191891.693916:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 161 00000100:00100000:1.0:1784191891.693928:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+111:123690:x1870858812397184:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:1.0:1784191891.694260:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+112:123690:x1870858812397184:12345-192.168.204.16@tcp:35:cp.0 Request processed in 332us (745us total) trans 34359738701 rc 0/0 00000100:00100000:1.0:1784191891.694268:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 161 00000100:00100000:0.0:1784191891.703841:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.704245:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812397312 00000100:00100000:2.0:1784191891.704257:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812397312 00000100:00100000:2.0:1784191891.704329:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 590 00000100:00100000:2.0:1784191891.704341:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+112:123690:x1870858812397312:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.704384:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.704408:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcc7 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc51 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705309:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a000/0xfeec3c2dc5a4bcce lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705329:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a000/0xfeec3c2dc5a4bcce lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705341:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a000/0xfeec3c2dc5a4bcce lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705368:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bcd5 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705375:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bcd5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705381:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bcd5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705445:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a000/0xfeec3c2dc5a4bcce lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705453:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a000/0xfeec3c2dc5a4bcce lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705458:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a000/0xfeec3c2dc5a4bcce lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705482:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a000/0xfeec3c2dc5a4bcce lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705488:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874a000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191891.705492:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a000/0xfeec3c2dc5a4bcce lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705499:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a000/0xfeec3c2dc5a4bcce lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705510:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191891.705513:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191891.705517:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a000/0xfeec3c2dc5a4bcce lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705523:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a000/0xfeec3c2dc5a4bcce lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705541:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bcd5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705548:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bcd5 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705571:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bcd5 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705576:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874bc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191891.705579:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bcd5 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705585:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bcd5 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705592:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x130bf32a (ffff8af207499600) 00010000:00010000:0.0:1784191891.705595:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191891.705597:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bcd5 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705602:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bcd5 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705640:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcc7 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc51 expref: 113 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705651:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191891.705653:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191891.705656:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcc7 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc51 expref: 113 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.705666:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7000, rc 0) 00000100:00100000:0.0:1784191891.706073:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+112:123690:x1870858812397312:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1731us (2241us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191891.706092:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 590 00000100:00100000:0.0:1784191891.716121:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.716223:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812397440 00000100:00100000:2.0:1784191891.716233:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812397440 00000100:00100000:2.0:1784191891.716326:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 591 00000100:00100000:2.0:1784191891.716336:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+112:123690:x1870858812397440:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.716367:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.716389:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bcdc lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc58 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.716462:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bce3 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.716964:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bce3 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.716977:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bce3 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.716994:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcea lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.717001:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcea lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.717007:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcea lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.717047:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bce3 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.717054:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bce3 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.717060:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bce3 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.717077:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bce3 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.717083:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d6200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.717088:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bce3 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.717095:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bce3 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.717108:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.717111:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.717116:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bce3 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.717123:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bce3 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.717136:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcea lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.717290:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcea lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.717297:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcea lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.717302:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.717305:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcea lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.717322:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcea lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.717331:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x130bf32a (ffff8af210e98900) 00010000:00010000:2.0:1784191891.717333:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.717336:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcea lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.717341:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcea lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.717461:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bcdc lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc58 expref: 113 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.718022:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.718026:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.718031:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bcdc lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc58 expref: 113 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.718044:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7400, rc 0) 00000100:00100000:2.0:1784191891.718193:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+112:123690:x1870858812397440:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1857us (2084us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191891.718202:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 591 00000100:00100000:0.0:1784191891.734963:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.735141:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812397696 00000100:00100000:2.0:1784191891.735153:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812397696 00000100:00100000:2.0:1784191891.735231:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 592 00000100:00100000:2.0:1784191891.735243:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+112:123690:x1870858812397696:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.735284:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.735308:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bcf1 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc5f expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.735429:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcf8 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.735447:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcf8 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.735460:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcf8 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.735496:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bcff lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.735503:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bcff lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.735509:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bcff lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191891.735935:0:158666:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x252:0x0], index 0: 0 00080000:00000400:2.0:1784191891.735947:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191891.735951:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191891.735954:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191891.735956:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191891.735958:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191891.735960:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191891.735977:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191891.735980:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191891.735989:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191891.735991:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191891.735992:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191891.735994:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191891.736026:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191891.736029:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191891.736030:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191891.736032:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191891.736034:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191891.736036:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191891.736122:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bd06 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.736132:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bd06 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.736140:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bd06 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.736172:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcf8 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.736178:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcf8 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.736184:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcf8 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.736190:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcf8 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.736196:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.736200:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcf8 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.736212:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcf8 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.736225:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.736228:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.736232:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcf8 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.736239:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bcf8 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191891.736253:0:158666:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000932427c1 reply state 00000000555f0a3c transno 34359738702 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bcff lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.736264:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bcff lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.736270:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x130bf32a (ffff8af210e98900) 00010000:00010000:2.0:1784191891.736273:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191891.736275:0:158666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191891.736305:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bcf1 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc5f expref: 115 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.736319:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bd06 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc5f expref: 114 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.736326:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1a:0x0].0x0 (ffff8af210e98a00) 00010000:00010000:2.0:1784191891.736328:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191891.736330:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7e00, rc 0) 00000100:00100000:2.0:1784191891.736398:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+115:123690:x1870858812397696:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1157us (1453us total) trans 34359738702 rc 0/0 00000100:00100000:2.0:1784191891.736405:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 592 00000100:00100000:0.0:1784191891.737193:0:158690:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:158690:1870858827961984:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784191891.737263:0:158690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191891.737297:0:158690:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111502a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784191891.739672:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827961984 00000100:00100000:2.0:1784191891.739706:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827961984 00000100:00100000:2.0:1784191891.739902:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1784191891.739913:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:158690:x1870858827961984:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1784191891.739969:0:160166:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 610 00002000:00080000:2.0:1784191891.740568:0:160166:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 618 00000001:00080000:2.0:1784191891.741012:0:160166:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836545 00002000:00080000:2.0:1784191891.741029:0:160166:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 626 00000001:00080000:2.0:1784191891.741333:0:160166:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836546 00002000:00080000:2.0:1784191891.741348:0:160166:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 634 00000100:00100000:1.0:1784191891.743884:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000001:00080000:2.0:1784191891.744399:0:160166:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836547 00000100:00100000:2.0:1784191891.744531:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:158690:x1870858827961984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4618us (7266us total) trans 21474836548 rc 0/0 00000100:00100000:2.0:1784191891.744542:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000020:00080000:2.0:1784191891.744548:0:160166:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00000100:00100000:3.0:1784191891.744638:0:158690:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:158690:1870858827961984:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784191891.744657:0:158690:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x252:0x0]-[0x280000401:0x281:0x0] 00000100:00100000:0.0:1784191891.745267:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812397824 00000100:00100000:0.0:1784191891.745275:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812397824 00000100:00100000:3.0:1784191891.745349:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 296 00000100:00100000:3.0:1784191891.745361:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:69110:x1870858812397824:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191891.745379:0:162396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191891.745421:0:162396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd14 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc66 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191891.745448:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x252:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784191891.745480:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x252:0x0].0x0 since=5511s v=(0 0) 00010000:00010000:3.0:1784191891.745485:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x252:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191891.745495:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc66 expref: 19 pid: 162396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.745514:0:162396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc66 expref: 19 pid: 162396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.745527:0:162396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3f000, rc 0) 00000100:00100000:3.0:1784191891.745598:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:69110:x1870858812397824:12345-192.168.204.16@tcp:101:cp.0 Request processed in 239us (1726us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191891.745605:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 296 00000100:00100000:1.0:1784191891.776726:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191891.782250:0:162390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812397952 00000100:00100000:0.0:1784191891.782271:0:162390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812397952 00000100:00100000:0.0:1784191891.782581:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 297 00000100:00100000:0.0:1784191891.782596:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:123690:x1870858812397952:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191891.782623:0:162390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191891.782655:0:162390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1b06070/0xfeec3c2dc5a4bd1b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x252:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc6d expref: -99 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.782719:0:162390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd14 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc66 expref: 20 pid: 162396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.782730:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x252:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.782735:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x252:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.782742:0:162390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1b06070/0xfeec3c2dc5a4bd1b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x252:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc6d expref: 20 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.782787:0:162390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc66 expref: 20 pid: 162396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.782829:0:162390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd14 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc66 expref: 20 pid: 162396 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191891.782845:0:162390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:162390:1870858827962112:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191891.782989:0:162390:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111502540 going to sleep for 11 seconds 00000100:00100000:1.0:1784191891.787335:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.787465:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812398080 00000100:00100000:2.0:1784191891.787480:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812398080 00010000:00010000:2.0:1784191891.787538:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd14 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc66 expref: 21 pid: 162396 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191891.787593:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 155 00000100:00100000:2.0:1784191891.787605:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:69112:x1870858812398080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191891.787625:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191891.787659:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd14 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x252:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc66 expref: 21 pid: 162396 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.787758:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd14 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x252:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc66 expref: 21 pid: 162396 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.787794:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x252:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.787799:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x252:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.787810:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1b06070/0xfeec3c2dc5a4bd1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x252:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc6d expref: 21 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.787822:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1b06070/0xfeec3c2dc5a4bd1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x252:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc6d expref: 21 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.787869:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d1b06070/0xfeec3c2dc5a4bd1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x252:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc6d expref: 21 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191891.787886:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827962240:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191891.787990:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10d3029c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784191891.789043:0:162390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd14 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x252:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc66 expref: 21 pid: 162396 timeout: 5611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191891.789067:0:162390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:162390:1870858827962112:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191891.789112:0:162390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1b06070/0xfeec3c2dc5a4bd1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc6d expref: 20 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.789125:0:162390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874a000, rc 0) 00000100:00100000:0.0:1784191891.789187:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+20:123690:x1870858812397952:12345-192.168.204.16@tcp:101:cp.0 Request processed in 6595us (12476us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191891.789198:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 297 00000100:00100000:3.0:1784191891.800757:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827962240:192.168.204.16@tcp:105: 00010000:00010000:3.0:1784191891.800793:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191891.800861:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:69112:x1870858812398080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 13257us (13537us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191891.800874:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 155 00000100:00100000:1.0:1784191891.802623:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191891.803414:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812398336 00000100:00100000:3.0:1784191891.803428:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812398336 00000100:00100000:3.0:1784191891.803603:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 162 00000100:00100000:3.0:1784191891.803614:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105327850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+115:123690:x1870858812398336:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191891.804001:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105327850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+116:123690:x1870858812398336:12345-192.168.204.16@tcp:35:cp.0 Request processed in 387us (1384us total) trans 34359738703 rc 0/0 00000100:00100000:3.0:1784191891.804025:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 162 00000100:00100000:1.0:1784191891.809444:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191891.809567:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812398464 00000100:00100000:0.0:1784191891.809579:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812398464 00000100:00100000:0.0:1784191891.809644:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 593 00000100:00100000:0.0:1784191891.809655:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+116:123690:x1870858812398464:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191891.809682:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191891.809741:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a400/0xfeec3c2dc5a4bd22 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc74 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.809830:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bd29 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.809844:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bd29 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.809854:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bd29 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.809868:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a600/0xfeec3c2dc5a4bd30 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.809874:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a600/0xfeec3c2dc5a4bd30 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.809880:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a600/0xfeec3c2dc5a4bd30 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.809920:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bd29 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.809926:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bd29 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.809933:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bd29 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.809939:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bd29 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.809944:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874b600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191891.809955:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bd29 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.809962:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bd29 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.809973:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191891.809976:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191891.809980:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bd29 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.809987:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bd29 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.810005:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a600/0xfeec3c2dc5a4bd30 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.810012:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a600/0xfeec3c2dc5a4bd30 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.810017:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a600/0xfeec3c2dc5a4bd30 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.810022:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874a600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191891.810024:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a600/0xfeec3c2dc5a4bd30 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.810030:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a600/0xfeec3c2dc5a4bd30 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.810038:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe00215d9 (ffff8af207499600) 00010000:00010000:0.0:1784191891.810040:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191891.810049:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a600/0xfeec3c2dc5a4bd30 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.810055:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a600/0xfeec3c2dc5a4bd30 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.810093:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a400/0xfeec3c2dc5a4bd22 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc74 expref: 117 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.810103:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191891.810106:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191891.810109:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a400/0xfeec3c2dc5a4bd22 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc74 expref: 117 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.810118:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874a400, rc 0) 00000100:00100000:0.0:1784191891.810182:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+116:123690:x1870858812398464:12345-192.168.204.16@tcp:101:cp.0 Request processed in 529us (752us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191891.810190:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 593 00000100:00100000:0.0:1784191891.813045:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191891.813310:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812398592 00000100:00100000:1.0:1784191891.813322:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812398592 00000100:00100000:1.0:1784191891.813384:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 594 00000100:00100000:1.0:1784191891.813396:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+116:123690:x1870858812398592:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191891.813418:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191891.813443:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4bd37 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc7b expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.813531:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bd3e lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.813549:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bd3e lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.813593:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bd3e lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.813610:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bd45 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.813617:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bd45 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.813624:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bd45 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.813672:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bd3e lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.813679:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bd3e lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.813685:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bd3e lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.813717:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bd3e lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.813979:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191891.813987:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bd3e lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.813996:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bd3e lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.814009:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191891.814020:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.814025:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bd3e lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.814033:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4bd3e lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.814048:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bd45 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.814053:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bd45 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.814058:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bd45 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.814062:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191891.814065:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bd45 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.814070:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bd45 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.814076:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe00215d9 (ffff8af2331f1300) 00010000:00010000:1.0:1784191891.814078:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.814081:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bd45 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.814086:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bd45 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.814228:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4bd37 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc7b expref: 117 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.814246:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191891.814248:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.814251:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4bd37 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc7b expref: 117 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.814260:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8e00, rc 0) 00000100:00100000:1.0:1784191891.814333:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+116:123690:x1870858812398592:12345-192.168.204.16@tcp:101:cp.0 Request processed in 939us (1300us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191891.814341:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 594 00000100:00100000:2.0:1784191891.818203:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191891.818268:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812398848 00000100:00100000:3.0:1784191891.818279:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812398848 00000100:00100000:3.0:1784191891.818365:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 595 00000100:00100000:3.0:1784191891.818376:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+116:123690:x1870858812398848:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191891.818399:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191891.818422:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bd4c lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc82 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.818552:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bd53 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.818577:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bd53 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.818589:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bd53 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.818604:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4bd5a lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.818611:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4bd5a lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.818617:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4bd5a lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191891.818969:0:164531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1cf:0x0], index 1: 0 00080000:00000400:3.0:1784191891.818982:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191891.819000:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191891.819003:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191891.819005:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191891.819007:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191891.819010:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191891.819027:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191891.819029:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191891.819031:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191891.819033:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191891.819036:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191891.819038:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191891.819064:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191891.819066:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191891.819068:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191891.819070:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191891.819072:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191891.819074:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191891.819180:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4bd61 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.819190:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4bd61 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.819198:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4bd61 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.819230:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bd53 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.819238:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bd53 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.819245:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bd53 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.819258:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bd53 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.819264:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3f600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191891.819269:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bd53 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.819276:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bd53 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.819289:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191891.819292:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191891.819295:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bd53 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.819302:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bd53 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191891.819314:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005983c99a reply state 000000001de8ec6d transno 34359738704 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4bd5a lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.819324:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4bd5a lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.819330:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe00215d9 (ffff8af2112b6600) 00010000:00010000:3.0:1784191891.819332:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191891.819334:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784191891.819361:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bd4c lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc82 expref: 119 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.819387:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4bd61 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc82 expref: 118 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.819394:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1b:0x0].0x0 (ffff8af2112b6200) 00010000:00010000:3.0:1784191891.819396:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784191891.819398:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3ea00, rc 0) 00000100:00100000:3.0:1784191891.819461:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+119:123690:x1870858812398848:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1087us (1268us total) trans 34359738704 rc 0/0 00000100:00100000:3.0:1784191891.819468:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 595 00000100:00100000:0.0:1784191891.829078:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191891.829196:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812398976 00000100:00100000:3.0:1784191891.829207:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812398976 00000100:00100000:3.0:1784191891.829270:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 298 00000100:00100000:3.0:1784191891.829282:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:69112:x1870858812398976:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191891.829304:0:160165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191891.829326:0:160165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd6f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc89 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191891.829353:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784191891.829374:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cf:0x0].0x0 since=5512s v=(0 0) 00010000:00010000:3.0:1784191891.829379:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191891.829390:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc89 expref: 19 pid: 160165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.829410:0:160165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc89 expref: 19 pid: 160165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.829448:0:160165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3f000, rc 0) 00000100:00100000:3.0:1784191891.829664:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:69112:x1870858812398976:12345-192.168.204.16@tcp:101:cp.0 Request processed in 383us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191891.829672:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 298 00000100:00100000:1.0:1784191891.833168:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191891.833298:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812399104 00000100:00100000:0.0:1784191891.833310:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812399104 00000100:00100000:0.0:1784191891.833385:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 299 00000100:00100000:0.0:1784191891.833396:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:123690:x1870858812399104:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191891.833421:0:162387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191891.833443:0:162387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e52d9cf4/0xfeec3c2dc5a4bd76 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc90 expref: -99 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.833488:0:162387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd6f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc89 expref: 20 pid: 160165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.833514:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.833519:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.833525:0:162387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e52d9cf4/0xfeec3c2dc5a4bd76 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->57343] (req 0->57343) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc90 expref: 20 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.833572:0:162387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc89 expref: 20 pid: 160165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.833588:0:162387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc89 expref: 20 pid: 160165 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191891.833604:0:162387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:162387:1870858827962368:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191891.833723:0:162387:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111502540 going to sleep for 11 seconds 00000100:00100000:1.0:1784191891.837103:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.837253:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812399232 00000100:00100000:2.0:1784191891.837263:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812399232 00010000:00010000:2.0:1784191891.837309:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd6f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc89 expref: 21 pid: 160165 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191891.837429:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 156 00000100:00100000:3.0:1784191891.837442:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:69109:x1870858812399232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191891.837459:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191891.837493:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd6f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc89 expref: 21 pid: 160165 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.837508:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc89 expref: 21 pid: 160165 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.837535:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191891.837540:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191891.837549:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e52d9cf4/0xfeec3c2dc5a4bd76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc90 expref: 21 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.837568:0:158650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e52d9cf4/0xfeec3c2dc5a4bd76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc90 expref: 21 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.837610:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e52d9cf4/0xfeec3c2dc5a4bd76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc90 expref: 21 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191891.837649:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1010b8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:158650:1870858827962496:192.168.204.16@tcp:105: 00000100:00100000:3.0:1784191891.837788:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35f00 going to sleep for 11 seconds 00010000:00010000:0.0:1784191891.838844:0:162387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bd6f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc89 expref: 21 pid: 160165 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191891.838866:0:162387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:162387:1870858827962368:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191891.838896:0:162387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e52d9cf4/0xfeec3c2dc5a4bd76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc90 expref: 20 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.838908:0:162387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874a400, rc 0) 00000100:00100000:1.0:1784191891.839021:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+20:123690:x1870858812399104:12345-192.168.204.16@tcp:101:cp.0 Request processed in 5625us (5866us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191891.839030:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 299 00000100:00100000:1.0:1784191891.845149:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191891.845320:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1010b8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:158650:1870858827962496:192.168.204.16@tcp:105: 00010000:00010000:3.0:1784191891.845358:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191891.845424:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:69109:x1870858812399232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7985us (8344us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191891.845437:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 156 00000100:00100000:2.0:1784191891.845651:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812399488 00000100:00100000:2.0:1784191891.845659:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812399488 00000100:00100000:2.0:1784191891.845739:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 163 00000100:00100000:2.0:1784191891.845764:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+119:123690:x1870858812399488:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191891.846329:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+120:123690:x1870858812399488:12345-192.168.204.16@tcp:35:cp.0 Request processed in 565us (1193us total) trans 34359738705 rc 0/0 00000100:00100000:2.0:1784191891.846337:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 163 00000100:00100000:1.0:1784191891.849833:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.849948:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812399616 00000100:00100000:2.0:1784191891.849960:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812399616 00000100:00100000:2.0:1784191891.850025:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 596 00000100:00100000:2.0:1784191891.850036:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+120:123690:x1870858812399616:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.850068:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.850106:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bd7d lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc97 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850180:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bd84 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850196:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bd84 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850214:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bd84 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850257:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc600/0xfeec3c2dc5a4bd8b lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850266:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc600/0xfeec3c2dc5a4bd8b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850274:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc600/0xfeec3c2dc5a4bd8b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850340:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bd84 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850348:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bd84 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850353:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bd84 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850360:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bd84 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850366:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.850371:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bd84 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850378:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bd84 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850390:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.850394:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.850398:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bd84 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850404:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4bd84 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850422:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc600/0xfeec3c2dc5a4bd8b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850428:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc600/0xfeec3c2dc5a4bd8b lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850441:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc600/0xfeec3c2dc5a4bd8b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850447:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cc600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.850450:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc600/0xfeec3c2dc5a4bd8b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850457:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc600/0xfeec3c2dc5a4bd8b lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850465:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x868dff87 (ffff8af210e98d00) 00010000:00010000:2.0:1784191891.850467:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.850470:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc600/0xfeec3c2dc5a4bd8b lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850476:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc600/0xfeec3c2dc5a4bd8b lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850512:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bd7d lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc97 expref: 121 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850523:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.850526:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.850530:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4bd7d lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc97 expref: 121 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.850539:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7000, rc 0) 00000100:00100000:2.0:1784191891.850624:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+120:123690:x1870858812399616:12345-192.168.204.16@tcp:101:cp.0 Request processed in 589us (805us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191891.850641:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 596 00000100:00100000:0.0:1784191891.854957:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191891.855128:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812399744 00000100:00100000:1.0:1784191891.855138:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812399744 00000100:00100000:1.0:1784191891.855202:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 597 00000100:00100000:1.0:1784191891.855214:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+120:123690:x1870858812399744:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191891.855238:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191891.855264:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4bd92 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bc9e expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855341:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bd99 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855374:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bd99 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855388:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bd99 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855405:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bda0 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855412:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bda0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855418:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bda0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855462:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bd99 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855469:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bd99 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855540:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bd99 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855546:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bd99 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855551:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191891.855565:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bd99 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855573:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bd99 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855593:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191891.855596:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.855603:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bd99 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855611:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bd99 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855629:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bda0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855635:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bda0 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855641:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bda0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855647:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191891.855650:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bda0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855656:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bda0 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855663:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x868dff87 (ffff8af2331f1300) 00010000:00010000:1.0:1784191891.855665:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.855668:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bda0 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855674:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bda0 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855928:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4bd92 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc9e expref: 121 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855939:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191891.855942:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.855945:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4bd92 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc9e expref: 121 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.855954:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4400, rc 0) 00000100:00100000:1.0:1784191891.856106:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+120:123690:x1870858812399744:12345-192.168.204.16@tcp:101:cp.0 Request processed in 893us (1158us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191891.856115:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 597 00000100:00100000:1.0:1784191891.860018:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191891.860183:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812400000 00000100:00100000:3.0:1784191891.860197:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812400000 00000100:00100000:3.0:1784191891.860274:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 598 00000100:00100000:3.0:1784191891.860286:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+120:123690:x1870858812400000:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191891.860316:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191891.860338:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bda7 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bca5 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.860462:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bdae lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.860594:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bdae lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.860610:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bdae lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.860627:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bdb5 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.860659:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bdb5 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.860667:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bdb5 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191891.861720:0:164531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x253:0x0], index 0: 0 00080000:00000400:0.0:1784191891.861886:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:0.0:1784191891.861890:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:0.0:1784191891.861892:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191891.861894:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191891.861897:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191891.861899:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191891.862008:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:1.0:1784191891.862012:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191891.862014:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191891.862016:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191891.862018:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191891.862019:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191891.862058:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:1.0:1784191891.862061:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191891.862062:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191891.862064:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191891.862066:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191891.862068:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191891.862432:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4bdbc lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.862452:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4bdbc lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.862547:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4bdbc lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.862613:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bdae lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.862621:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bdae lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.862629:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bdae lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.862635:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bdae lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.862641:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3f600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191891.862646:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bdae lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.862653:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bdae lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.862665:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191891.862668:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.862673:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bdae lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.862679:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bdae lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191891.862891:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001d684d3d reply state 00000000f1eaf22e transno 34359738706 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bdb5 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.862910:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bdb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.862916:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x868dff87 (ffff8af2112b6d00) 00010000:00010000:1.0:1784191891.862919:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191891.862922:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191891.862961:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bda7 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bca5 expref: 123 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.862977:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4bdbc lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bca5 expref: 122 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.862985:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1c:0x0].0x0 (ffff8af2331f1900) 00010000:00010000:1.0:1784191891.862987:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191891.862989:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5e00, rc 0) 00000100:00100000:1.0:1784191891.863111:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+123:123690:x1870858812400000:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2826us (3109us total) trans 34359738706 rc 0/0 00000100:00100000:1.0:1784191891.863120:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 598 00000100:00100000:2.0:1784191891.866549:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191891.866732:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812400128 00000100:00100000:3.0:1784191891.866743:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812400128 00000100:00100000:3.0:1784191891.866799:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 300 00000100:00100000:3.0:1784191891.866810:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:69110:x1870858812400128:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191891.866834:0:162392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191891.866861:0:162392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bdca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bcac expref: -99 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191891.866894:0:162392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x253:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784191891.866916:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x253:0x0].0x0 since=5512s v=(0 0) 00010000:00010000:3.0:1784191891.866921:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x253:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191891.866930:0:162392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bdca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcac expref: 20 pid: 162392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.866951:0:162392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bdca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcac expref: 20 pid: 162392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191891.866965:0:162392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3f000, rc 0) 00000100:00100000:3.0:1784191891.867031:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+20:69110:x1870858812400128:12345-192.168.204.16@tcp:101:cp.0 Request processed in 223us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191891.867059:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 300 00000100:00100000:3.0:1784191891.869662:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191891.869860:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812400256 00000100:00100000:0.0:1784191891.869869:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812400256 00000100:00100000:0.0:1784191891.869926:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 301 00000100:00100000:0.0:1784191891.869936:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+20:123690:x1870858812400256:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191891.869955:0:162395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191891.869977:0:162395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7b81951/0xfeec3c2dc5a4bdd1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x253:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bcb3 expref: -99 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.870014:0:162395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bdca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcac expref: 21 pid: 162392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.870023:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x253:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.870027:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x253:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.870033:0:162395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7b81951/0xfeec3c2dc5a4bdd1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x253:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcb3 expref: 21 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.870069:0:162395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bdca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcac expref: 21 pid: 162392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.870085:0:162395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bdca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcac expref: 21 pid: 162392 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191891.870128:0:162395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:162395:1870858827962624:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191891.870217:0:162395:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1115020c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191891.874005:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191891.874177:0:162395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:162395:1870858827962624:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191891.874220:0:162395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c7b81951/0xfeec3c2dc5a4bdd1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x253:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcb3 expref: 21 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.874244:0:162395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874be00, rc 0) 00000100:00100000:0.0:1784191891.874322:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:123690:x1870858812400256:12345-192.168.204.16@tcp:101:cp.0 Request processed in 4386us (4672us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191891.874332:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 301 00000100:00100000:2.0:1784191891.877238:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812400384 00000100:00100000:2.0:1784191891.877254:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812400384 00010000:00010000:2.0:1784191891.877314:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bdca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcac expref: 21 pid: 162392 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191891.877451:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 157 00000100:00100000:2.0:1784191891.877462:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:69111:x1870858812400384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191891.877488:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191891.877514:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bdca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x253:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcac expref: 21 pid: 162392 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.877531:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bdca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x253:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcac expref: 21 pid: 162392 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.877578:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4bdca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x253:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcac expref: 21 pid: 162392 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.877599:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x253:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.877604:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x253:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.877614:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7b81951/0xfeec3c2dc5a4bdd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcb3 expref: 20 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.877625:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7b81951/0xfeec3c2dc5a4bdd1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcb3 expref: 20 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.877712:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c7b81951/0xfeec3c2dc5a4bdd1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcb3 expref: 20 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191891.877738:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827962752:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191891.877835:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191891.882764:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191891.882869:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812400640 00000100:00100000:3.0:1784191891.882881:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812400640 00000100:00100000:3.0:1784191891.882945:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 164 00000100:00100000:3.0:1784191891.882955:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+123:123690:x1870858812400640:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191891.883303:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+124:123690:x1870858812400640:12345-192.168.204.16@tcp:35:cp.0 Request processed in 347us (549us total) trans 34359738707 rc 0/0 00000100:00100000:3.0:1784191891.883310:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 164 00000100:00100000:2.0:1784191891.884143:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827962752:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191891.884174:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191891.884223:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+20:69111:x1870858812400384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6762us (10230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191891.884248:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 157 00000100:00100000:1.0:1784191891.888516:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191891.888609:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812400768 00000100:00100000:0.0:1784191891.888620:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812400768 00000100:00100000:0.0:1784191891.888732:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 599 00000100:00100000:0.0:1784191891.888743:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+124:123690:x1870858812400768:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191891.888768:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191891.888791:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b400/0xfeec3c2dc5a4bdd8 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bcba expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.888860:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bddf lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.888876:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bddf lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.888889:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bddf lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.888920:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ae00/0xfeec3c2dc5a4bde6 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.888928:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ae00/0xfeec3c2dc5a4bde6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.888934:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ae00/0xfeec3c2dc5a4bde6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.888978:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bddf lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.888985:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bddf lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.888991:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bddf lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.888998:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bddf lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.889003:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874a200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191891.889007:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bddf lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.889015:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bddf lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.889028:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191891.889031:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191891.889036:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bddf lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.889050:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4bddf lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.889069:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ae00/0xfeec3c2dc5a4bde6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.889074:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ae00/0xfeec3c2dc5a4bde6 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.889079:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ae00/0xfeec3c2dc5a4bde6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.889083:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874ae00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191891.889087:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ae00/0xfeec3c2dc5a4bde6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.889092:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ae00/0xfeec3c2dc5a4bde6 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.889100:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x39c3d8fe (ffff8af207499600) 00010000:00010000:0.0:1784191891.889102:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191891.889105:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ae00/0xfeec3c2dc5a4bde6 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.889111:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ae00/0xfeec3c2dc5a4bde6 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.889149:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b400/0xfeec3c2dc5a4bdd8 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcba expref: 125 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.889172:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191891.889175:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191891.889178:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b400/0xfeec3c2dc5a4bdd8 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcba expref: 125 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.889187:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874b400, rc 0) 00000100:00100000:0.0:1784191891.889247:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+124:123690:x1870858812400768:12345-192.168.204.16@tcp:101:cp.0 Request processed in 506us (742us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191891.889253:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 599 00000100:00100000:1.0:1784191891.893113:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.893237:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812400896 00000100:00100000:2.0:1784191891.893248:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812400896 00000100:00100000:2.0:1784191891.893311:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 600 00000100:00100000:2.0:1784191891.893321:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+124:123690:x1870858812400896:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.893344:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.893365:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc600/0xfeec3c2dc5a4bded lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bcc1 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893435:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4bdf4 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893450:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4bdf4 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893463:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4bdf4 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893499:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4bdfb lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893508:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4bdfb lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893515:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4bdfb lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893568:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4bdf4 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893576:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4bdf4 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893583:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4bdf4 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893590:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4bdf4 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893596:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cda00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.893600:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4bdf4 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893608:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4bdf4 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893620:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.893623:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.893627:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4bdf4 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893640:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4bdf4 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893658:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4bdfb lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893665:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4bdfb lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893671:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4bdfb lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893676:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cce00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.893679:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4bdfb lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893685:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4bdfb lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893735:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x39c3d8fe (ffff8af210e98d00) 00010000:00010000:2.0:1784191891.893738:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.893740:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4bdfb lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893746:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4bdfb lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893776:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc600/0xfeec3c2dc5a4bded lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcc1 expref: 125 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893798:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.893800:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.893804:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc600/0xfeec3c2dc5a4bded lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcc1 expref: 125 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.893813:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cc600, rc 0) 00000100:00100000:2.0:1784191891.893869:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+124:123690:x1870858812400896:12345-192.168.204.16@tcp:101:cp.0 Request processed in 551us (781us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191891.893876:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 600 00000100:00100000:3.0:1784191891.897678:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191891.897838:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812401152 00000100:00100000:1.0:1784191891.897849:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812401152 00000100:00100000:1.0:1784191891.897906:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 601 00000100:00100000:1.0:1784191891.897915:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+124:123690:x1870858812401152:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191891.897936:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191891.897973:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4be02 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bcc8 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898088:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be09 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898115:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be09 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898127:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be09 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898141:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4be10 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898148:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4be10 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898154:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4be10 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191891.898439:0:164531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1d0:0x0], index 1: 0 00080000:00000400:1.0:1784191891.898453:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191891.898456:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191891.898458:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191891.898460:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191891.898462:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191891.898464:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191891.898482:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191891.898485:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191891.898487:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191891.898489:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191891.898498:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191891.898500:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191891.898531:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191891.898534:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191891.898536:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191891.898538:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191891.898540:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191891.898541:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191891.898647:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4be17 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898657:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4be17 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898664:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4be17 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898745:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be09 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898754:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be09 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898760:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be09 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898766:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be09 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898773:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191891.898777:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be09 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898785:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be09 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898805:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191891.898808:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.898813:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be09 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898820:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be09 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191891.898834:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007758900d reply state 000000005f3c085e transno 34359738708 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4be10 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898845:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4be10 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898851:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x39c3d8fe (ffff8af2331f1300) 00010000:00010000:1.0:1784191891.898853:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191891.898856:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191891.898884:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4be02 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcc8 expref: 127 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898898:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4be17 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcc8 expref: 126 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.898905:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1d:0x0].0x0 (ffff8af2331f1e00) 00010000:00010000:1.0:1784191891.898908:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191891.898910:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4a00, rc 0) 00000100:00100000:1.0:1784191891.898976:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+127:123690:x1870858812401152:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1062us (1311us total) trans 34359738708 rc 0/0 00000100:00100000:1.0:1784191891.898984:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 601 00000100:00100000:3.0:1784191891.904454:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.904616:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812401280 00000100:00100000:2.0:1784191891.904629:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812401280 00000100:00100000:2.0:1784191891.904738:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 302 00000100:00100000:2.0:1784191891.904752:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:69112:x1870858812401280:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.904775:0:160163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.904798:0:160163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068c48e28/0xfeec3c2dc5a4be25 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bccf expref: -99 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191891.904828:0:160163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191891.904850:0:160163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d0:0x0].0x0 since=5512s v=(0 0) 00010000:00010000:2.0:1784191891.904855:0:160163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.904865:0:160163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068c48e28/0xfeec3c2dc5a4be25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bccf expref: 20 pid: 160163 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.904884:0:160163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000068c48e28/0xfeec3c2dc5a4be25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bccf expref: 20 pid: 160163 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.904924:0:160163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cc600, rc 0) 00000100:00100000:2.0:1784191891.904989:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+20:69112:x1870858812401280:12345-192.168.204.16@tcp:101:cp.0 Request processed in 241us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191891.904997:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 302 00000100:00100000:3.0:1784191891.908421:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191891.908540:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812401408 00000100:00100000:0.0:1784191891.908587:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812401408 00000100:00100000:0.0:1784191891.908661:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 303 00000100:00100000:0.0:1784191891.908672:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+20:123690:x1870858812401408:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191891.908741:0:162396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191891.908763:0:162396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e08ed8b/0xfeec3c2dc5a4be2c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bcd6 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.908801:0:162396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068c48e28/0xfeec3c2dc5a4be25 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bccf expref: 21 pid: 160163 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.908811:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.908816:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.908821:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e08ed8b/0xfeec3c2dc5a4be2c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcd6 expref: 21 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.908889:0:162396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068c48e28/0xfeec3c2dc5a4be25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bccf expref: 21 pid: 160163 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.908904:0:162396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068c48e28/0xfeec3c2dc5a4be25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bccf expref: 21 pid: 160163 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191891.908919:0:162396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:162396:1870858827962880:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191891.909014:0:162396:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1115020c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191891.912196:0:162396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:162396:1870858827962880:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191891.912239:0:162396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000e08ed8b/0xfeec3c2dc5a4be2c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcd6 expref: 21 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.912259:0:162396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874b400, rc 0) 00000100:00100000:0.0:1784191891.912325:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:123690:x1870858812401408:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3653us (3914us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191891.912334:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 303 00000100:00100000:3.0:1784191891.914892:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.915009:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812401536 00000100:00100000:2.0:1784191891.915019:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812401536 00010000:00010000:2.0:1784191891.915059:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068c48e28/0xfeec3c2dc5a4be25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bccf expref: 21 pid: 160163 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191891.915111:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 158 00000100:00100000:2.0:1784191891.915121:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:69110:x1870858812401536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191891.915138:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191891.915163:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068c48e28/0xfeec3c2dc5a4be25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bccf expref: 21 pid: 160163 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.915178:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068c48e28/0xfeec3c2dc5a4be25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bccf expref: 21 pid: 160163 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.915203:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068c48e28/0xfeec3c2dc5a4be25 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bccf expref: 21 pid: 160163 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.915221:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.915226:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.915235:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000e08ed8b/0xfeec3c2dc5a4be2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcd6 expref: 20 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.915265:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e08ed8b/0xfeec3c2dc5a4be2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcd6 expref: 20 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.915307:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000e08ed8b/0xfeec3c2dc5a4be2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcd6 expref: 20 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191891.915321:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827963008:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191891.915408:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191891.918024:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827963008:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191891.918053:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191891.918132:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+20:69110:x1870858812401536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3010us (3248us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191891.918146:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 158 00000100:00100000:0.0:1784191891.921572:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191891.921671:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812401792 00000100:00100000:3.0:1784191891.921683:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812401792 00000100:00100000:3.0:1784191891.921799:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 165 00000100:00100000:3.0:1784191891.921811:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+127:123690:x1870858812401792:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191891.922176:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+128:123690:x1870858812401792:12345-192.168.204.16@tcp:35:cp.0 Request processed in 365us (622us total) trans 34359738709 rc 0/0 00000100:00100000:3.0:1784191891.922184:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 165 00000100:00100000:3.0:1784191891.925829:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.926007:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812401920 00000100:00100000:2.0:1784191891.926022:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812401920 00000100:00100000:2.0:1784191891.926114:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 602 00000100:00100000:2.0:1784191891.926125:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+128:123690:x1870858812401920:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.926156:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.926187:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc600/0xfeec3c2dc5a4be33 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bcdd expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926277:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be3a lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926293:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be3a lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926326:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be3a lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926343:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4be41 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926351:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4be41 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926357:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4be41 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926407:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be3a lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926415:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be3a lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926424:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be3a lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926431:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be3a lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926438:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cce00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.926443:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be3a lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926452:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be3a lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926465:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.926474:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.926481:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be3a lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926488:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be3a lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926508:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4be41 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926515:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4be41 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926521:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4be41 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926527:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cda00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.926530:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4be41 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926536:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4be41 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926544:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x5b30f298 (ffff8af210e98100) 00010000:00010000:2.0:1784191891.926546:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.926548:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4be41 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926565:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4be41 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926603:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc600/0xfeec3c2dc5a4be33 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcdd expref: 129 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926621:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.926623:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.926627:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc600/0xfeec3c2dc5a4be33 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcdd expref: 129 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.926637:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cc600, rc 0) 00000100:00100000:2.0:1784191891.926987:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+128:123690:x1870858812401920:12345-192.168.204.16@tcp:101:cp.0 Request processed in 861us (1168us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191891.926996:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 602 00000100:00100000:0.0:1784191891.930302:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191891.930398:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812402048 00000100:00100000:1.0:1784191891.930409:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812402048 00000100:00100000:1.0:1784191891.930485:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 603 00000100:00100000:1.0:1784191891.930495:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+128:123690:x1870858812402048:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191891.930521:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191891.930546:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4be48 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bce4 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930625:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be4f lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930644:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be4f lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930657:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be4f lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930673:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4be56 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930679:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4be56 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930685:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4be56 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930787:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be4f lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930794:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be4f lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930823:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be4f lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930829:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be4f lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930835:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191891.930840:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be4f lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930848:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be4f lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930861:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191891.930864:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.930869:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be4f lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930874:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4be4f lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930891:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4be56 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930897:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4be56 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930904:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4be56 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930909:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3f000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191891.930919:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4be56 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930925:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4be56 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930934:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x5b30f298 (ffff8af2331f1500) 00010000:00010000:1.0:1784191891.930936:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.930938:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4be56 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930944:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4be56 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930983:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4be48 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bce4 expref: 129 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.930994:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191891.930996:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191891.930999:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4be48 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bce4 expref: 129 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191891.931008:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5c00, rc 0) 00000100:00100000:1.0:1784191891.931086:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+128:123690:x1870858812402048:12345-192.168.204.16@tcp:101:cp.0 Request processed in 592us (799us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191891.931094:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 603 00000100:00100000:3.0:1784191891.934900:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191891.935014:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812402304 00000100:00100000:0.0:1784191891.935026:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812402304 00000100:00100000:0.0:1784191891.935104:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 604 00000100:00100000:0.0:1784191891.935117:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+128:123690:x1870858812402304:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191891.935145:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191891.935188:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ac00/0xfeec3c2dc5a4be5d lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bceb expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.935336:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4be64 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.935352:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4be64 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.935365:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4be64 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.935380:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4be6b lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.935387:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4be6b lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.935394:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4be6b lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191891.935822:0:158666:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x254:0x0], index 0: 0 00080000:00000400:0.0:1784191891.935836:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191891.935840:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191891.935842:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191891.935845:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191891.935847:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191891.935848:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191891.935866:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191891.935869:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191891.935871:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191891.935872:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191891.935882:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191891.935884:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191891.935918:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191891.935921:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191891.935923:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191891.935925:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191891.935927:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191891.935929:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191891.936029:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ae00/0xfeec3c2dc5a4be72 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.936040:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ae00/0xfeec3c2dc5a4be72 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.936048:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ae00/0xfeec3c2dc5a4be72 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.936091:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4be64 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.936099:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4be64 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.936106:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4be64 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.936113:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4be64 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.936121:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874ba00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191891.936127:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4be64 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.936135:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4be64 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.936158:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191891.936161:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191891.936166:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4be64 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.936173:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4be64 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191891.936192:0:158666:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6d57f47 reply state 00000000106259ad transno 34359738710 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4be6b lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.936204:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4be6b lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.936210:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x5b30f298 (ffff8af207499600) 00010000:00010000:0.0:1784191891.936212:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191891.936215:0:158666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191891.936258:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ac00/0xfeec3c2dc5a4be5d lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bceb expref: 131 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.936273:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ae00/0xfeec3c2dc5a4be72 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bceb expref: 130 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.936282:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1e:0x0].0x0 (ffff8af207499300) 00010000:00010000:0.0:1784191891.936284:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191891.936286:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874ae00, rc 0) 00000100:00100000:0.0:1784191891.936383:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+131:123690:x1870858812402304:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1267us (1494us total) trans 34359738710 rc 0/0 00000100:00100000:0.0:1784191891.936392:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 604 00000100:00100000:1.0:1784191891.947223:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191891.947333:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812402432 00000100:00100000:0.0:1784191891.947344:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812402432 00000100:00100000:0.0:1784191891.947410:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 304 00000100:00100000:0.0:1784191891.947422:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+20:69110:x1870858812402432:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191891.947443:0:162339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191891.947468:0:162339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4be80 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bcf2 expref: -99 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191891.947511:0:162339:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x254:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191891.947536:0:162339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x254:0x0].0x0 since=5512s v=(0 0) 00010000:00010000:0.0:1784191891.947542:0:162339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x254:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.947563:0:162339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4be80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcf2 expref: 21 pid: 162339 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.947582:0:162339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4be80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcf2 expref: 21 pid: 162339 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.947598:0:162339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874ac00, rc 0) 00000100:00100000:0.0:1784191891.947682:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:69110:x1870858812402432:12345-192.168.204.16@tcp:101:cp.0 Request processed in 262us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191891.947738:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 304 00000100:00100000:3.0:1784191891.952678:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.953198:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812402560 00000100:00100000:2.0:1784191891.953209:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812402560 00000100:00100000:2.0:1784191891.953316:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 305 00000100:00100000:2.0:1784191891.953328:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:123690:x1870858812402560:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.953349:0:162394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.953368:0:162394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068c48e28/0xfeec3c2dc5a4be87 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x254:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bcf9 expref: -99 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.953404:0:162394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4be80 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x254:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcf2 expref: 22 pid: 162339 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.953414:0:162394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x254:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.953418:0:162394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x254:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191891.953424:0:162394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068c48e28/0xfeec3c2dc5a4be87 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x254:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcf9 expref: 22 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.953500:0:162394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4be80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x254:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcf2 expref: 22 pid: 162339 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.953516:0:162394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4be80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x254:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcf2 expref: 22 pid: 162339 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191891.953531:0:162394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:162394:1870858827963136:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191891.953862:0:162394:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f2db0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191891.960895:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191891.961155:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812402688 00000100:00100000:0.0:1784191891.961165:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812402688 00010000:00010000:0.0:1784191891.961210:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4be80 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x254:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcf2 expref: 23 pid: 162339 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191891.961260:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 159 00000100:00100000:0.0:1784191891.961279:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:69111:x1870858812402688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191891.961298:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191891.961322:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4be80 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x254:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcf2 expref: 23 pid: 162339 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.961339:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4be80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x254:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcf2 expref: 23 pid: 162339 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.961388:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x254:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.961394:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x254:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191891.961403:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068c48e28/0xfeec3c2dc5a4be87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x254:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcf9 expref: 23 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.961415:0:158650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068c48e28/0xfeec3c2dc5a4be87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x254:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcf9 expref: 23 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191891.961459:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000068c48e28/0xfeec3c2dc5a4be87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x254:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcf9 expref: 23 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191891.961677:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016be300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:158650:1870858827963264:192.168.204.16@tcp:105: 00000100:00100000:0.0:1784191891.961824:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111502b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784191891.964946:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016be300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:158650:1870858827963264:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191891.965055:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191891.965117:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:69111:x1870858812402688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3839us (4236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191891.965148:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 159 00010000:00010000:2.0:1784191891.966664:0:162394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000651a9d21/0xfeec3c2dc5a4be80 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x254:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcf2 expref: 22 pid: 162339 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191891.966715:0:162394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:162394:1870858827963136:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191891.966885:0:162394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000068c48e28/0xfeec3c2dc5a4be87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcf9 expref: 21 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.966901:0:162394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cc600, rc 0) 00000100:00100000:2.0:1784191891.967091:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:123690:x1870858812402560:12345-192.168.204.16@tcp:101:cp.0 Request processed in 13764us (14422us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191891.967100:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 305 00000100:00100000:1.0:1784191891.972228:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191891.972318:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812402944 00000100:00100000:3.0:1784191891.972328:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812402944 00000100:00100000:3.0:1784191891.972441:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 166 00000100:00100000:3.0:1784191891.972452:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+131:123690:x1870858812402944:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191891.973161:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+132:123690:x1870858812402944:12345-192.168.204.16@tcp:35:cp.0 Request processed in 708us (939us total) trans 34359738711 rc 0/0 00000100:00100000:3.0:1784191891.973170:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 166 00000100:00100000:1.0:1784191891.979377:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.979680:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812403072 00000100:00100000:2.0:1784191891.979750:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812403072 00000100:00100000:2.0:1784191891.979856:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 605 00000100:00100000:2.0:1784191891.979866:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+132:123690:x1870858812403072:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.979910:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.979930:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4be8e lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd00 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.980867:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be95 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.980889:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be95 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.980902:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be95 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.980919:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4be9c lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.980926:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4be9c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.980933:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4be9c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.982289:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be95 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.982306:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be95 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.982312:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be95 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.982320:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be95 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.982347:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cce00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.982351:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be95 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.982359:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be95 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.982376:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.982379:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.982384:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be95 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.982390:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4be95 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.982405:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4be9c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.982411:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4be9c lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.982416:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4be9c lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.982421:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cc200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.982424:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4be9c lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.982430:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4be9c lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.982449:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x2893e4db (ffff8af219b92e00) 00010000:00010000:2.0:1784191891.982452:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.982454:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4be9c lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.982597:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4be9c lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.982655:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4be8e lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd00 expref: 133 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.982667:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.982669:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.982672:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4be8e lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd00 expref: 133 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.982684:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cda00, rc 0) 00000100:00100000:2.0:1784191891.983060:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+132:123690:x1870858812403072:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3192us (3691us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191891.983071:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 605 00000100:00100000:1.0:1784191891.986969:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.987150:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812403200 00000100:00100000:2.0:1784191891.987161:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812403200 00000100:00100000:2.0:1784191891.987217:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 606 00000100:00100000:2.0:1784191891.987228:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+132:123690:x1870858812403200:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.987250:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.987275:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bea3 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd07 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987368:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4beaa lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987384:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4beaa lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987396:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4beaa lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987414:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd400/0xfeec3c2dc5a4beb1 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987421:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd400/0xfeec3c2dc5a4beb1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987427:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd400/0xfeec3c2dc5a4beb1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987480:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4beaa lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987487:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4beaa lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987494:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4beaa lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987501:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4beaa lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987507:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cca00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.987519:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4beaa lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987528:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4beaa lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987540:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.987544:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.987548:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4beaa lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987567:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4beaa lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987586:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd400/0xfeec3c2dc5a4beb1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987593:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd400/0xfeec3c2dc5a4beb1 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987599:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd400/0xfeec3c2dc5a4beb1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987603:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cd400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.987607:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd400/0xfeec3c2dc5a4beb1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987613:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd400/0xfeec3c2dc5a4beb1 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987620:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x2893e4db (ffff8af2382d2200) 00010000:00010000:2.0:1784191891.987622:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.987632:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd400/0xfeec3c2dc5a4beb1 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987638:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd400/0xfeec3c2dc5a4beb1 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987675:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bea3 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd07 expref: 133 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987804:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.987808:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.987813:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bea3 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd07 expref: 133 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.987825:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cd200, rc 0) 00000100:00100000:2.0:1784191891.987890:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+132:123690:x1870858812403200:12345-192.168.204.16@tcp:101:cp.0 Request processed in 663us (934us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191891.987897:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 606 00000100:00100000:1.0:1784191891.991387:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191891.991527:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812403456 00000100:00100000:2.0:1784191891.991539:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812403456 00000100:00100000:2.0:1784191891.991617:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 607 00000100:00100000:2.0:1784191891.991629:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+132:123690:x1870858812403456:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191891.991654:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191891.991679:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4beb8 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd0e expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.991833:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bebf lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.991871:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bebf lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.991883:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bebf lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.991899:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4bec6 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.991906:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4bec6 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.991913:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4bec6 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191891.993911:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1d1:0x0], index 1: 0 00080000:00000400:2.0:1784191891.993934:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191891.993939:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191891.993941:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191891.993943:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191891.993946:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191891.993948:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191891.994049:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191891.994053:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191891.994055:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191891.994057:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191891.994059:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191891.994061:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191891.994160:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191891.994164:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191891.994166:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191891.994183:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191891.994185:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191891.994187:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191891.994324:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc000/0xfeec3c2dc5a4becd lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.994342:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc000/0xfeec3c2dc5a4becd lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.994356:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc000/0xfeec3c2dc5a4becd lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.994395:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bebf lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.994402:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bebf lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.994408:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bebf lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.994416:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bebf lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.994421:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cd800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191891.994426:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bebf lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.994433:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bebf lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.994447:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191891.994450:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191891.994462:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bebf lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.994544:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bebf lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191891.994574:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096f3ef29 reply state 00000000de9e150b transno 34359738712 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4bec6 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.994586:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4bec6 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.994593:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x2893e4db (ffff8af2382d2a00) 00010000:00010000:2.0:1784191891.994595:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191891.994598:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191891.994642:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4beb8 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd0e expref: 135 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.994661:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc000/0xfeec3c2dc5a4becd lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd0e expref: 134 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191891.994668:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1f:0x0].0x0 (ffff8af2382d2f00) 00010000:00010000:2.0:1784191891.994670:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191891.994672:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cc000, rc 0) 00000100:00100000:2.0:1784191891.995252:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+135:123690:x1870858812403456:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3620us (3871us total) trans 34359738712 rc 0/0 00000100:00100000:2.0:1784191891.995263:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 607 00000100:00100000:1.0:1784191892.003928:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.004088:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812403584 00000100:00100000:0.0:1784191892.004100:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812403584 00000100:00100000:0.0:1784191892.004160:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 306 00000100:00100000:0.0:1784191892.004172:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+20:69111:x1870858812403584:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.004193:0:162398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.004216:0:162398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d8b7604/0xfeec3c2dc5a4bedb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd15 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191892.004245:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191892.004266:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d1:0x0].0x0 since=5512s v=(0 0) 00010000:00010000:0.0:1784191892.004272:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.004283:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8b7604/0xfeec3c2dc5a4bedb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd15 expref: 21 pid: 162398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.004302:0:162398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000d8b7604/0xfeec3c2dc5a4bedb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd15 expref: 21 pid: 162398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.004316:0:162398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874ba00, rc 0) 00000100:00100000:0.0:1784191892.004385:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:69111:x1870858812403584:12345-192.168.204.16@tcp:101:cp.0 Request processed in 215us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.004393:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 306 00000100:00100000:1.0:1784191892.008278:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.008543:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812403712 00000100:00100000:3.0:1784191892.008563:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812403712 00000100:00100000:3.0:1784191892.008630:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 307 00000100:00100000:3.0:1784191892.008640:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:123690:x1870858812403712:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191892.008665:0:162391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191892.008684:0:162391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a32aa829/0xfeec3c2dc5a4bee2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd1c expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.008889:0:162391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d8b7604/0xfeec3c2dc5a4bedb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd15 expref: 22 pid: 162398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.008899:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191892.008903:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191892.008909:0:162391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a32aa829/0xfeec3c2dc5a4bee2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd1c expref: 22 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.009056:0:162391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d8b7604/0xfeec3c2dc5a4bedb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd15 expref: 22 pid: 162398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.009087:0:162391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d8b7604/0xfeec3c2dc5a4bedb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd15 expref: 22 pid: 162398 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191892.009104:0:162391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:162391:1870858827963392:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191892.009188:0:162391:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf353c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191892.011490:0:162391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:162391:1870858827963392:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191892.011530:0:162391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a32aa829/0xfeec3c2dc5a4bee2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd1c expref: 22 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.011562:0:162391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d532000, rc 0) 00000100:00100000:3.0:1784191892.011639:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+22:123690:x1870858812403712:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3000us (3370us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191892.011647:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 307 00000100:00100000:1.0:1784191892.015363:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.015443:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812403840 00000100:00100000:2.0:1784191892.015453:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812403840 00010000:00010000:2.0:1784191892.015508:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d8b7604/0xfeec3c2dc5a4bedb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd15 expref: 22 pid: 162398 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191892.015588:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 160 00000100:00100000:2.0:1784191892.015598:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af202d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+22:69109:x1870858812403840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191892.015615:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191892.015639:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d8b7604/0xfeec3c2dc5a4bedb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd15 expref: 22 pid: 162398 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.015654:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d8b7604/0xfeec3c2dc5a4bedb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd15 expref: 22 pid: 162398 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.015679:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d8b7604/0xfeec3c2dc5a4bedb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd15 expref: 22 pid: 162398 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.015759:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.015764:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.015772:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a32aa829/0xfeec3c2dc5a4bee2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd1c expref: 21 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.015784:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a32aa829/0xfeec3c2dc5a4bee2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd1c expref: 21 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.015824:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a32aa829/0xfeec3c2dc5a4bee2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd1c expref: 21 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191892.015839:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827963520:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191892.015919:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ef50600 going to sleep for 11 seconds 00000100:00100000:2.0:1784191892.018766:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827963520:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191892.018797:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191892.018849:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af202d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:69109:x1870858812403840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3252us (3497us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191892.018861:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 160 00000100:00100000:1.0:1784191892.020372:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.020495:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812404096 00000100:00100000:2.0:1784191892.020504:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812404096 00000100:00100000:2.0:1784191892.020611:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 167 00000100:00100000:2.0:1784191892.020623:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+135:123690:x1870858812404096:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191892.020986:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+136:123690:x1870858812404096:12345-192.168.204.16@tcp:35:cp.0 Request processed in 365us (621us total) trans 34359738713 rc 0/0 00000100:00100000:2.0:1784191892.020994:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 167 00000100:00100000:1.0:1784191892.029313:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.029395:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812404224 00000100:00100000:2.0:1784191892.029406:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812404224 00000100:00100000:2.0:1784191892.029478:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 608 00000100:00100000:2.0:1784191892.029489:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+136:123690:x1870858812404224:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.029518:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.029539:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4bee9 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd23 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029629:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bef0 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029645:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bef0 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029683:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bef0 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029737:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bef7 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029746:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bef7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029752:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bef7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029800:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bef0 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029808:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bef0 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029814:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bef0 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029821:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bef0 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029827:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cd800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.029833:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bef0 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029841:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bef0 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029854:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.029864:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.029871:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bef0 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029877:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bef0 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029895:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bef7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029900:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bef7 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029906:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bef7 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029911:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cd200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.029914:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bef7 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029919:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bef7 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029926:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x49aa722d (ffff8af2382d2200) 00010000:00010000:2.0:1784191892.029928:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.029931:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bef7 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029937:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bef7 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029973:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4bee9 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd23 expref: 137 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.029992:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.029994:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.029998:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4bee9 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd23 expref: 137 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.030009:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cc800, rc 0) 00000100:00100000:2.0:1784191892.030088:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+136:123690:x1870858812404224:12345-192.168.204.16@tcp:101:cp.0 Request processed in 601us (786us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191892.030108:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 608 00000100:00100000:1.0:1784191892.034207:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.034311:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812404352 00000100:00100000:0.0:1784191892.034323:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812404352 00000100:00100000:0.0:1784191892.034409:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 609 00000100:00100000:0.0:1784191892.034419:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+136:123690:x1870858812404352:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.034472:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.034495:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4befe lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd2a expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034582:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bf05 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034601:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bf05 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034614:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bf05 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034631:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bf0c lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034638:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bf0c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034645:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bf0c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034727:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bf05 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034736:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bf05 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034742:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bf05 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034748:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bf05 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034761:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874b800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191892.034765:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bf05 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034773:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bf05 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034787:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191892.034790:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.034795:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bf05 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034801:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bf05 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034817:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bf0c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034823:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bf0c lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034829:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bf0c lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034834:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874bc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191892.034836:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bf0c lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034843:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bf0c lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034863:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x49aa722d (ffff8af20c1fa600) 00010000:00010000:0.0:1784191892.034865:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.034868:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bf0c lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034873:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bf0c lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034909:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4befe lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd2a expref: 137 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034921:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191892.034923:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.034926:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4befe lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd2a expref: 137 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.034937:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874a800, rc 0) 00000100:00100000:0.0:1784191892.035010:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+136:123690:x1870858812404352:12345-192.168.204.16@tcp:101:cp.0 Request processed in 592us (811us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191892.035019:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 609 00000100:00100000:3.0:1784191892.037796:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.037968:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812404608 00000100:00100000:2.0:1784191892.038059:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812404608 00000100:00100000:2.0:1784191892.040317:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 610 00000100:00100000:2.0:1784191892.040342:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+136:123690:x1870858812404608:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.040368:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.040392:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4bf13 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd31 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.040517:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bf1a lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.040535:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bf1a lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.040547:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bf1a lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.040574:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bf21 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.040600:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bf21 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.040609:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bf21 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191892.042351:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x255:0x0], index 0: 0 00080000:00000400:2.0:1784191892.042376:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:2.0:1784191892.042381:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:2.0:1784191892.042383:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191892.042385:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191892.042387:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191892.042389:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191892.043389:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:1.0:1784191892.043397:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191892.043399:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191892.043401:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191892.043403:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191892.043405:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191892.043448:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:1.0:1784191892.043451:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191892.043453:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191892.043455:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191892.043457:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191892.043459:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191892.043617:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bf28 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.043636:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bf28 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.043647:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bf28 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.043845:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bf1a lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.043853:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bf1a lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.043876:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bf1a lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.043884:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bf1a lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.043889:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cd200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.043893:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bf1a lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.043901:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bf1a lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.043914:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.043917:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.043922:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bf1a lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.043928:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4bf1a lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191892.043945:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009926dd74 reply state 000000009417e699 transno 34359738714 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bf21 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.043956:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bf21 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.043962:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x49aa722d (ffff8af2382d2200) 00010000:00010000:1.0:1784191892.043964:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191892.043967:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191892.044158:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4bf13 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd31 expref: 139 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.044177:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bf28 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd31 expref: 138 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.044185:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x20:0x0].0x0 (ffff8af2331f1500) 00010000:00010000:1.0:1784191892.044188:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191892.044190:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3f600, rc 0) 00000100:00100000:1.0:1784191892.044325:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+139:123690:x1870858812404608:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3994us (6539us total) trans 34359738714 rc 0/0 00000100:00100000:1.0:1784191892.044334:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 610 00000100:00100000:2.0:1784191892.048076:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.048372:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812404736 00000100:00100000:0.0:1784191892.048382:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812404736 00000100:00100000:0.0:1784191892.048482:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 308 00000100:00100000:0.0:1784191892.048493:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:69109:x1870858812404736:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.048514:0:162392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.048535:0:162392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d3f537f/0xfeec3c2dc5a4bf36 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd38 expref: -99 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191892.048592:0:162392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x255:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191892.048615:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x255:0x0].0x0 since=5512s v=(0 0) 00010000:00010000:0.0:1784191892.048620:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x255:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.048629:0:162392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d3f537f/0xfeec3c2dc5a4bf36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd38 expref: 22 pid: 162392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.048646:0:162392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007d3f537f/0xfeec3c2dc5a4bf36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd38 expref: 22 pid: 162392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.048659:0:162392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874a800, rc 0) 00000100:00100000:0.0:1784191892.048755:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+22:69109:x1870858812404736:12345-192.168.204.16@tcp:101:cp.0 Request processed in 264us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.048763:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 308 00000100:00100000:3.0:1784191892.054291:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.055165:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812404864 00000100:00100000:2.0:1784191892.055178:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812404864 00000100:00100000:2.0:1784191892.055234:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 309 00000100:00100000:2.0:1784191892.055245:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+22:123690:x1870858812404864:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.055266:0:162389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.055287:0:162389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ccb4982/0xfeec3c2dc5a4bf3d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x255:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd3f expref: -99 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.055321:0:162389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007d3f537f/0xfeec3c2dc5a4bf36 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd38 expref: 23 pid: 162392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.055331:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x255:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.055336:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x255:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.055622:0:162389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ccb4982/0xfeec3c2dc5a4bf3d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x255:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd3f expref: 23 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.055665:0:162389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007d3f537f/0xfeec3c2dc5a4bf36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd38 expref: 23 pid: 162392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.055682:0:162389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007d3f537f/0xfeec3c2dc5a4bf36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd38 expref: 23 pid: 162392 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191892.055802:0:162389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210303b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:162389:1870858827963648:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191892.056020:0:162389:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af22379a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191892.062093:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.062452:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812404992 00000100:00100000:3.0:1784191892.062463:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812404992 00010000:00010000:3.0:1784191892.062506:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007d3f537f/0xfeec3c2dc5a4bf36 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd38 expref: 24 pid: 162392 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191892.062566:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 161 00000100:00100000:3.0:1784191892.062577:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:69112:x1870858812404992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191892.062593:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191892.062634:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007d3f537f/0xfeec3c2dc5a4bf36 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x255:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd38 expref: 24 pid: 162392 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.062648:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007d3f537f/0xfeec3c2dc5a4bf36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x255:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd38 expref: 24 pid: 162392 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.062677:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x255:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191892.062682:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x255:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191892.062741:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003ccb4982/0xfeec3c2dc5a4bf3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x255:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd3f expref: 24 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.062755:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ccb4982/0xfeec3c2dc5a4bf3d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x255:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd3f expref: 24 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.062799:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003ccb4982/0xfeec3c2dc5a4bf3d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x255:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd3f expref: 24 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191892.062814:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827963776:192.168.204.16@tcp:105: 00000100:00100000:3.0:1784191892.062910:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf353c0 going to sleep for 11 seconds 00010000:00010000:1.0:1784191892.064463:0:162389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d3f537f/0xfeec3c2dc5a4bf36 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x255:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd38 expref: 24 pid: 162392 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191892.064649:0:162389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210303b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:162389:1870858827963648:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191892.064679:0:162389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ccb4982/0xfeec3c2dc5a4bf3d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd3f expref: 23 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.064975:0:162389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cd400, rc 0) 00000100:00100000:1.0:1784191892.065098:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:123690:x1870858812404864:12345-192.168.204.16@tcp:101:cp.0 Request processed in 9843us (10806us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191892.065107:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 309 00000100:00100000:0.0:1784191892.067109:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827963776:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191892.067135:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191892.067180:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+22:69112:x1870858812404992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4605us (5102us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.067189:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 161 00000100:00100000:2.0:1784191892.070475:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.070568:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812405248 00000100:00100000:3.0:1784191892.070580:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812405248 00000100:00100000:3.0:1784191892.070669:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 168 00000100:00100000:3.0:1784191892.070680:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105326c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+139:123690:x1870858812405248:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191892.071164:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105326c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+140:123690:x1870858812405248:12345-192.168.204.16@tcp:35:cp.0 Request processed in 484us (700us total) trans 34359738715 rc 0/0 00000100:00100000:3.0:1784191892.071173:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 168 00000100:00100000:2.0:1784191892.078882:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.079024:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812405376 00000100:00100000:1.0:1784191892.079036:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812405376 00000100:00100000:1.0:1784191892.079114:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 611 00000100:00100000:1.0:1784191892.079125:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+140:123690:x1870858812405376:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191892.079165:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191892.079190:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4bf44 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd46 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079257:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf4b lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079272:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf4b lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079284:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf4b lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079298:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf52 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079305:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf52 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079312:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf52 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079351:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf4b lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079357:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf4b lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079363:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf4b lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079369:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf4b lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079382:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.079387:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf4b lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079394:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf4b lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079406:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.079409:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.079413:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf4b lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079420:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf4b lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079432:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf52 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079437:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf52 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079443:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf52 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079448:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.079451:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf52 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079457:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf52 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079484:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x4c7a76ee (ffff8af2331f1400) 00010000:00010000:1.0:1784191892.079486:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.079489:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf52 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079495:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf52 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079526:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4bf44 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd46 expref: 141 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079536:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.079538:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.079541:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4bf44 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd46 expref: 141 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.079559:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3f000, rc 0) 00000100:00100000:1.0:1784191892.079621:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+140:123690:x1870858812405376:12345-192.168.204.16@tcp:101:cp.0 Request processed in 498us (751us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191892.079628:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 611 00000100:00100000:0.0:1784191892.086966:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.087101:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812405504 00000100:00100000:1.0:1784191892.087111:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812405504 00000100:00100000:1.0:1784191892.087165:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 612 00000100:00100000:1.0:1784191892.087175:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+140:123690:x1870858812405504:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191892.087198:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191892.087218:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf59 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd4d expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087310:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bf60 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087325:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bf60 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087336:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bf60 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087353:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4bf67 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087360:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4bf67 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087366:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4bf67 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087408:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bf60 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087414:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bf60 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087420:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bf60 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087427:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bf60 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087432:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.087446:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bf60 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087454:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bf60 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087466:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.087470:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.087475:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bf60 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087492:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bf60 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087506:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4bf67 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087512:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4bf67 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087518:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4bf67 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087523:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3f000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.087526:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4bf67 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087531:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4bf67 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087538:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x4c7a76ee (ffff8af2331f1400) 00010000:00010000:1.0:1784191892.087541:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.087561:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4bf67 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087568:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4bf67 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087602:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf59 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd4d expref: 141 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087613:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.087615:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.087618:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf59 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd4d expref: 141 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.087627:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5c00, rc 0) 00000100:00100000:1.0:1784191892.088177:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+140:123690:x1870858812405504:12345-192.168.204.16@tcp:101:cp.0 Request processed in 999us (1219us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191892.088187:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 612 00000100:00100000:2.0:1784191892.102932:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.103085:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812405760 00000100:00100000:1.0:1784191892.103110:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812405760 00000100:00100000:1.0:1784191892.103179:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 613 00000100:00100000:1.0:1784191892.103190:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+140:123690:x1870858812405760:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191892.103216:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191892.103241:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4bf6e lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd54 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.103385:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf75 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.103414:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf75 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.103428:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf75 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.103446:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf7c lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.103453:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf7c lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.103460:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf7c lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191892.104323:0:158692:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:158692:1870858827963904:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784191892.104390:0:158692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191892.104429:0:158692:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35f00 going to sleep for 11 seconds 00000004:00080000:1.0:1784191892.104565:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1d2:0x0], index 1: 0 00080000:00000400:1.0:1784191892.104582:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191892.104586:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191892.104589:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191892.104591:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191892.104594:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191892.104596:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191892.104621:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191892.104624:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191892.104626:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191892.104627:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191892.104630:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191892.104632:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191892.104670:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191892.104674:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191892.104676:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191892.104716:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00000100:00100000:2.0:1784191892.104848:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827963904 00000100:00100000:2.0:1784191892.104858:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827963904 00000100:00100000:2.0:1784191892.104936:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1784191892.104947:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:158692:x1870858827963904:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1784191892.104997:0:160163:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 482 00000100:00080000:3.0:1784191892.105292:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00080000:00000400:1.0:1784191892.105371:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191892.105375:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191892.105987:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bf83 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.106005:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bf83 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.106016:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bf83 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.106057:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf75 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.106064:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf75 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.106070:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf75 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.106076:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf75 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.106082:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.106086:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf75 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.108353:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf75 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.108375:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.108378:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.108400:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf75 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.108408:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4bf75 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191892.108430:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007aef5a89 reply state 00000000bc87c7e0 transno 34359738716 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf7c lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.108442:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf7c lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.108449:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x4c7a76ee (ffff8af2331f1400) 00010000:00010000:1.0:1784191892.108452:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191892.108456:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00002000:00080000:2.0:1784191892.113221:0:160163:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 490 00000001:00080000:2.0:1784191892.113650:0:160163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869236 00002000:00080000:2.0:1784191892.113668:0:160163:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 498 00000001:00080000:2.0:1784191892.114087:0:160163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869237 00002000:00080000:2.0:1784191892.114104:0:160163:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 506 00000001:00080000:2.0:1784191892.114411:0:160163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869238 00000100:00100000:2.0:1784191892.114539:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:158692:x1870858827963904:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9590us (10144us total) trans 17179869239 rc 0/0 00000100:00100000:2.0:1784191892.114573:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000020:00080000:2.0:1784191892.114580:0:160163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00010000:00010000:0.0:1784191892.117294:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4bf6e lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd54 expref: 143 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.117326:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bf83 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd54 expref: 142 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.117363:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x21:0x0].0x0 (ffff8af2331f1200) 00010000:00010000:0.0:1784191892.117367:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191892.117370:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5800, rc 0) 00000100:00100000:0.0:1784191892.117454:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+143:123690:x1870858812405760:12345-192.168.204.16@tcp:101:cp.0 Request processed in 14264us (14534us total) trans 34359738716 rc 0/0 00000100:00100000:0.0:1784191892.117463:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 613 00000100:00100000:1.0:1784191892.118061:0:158692:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:158692:1870858827963904:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1784191892.118080:0:158692:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1d2:0x0]-[0x2c0000401:0x201:0x0] 00000100:00100000:2.0:1784191892.124820:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.124977:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812405888 00000100:00100000:0.0:1784191892.124991:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812405888 00000100:00100000:0.0:1784191892.125055:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 311 00000100:00100000:0.0:1784191892.125066:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:69111:x1870858812405888:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.125099:0:160166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.125124:0:160166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bf91 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd5b expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191892.125153:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191892.125186:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d2:0x0].0x0 since=5512s v=(0 0) 00010000:00010000:0.0:1784191892.125192:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.125203:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bf91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd5b expref: 22 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.125222:0:160166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bf91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd5b expref: 22 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.125236:0:160166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874b800, rc 0) 00000100:00100000:0.0:1784191892.125410:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+22:69111:x1870858812405888:12345-192.168.204.16@tcp:101:cp.0 Request processed in 345us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.125419:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 311 00000100:00100000:2.0:1784191892.152160:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.152477:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812406016 00000100:00100000:0.0:1784191892.152487:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812406016 00000100:00100000:0.0:1784191892.152560:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 312 00000100:00100000:0.0:1784191892.152571:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+22:123690:x1870858812406016:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.152592:0:162339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.152617:0:162339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8560c00/0xfeec3c2dc5a4bf98 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd62 expref: -99 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.152652:0:162339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bf91 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd5b expref: 23 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.152661:0:162339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.152665:0:162339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.152670:0:162339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8560c00/0xfeec3c2dc5a4bf98 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd62 expref: 23 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.152744:0:162339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bf91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd5b expref: 23 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.152759:0:162339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bf91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd5b expref: 23 pid: 160166 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191892.152775:0:162339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:162339:1870858827964032:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191892.152884:0:162339:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111502b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784191892.160968:0:162339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:162339:1870858827964032:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191892.161017:0:162339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d8560c00/0xfeec3c2dc5a4bf98 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd62 expref: 23 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.161037:0:162339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874a600, rc 0) 00000100:00100000:3.0:1784191892.161128:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:123690:x1870858812406016:12345-192.168.204.16@tcp:101:cp.0 Request processed in 8559us (8978us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191892.161138:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 312 00000100:00100000:2.0:1784191892.162827:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.162976:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812406144 00000100:00100000:0.0:1784191892.162986:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812406144 00010000:00010000:0.0:1784191892.163035:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bf91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd5b expref: 23 pid: 160166 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191892.163091:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 162 00000100:00100000:0.0:1784191892.163102:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:69110:x1870858812406144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191892.163135:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191892.163162:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bf91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd5b expref: 23 pid: 160166 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.163178:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bf91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd5b expref: 23 pid: 160166 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.163205:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bf91 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd5b expref: 23 pid: 160166 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.163223:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.163227:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.163235:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8560c00/0xfeec3c2dc5a4bf98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd62 expref: 22 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.163247:0:158650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8560c00/0xfeec3c2dc5a4bf98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd62 expref: 22 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.163313:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d8560c00/0xfeec3c2dc5a4bf98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd62 expref: 22 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191892.163328:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:158650:1870858827964160:192.168.204.16@tcp:105: 00000100:00100000:0.0:1784191892.163421:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1115026c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191892.167261:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:158650:1870858827964160:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191892.167315:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191892.167399:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+22:69110:x1870858812406144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4296us (4581us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191892.167402:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.167418:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 162 00000100:00100000:3.0:1784191892.167776:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812406400 00000100:00100000:3.0:1784191892.167785:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812406400 00000100:00100000:3.0:1784191892.167838:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 169 00000100:00100000:3.0:1784191892.167848:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+143:123690:x1870858812406400:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191892.168171:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+144:123690:x1870858812406400:12345-192.168.204.16@tcp:35:cp.0 Request processed in 323us (771us total) trans 34359738717 rc 0/0 00000100:00100000:3.0:1784191892.168178:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 169 00000100:00100000:2.0:1784191892.172886:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.173065:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812406528 00000100:00100000:0.0:1784191892.173080:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812406528 00000100:00100000:0.0:1784191892.173168:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 614 00000100:00100000:0.0:1784191892.173183:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+144:123690:x1870858812406528:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.173218:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.173246:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bf9f lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd69 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.173324:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfa6 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.173342:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfa6 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.173354:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfa6 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.173629:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfad lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.173638:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfad lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.173645:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfad lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.174138:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfa6 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.174148:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfa6 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.174155:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfa6 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.174162:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfa6 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.174168:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874b000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191892.174172:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfa6 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.174179:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfa6 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.174192:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191892.174196:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.174200:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfa6 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.174215:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfa6 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.174233:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfad lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.174239:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfad lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.174245:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfad lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.174250:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874b600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191892.174252:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfad lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.174257:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfad lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.174264:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x610aa076 (ffff8af233110800) 00010000:00010000:0.0:1784191892.174266:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.174269:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfad lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.174274:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfad lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.174311:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bf9f lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd69 expref: 145 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.174335:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191892.174338:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.174342:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bf9f lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd69 expref: 145 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.174352:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874b800, rc 0) 00000100:00100000:0.0:1784191892.175709:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+144:123690:x1870858812406528:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2505us (2813us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191892.175729:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 614 00000100:00100000:0.0:1784191892.179744:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.179900:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812406656 00000100:00100000:2.0:1784191892.179911:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812406656 00000100:00100000:2.0:1784191892.179967:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 615 00000100:00100000:2.0:1784191892.179975:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+144:123690:x1870858812406656:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.179997:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.180020:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4bfb4 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd70 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180089:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4bfbb lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180103:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4bfbb lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180114:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4bfbb lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180129:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cdc00/0xfeec3c2dc5a4bfc2 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180136:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cdc00/0xfeec3c2dc5a4bfc2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180163:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cdc00/0xfeec3c2dc5a4bfc2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180208:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4bfbb lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180215:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4bfbb lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180222:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4bfbb lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180229:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4bfbb lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180236:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cd000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.180240:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4bfbb lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180248:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4bfbb lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180262:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.180265:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.180270:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4bfbb lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180277:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4bfbb lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180293:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cdc00/0xfeec3c2dc5a4bfc2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180305:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cdc00/0xfeec3c2dc5a4bfc2 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180311:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cdc00/0xfeec3c2dc5a4bfc2 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180316:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cdc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.180319:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cdc00/0xfeec3c2dc5a4bfc2 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180326:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cdc00/0xfeec3c2dc5a4bfc2 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180335:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x610aa076 (ffff8af2382d2100) 00010000:00010000:2.0:1784191892.180337:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.180340:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cdc00/0xfeec3c2dc5a4bfc2 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180346:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cdc00/0xfeec3c2dc5a4bfc2 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180398:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4bfb4 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd70 expref: 145 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180408:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.180410:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.180413:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4bfb4 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd70 expref: 145 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.180437:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cc400, rc 0) 00000100:00100000:2.0:1784191892.180748:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+144:123690:x1870858812406656:12345-192.168.204.16@tcp:101:cp.0 Request processed in 771us (1074us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191892.180757:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 615 00000100:00100000:2.0:1784191892.186925:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.187136:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812406912 00000100:00100000:0.0:1784191892.187145:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812406912 00000100:00100000:0.0:1784191892.187214:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 616 00000100:00100000:0.0:1784191892.187225:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+144:123690:x1870858812406912:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.187248:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.187272:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bfc9 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd77 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.187400:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfd0 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.187416:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfd0 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.187428:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfd0 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.187460:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfd7 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.187478:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfd7 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.187487:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfd7 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191892.188308:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x256:0x0], index 0: 0 00080000:00000400:0.0:1784191892.188326:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191892.188330:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191892.188333:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191892.188336:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191892.188338:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191892.188340:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191892.188410:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191892.188414:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191892.188416:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191892.188419:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191892.188421:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191892.188423:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191892.188460:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191892.188463:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191892.188465:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191892.188536:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191892.188538:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191892.188540:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191892.188681:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bfde lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.189076:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bfde lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.189087:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bfde lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.189133:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfd0 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.189141:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfd0 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.189147:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfd0 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.189156:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfd0 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.189164:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874b600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191892.189170:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfd0 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.189178:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfd0 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.189192:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191892.189196:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.189200:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfd0 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.189207:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b600/0xfeec3c2dc5a4bfd0 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191892.189228:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000005535c5e reply state 00000000cdb422a9 transno 34359738718 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfd7 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.189239:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfd7 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.189245:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x610aa076 (ffff8af233110800) 00010000:00010000:0.0:1784191892.189247:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191892.189250:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191892.189289:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bfc9 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd77 expref: 147 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.189305:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bfde lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd77 expref: 146 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.189313:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x22:0x0].0x0 (ffff8af233110c00) 00010000:00010000:0.0:1784191892.189315:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191892.189317:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874bc00, rc 0) 00000100:00100000:0.0:1784191892.189568:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+147:123690:x1870858812406912:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2343us (2654us total) trans 34359738718 rc 0/0 00000100:00100000:0.0:1784191892.189577:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 616 00000100:00100000:2.0:1784191892.197062:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.197606:0:162390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812407040 00000100:00100000:0.0:1784191892.197619:0:162390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812407040 00000100:00100000:0.0:1784191892.197733:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 313 00000100:00100000:0.0:1784191892.197744:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+22:69110:x1870858812407040:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.197767:0:162390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.197795:0:162390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bfec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd7e expref: -99 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191892.197860:0:162390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x256:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191892.197886:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x256:0x0].0x0 since=5512s v=(0 0) 00010000:00010000:0.0:1784191892.197891:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x256:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.197901:0:162390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bfec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd7e expref: 23 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.197921:0:162390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bfec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd7e expref: 23 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.197934:0:162390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874b800, rc 0) 00000100:00100000:0.0:1784191892.197997:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:69110:x1870858812407040:12345-192.168.204.16@tcp:101:cp.0 Request processed in 256us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.198005:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 313 00000100:00100000:2.0:1784191892.203204:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.203294:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812407168 00000100:00100000:0.0:1784191892.203304:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812407168 00000100:00100000:0.0:1784191892.203374:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 314 00000100:00100000:0.0:1784191892.203385:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:123690:x1870858812407168:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.203407:0:162398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.203426:0:162398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db5cd8a5/0xfeec3c2dc5a4bff3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x256:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd85 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.203461:0:162398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bfec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd7e expref: 24 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.203501:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x256:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.203505:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x256:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.203511:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db5cd8a5/0xfeec3c2dc5a4bff3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x256:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd85 expref: 24 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.203574:0:162398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bfec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd7e expref: 24 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.203590:0:162398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bfec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd7e expref: 24 pid: 162390 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191892.203604:0:162398:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:162398:1870858827964288:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191892.203746:0:162398:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111502c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784191892.210648:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.215640:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812407296 00000100:00100000:2.0:1784191892.215658:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812407296 00010000:00010000:2.0:1784191892.215762:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bfec lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd7e expref: 25 pid: 162390 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191892.215817:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 163 00000100:00100000:2.0:1784191892.215828:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+25:69111:x1870858812407296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191892.215845:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191892.215881:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bfec lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x256:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd7e expref: 25 pid: 162390 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.215896:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bfec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x256:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd7e expref: 25 pid: 162390 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.215925:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x256:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.215930:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x256:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.215938:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db5cd8a5/0xfeec3c2dc5a4bff3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x256:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd85 expref: 25 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.215970:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db5cd8a5/0xfeec3c2dc5a4bff3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x256:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd85 expref: 25 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.216016:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000db5cd8a5/0xfeec3c2dc5a4bff3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x256:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd85 expref: 25 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191892.216037:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb63b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827964416:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191892.216146:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111d086c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784191892.216205:0:162398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4bfec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x256:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd7e expref: 25 pid: 162390 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191892.216221:0:162398:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:162398:1870858827964288:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191892.216249:0:162398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db5cd8a5/0xfeec3c2dc5a4bff3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd85 expref: 24 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.216259:0:162398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874b600, rc 0) 00000100:00100000:0.0:1784191892.216296:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:123690:x1870858812407168:12345-192.168.204.16@tcp:101:cp.0 Request processed in 12912us (13106us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.216315:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 314 00000100:00100000:2.0:1784191892.234308:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.235599:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb63b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827964416:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191892.235632:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191892.235796:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812407552 00000100:00100000:3.0:1784191892.235807:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812407552 00000100:00100000:0.0:1784191892.235917:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 170 00000100:00100000:0.0:1784191892.235934:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+147:123690:x1870858812407552:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:0.0:1784191892.236298:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+148:123690:x1870858812407552:12345-192.168.204.16@tcp:35:cp.0 Request processed in 370us (2003us total) trans 34359738719 rc 0/0 00000100:00100000:0.0:1784191892.236306:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 170 00000100:00100000:3.0:1784191892.240098:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.240222:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812407680 00000100:00100000:0.0:1784191892.240234:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812407680 00000100:00100000:0.0:1784191892.240309:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 617 00000100:00100000:0.0:1784191892.240321:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+148:123690:x1870858812407680:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.240346:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.240367:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bffa lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd8c expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.240438:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c001 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.240452:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c001 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.240463:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c001 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.240491:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c008 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.240535:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c008 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.240542:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c008 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.240598:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c001 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.240606:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c001 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.240613:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c001 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.240620:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c001 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.240626:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874a800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191892.240631:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c001 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.240640:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c001 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.240652:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191892.240656:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.240661:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c001 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.240668:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c001 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.241259:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c008 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.241267:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c008 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.241273:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c008 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.241278:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874ba00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191892.241280:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c008 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.241286:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c008 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.241296:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x72a71b3d (ffff8af233110200) 00010000:00010000:0.0:1784191892.241299:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.241302:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c008 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.241309:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c008 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.241348:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bffa lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd8c expref: 149 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.241358:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191892.241361:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.241373:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4bffa lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd8c expref: 149 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.241384:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874b800, rc 0) 00000100:00100000:0.0:1784191892.241505:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+148:123690:x1870858812407680:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1185us (1415us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191892.241512:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 617 00000100:00100000:1.0:1784191892.241671:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:69111:x1870858812407296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 25843us (31035us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191892.241681:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 163 00000100:00100000:0.0:1784191892.247542:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.247860:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812407808 00000100:00100000:2.0:1784191892.247872:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812407808 00000100:00100000:2.0:1784191892.247953:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 618 00000100:00100000:2.0:1784191892.247965:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+148:123690:x1870858812407808:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.247990:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.248011:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c00f lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd93 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248077:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c016 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248307:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c016 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248321:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c016 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248355:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c01d lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248363:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c01d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248370:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c01d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248415:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c016 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248422:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c016 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248429:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c016 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248435:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c016 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248441:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cda00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.248446:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c016 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248453:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c016 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248475:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.248479:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.248484:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c016 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248497:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c016 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248513:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c01d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248519:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c01d lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248524:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c01d lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248530:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cca00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.248533:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c01d lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248538:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c01d lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248555:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x72a71b3d (ffff8af2382d2100) 00010000:00010000:2.0:1784191892.248558:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.248561:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c01d lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248566:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c01d lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248604:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c00f lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd93 expref: 149 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248627:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.248630:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.248634:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c00f lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd93 expref: 149 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.248644:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cd000, rc 0) 00000100:00100000:2.0:1784191892.249424:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+148:123690:x1870858812407808:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1455us (1890us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191892.249434:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 618 00000100:00100000:2.0:1784191892.255117:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.255223:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812408064 00000100:00100000:0.0:1784191892.255236:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812408064 00000100:00100000:0.0:1784191892.255308:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 619 00000100:00100000:0.0:1784191892.255320:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+148:123690:x1870858812408064:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.255347:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.255374:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4c024 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bd9a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.255522:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c02b lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.255541:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c02b lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.255564:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c02b lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.255580:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c032 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.255586:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c032 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.255615:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c032 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191892.256262:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1d3:0x0], index 1: 0 00080000:00000400:0.0:1784191892.256275:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191892.256279:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191892.256281:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191892.256283:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191892.256285:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191892.256287:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191892.256302:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191892.256305:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191892.256306:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191892.256308:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191892.256311:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191892.256312:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191892.256341:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191892.256344:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191892.256346:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191892.256348:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191892.256350:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191892.256352:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191892.256449:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ac00/0xfeec3c2dc5a4c039 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.256460:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ac00/0xfeec3c2dc5a4c039 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.257036:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ac00/0xfeec3c2dc5a4c039 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.257111:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c02b lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.257119:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c02b lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.257126:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c02b lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.257132:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c02b lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.257139:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874ba00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191892.257143:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c02b lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.257151:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c02b lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.257165:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191892.257167:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.257172:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c02b lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.257178:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c02b lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191892.257193:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000405ab5ee reply state 0000000021526c73 transno 34359738720 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c032 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.257204:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c032 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.257218:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x72a71b3d (ffff8af233110200) 00010000:00010000:0.0:1784191892.257220:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191892.257223:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191892.257268:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b800/0xfeec3c2dc5a4c024 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd9a expref: 151 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.257285:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ac00/0xfeec3c2dc5a4c039 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd9a expref: 150 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.257294:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x23:0x0].0x0 (ffff8af233110a00) 00010000:00010000:0.0:1784191892.257297:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191892.257300:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874ac00, rc 0) 00000100:00100000:0.0:1784191892.257397:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+151:123690:x1870858812408064:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2078us (2294us total) trans 34359738720 rc 0/0 00000100:00100000:0.0:1784191892.257406:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 619 00000100:00100000:2.0:1784191892.264953:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.265555:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812408192 00000100:00100000:1.0:1784191892.265567:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812408192 00000100:00100000:1.0:1784191892.265649:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 315 00000100:00100000:1.0:1784191892.265661:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+22:69111:x1870858812408192:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191892.265685:0:162387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.266428:0:162387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000319fdc4c/0xfeec3c2dc5a4c047 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bda1 expref: -99 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191892.266462:0:162387:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191892.267413:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d3:0x0].0x0 since=5512s v=(0 0) 00010000:00010000:0.0:1784191892.267426:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.267442:0:162387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000319fdc4c/0xfeec3c2dc5a4c047 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bda1 expref: 23 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.267555:0:162387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000319fdc4c/0xfeec3c2dc5a4c047 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bda1 expref: 23 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.267593:0:162387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010bfe00, rc 0) 00000100:00100000:0.0:1784191892.267758:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:69111:x1870858812408192:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2097us (2816us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.267767:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 315 00000100:00100000:2.0:1784191892.277322:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.277588:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812408320 00000100:00100000:3.0:1784191892.277599:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812408320 00000100:00100000:3.0:1784191892.277765:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 316 00000100:00100000:3.0:1784191892.277777:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:123690:x1870858812408320:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191892.277823:0:161232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191892.277846:0:161232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a25c204/0xfeec3c2dc5a4c04e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bda8 expref: -99 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.277897:0:161232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000319fdc4c/0xfeec3c2dc5a4c047 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bda1 expref: 24 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.277907:0:161232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191892.277911:0:161232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191892.277917:0:161232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a25c204/0xfeec3c2dc5a4c04e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bda8 expref: 24 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.277954:0:161232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000319fdc4c/0xfeec3c2dc5a4c047 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bda1 expref: 24 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.277983:0:161232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000319fdc4c/0xfeec3c2dc5a4c047 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bda1 expref: 24 pid: 162387 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191892.278000:0:161232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:161232:1870858827964544:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191892.278115:0:161232:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784191892.281860:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.282027:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812408448 00000100:00100000:0.0:1784191892.282038:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812408448 00010000:00010000:0.0:1784191892.282106:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000319fdc4c/0xfeec3c2dc5a4c047 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bda1 expref: 25 pid: 162387 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191892.282161:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 164 00000100:00100000:0.0:1784191892.282172:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+25:69109:x1870858812408448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191892.282189:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191892.282217:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000319fdc4c/0xfeec3c2dc5a4c047 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bda1 expref: 25 pid: 162387 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.282234:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000319fdc4c/0xfeec3c2dc5a4c047 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bda1 expref: 25 pid: 162387 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.282270:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.282276:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.282285:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a25c204/0xfeec3c2dc5a4c04e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bda8 expref: 25 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.282298:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a25c204/0xfeec3c2dc5a4c04e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bda8 expref: 25 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.282360:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005a25c204/0xfeec3c2dc5a4c04e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bda8 expref: 25 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191892.282376:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827964672:192.168.204.16@tcp:105: 00000100:00100000:0.0:1784191892.282462:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111502b40 going to sleep for 11 seconds 00010000:00010000:3.0:1784191892.283284:0:161232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000319fdc4c/0xfeec3c2dc5a4c047 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bda1 expref: 25 pid: 162387 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191892.283305:0:161232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:161232:1870858827964544:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191892.283331:0:161232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a25c204/0xfeec3c2dc5a4c04e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bda8 expref: 24 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.283358:0:161232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db2200, rc 0) 00000100:00100000:3.0:1784191892.283415:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:123690:x1870858812408320:12345-192.168.204.16@tcp:101:cp.0 Request processed in 5639us (6104us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191892.283424:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 316 00000100:00100000:0.0:1784191892.293248:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827964672:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191892.293281:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191892.293357:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:69109:x1870858812408448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 11185us (11517us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.293369:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 164 00000100:00100000:0.0:1784191892.296254:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.296363:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812408704 00000100:00100000:2.0:1784191892.296374:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812408704 00000100:00100000:2.0:1784191892.296469:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 171 00000100:00100000:2.0:1784191892.296481:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+151:123690:x1870858812408704:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191892.296882:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+152:123690:x1870858812408704:12345-192.168.204.16@tcp:35:cp.0 Request processed in 402us (637us total) trans 34359738721 rc 0/0 00000100:00100000:2.0:1784191892.296890:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 171 00000100:00100000:2.0:1784191892.302106:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.303623:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812408832 00000100:00100000:0.0:1784191892.303641:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812408832 00000100:00100000:0.0:1784191892.303815:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 620 00000100:00100000:0.0:1784191892.303828:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+152:123690:x1870858812408832:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.304037:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.304063:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfc00/0xfeec3c2dc5a4c055 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bdaf expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304209:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf000/0xfeec3c2dc5a4c05c lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304225:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf000/0xfeec3c2dc5a4c05c lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304237:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf000/0xfeec3c2dc5a4c05c lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304268:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c063 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304275:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c063 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304282:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c063 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304327:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf000/0xfeec3c2dc5a4c05c lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304334:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf000/0xfeec3c2dc5a4c05c lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304339:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf000/0xfeec3c2dc5a4c05c lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304345:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf000/0xfeec3c2dc5a4c05c lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304351:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010bf000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191892.304356:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf000/0xfeec3c2dc5a4c05c lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304364:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf000/0xfeec3c2dc5a4c05c lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304376:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191892.304379:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.304384:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf000/0xfeec3c2dc5a4c05c lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304398:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf000/0xfeec3c2dc5a4c05c lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304419:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c063 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304426:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c063 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304432:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c063 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304438:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010be400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191892.304441:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c063 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304447:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c063 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304455:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xa9dd9870 (ffff8af233110700) 00010000:00010000:0.0:1784191892.304458:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.304461:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c063 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304466:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c063 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304501:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfc00/0xfeec3c2dc5a4c055 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdaf expref: 153 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304525:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191892.304527:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.304532:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfc00/0xfeec3c2dc5a4c055 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdaf expref: 153 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.304541:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010bfc00, rc 0) 00000100:00100000:0.0:1784191892.304740:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+152:123690:x1870858812408832:12345-192.168.204.16@tcp:101:cp.0 Request processed in 865us (2605us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191892.304748:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 620 00000100:00100000:0.0:1784191892.308314:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.310132:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812408960 00000100:00100000:2.0:1784191892.310154:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812408960 00000100:00100000:2.0:1784191892.310248:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 621 00000100:00100000:2.0:1784191892.310259:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+152:123690:x1870858812408960:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.310301:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.310323:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c06a lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bdb6 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310393:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c071 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310409:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c071 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310421:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c071 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310437:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c078 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310443:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c078 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310450:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c078 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310501:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c071 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310509:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c071 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310516:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c071 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310523:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c071 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310537:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cda00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.310541:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c071 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310558:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c071 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310578:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.310580:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.310589:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c071 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310596:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c071 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310617:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c078 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310622:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c078 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310628:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c078 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310632:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cca00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.310634:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c078 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310639:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c078 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310655:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xa9dd9870 (ffff8af2382d2100) 00010000:00010000:2.0:1784191892.310657:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.310660:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c078 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310666:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c078 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310782:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c06a lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdb6 expref: 153 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310793:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.310796:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.310799:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c06a lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdb6 expref: 153 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.310808:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cd200, rc 0) 00000100:00100000:2.0:1784191892.310961:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+152:123690:x1870858812408960:12345-192.168.204.16@tcp:101:cp.0 Request processed in 703us (2657us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191892.311043:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 621 00000100:00100000:2.0:1784191892.314298:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.314376:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812409216 00000100:00100000:1.0:1784191892.314387:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812409216 00000100:00100000:1.0:1784191892.314445:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 622 00000100:00100000:1.0:1784191892.314455:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+152:123690:x1870858812409216:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191892.314492:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191892.314515:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c07f lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bdbd expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.314633:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c086 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.314648:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c086 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.314661:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c086 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.314676:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c08d lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.314683:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c08d lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.314722:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c08d lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191892.315166:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x257:0x0], index 0: 0 00080000:00000400:1.0:1784191892.315179:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:1.0:1784191892.315183:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191892.315185:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191892.315187:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191892.315190:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191892.315192:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191892.315207:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:1.0:1784191892.315209:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191892.315218:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191892.315220:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191892.315222:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191892.315224:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191892.315253:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:1.0:1784191892.315255:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191892.315257:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191892.315259:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191892.315262:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191892.315263:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191892.315358:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4c094 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.315368:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4c094 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.315375:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4c094 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.315406:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c086 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.315413:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c086 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.315420:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c086 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.315427:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c086 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.315432:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.315436:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c086 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.315449:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c086 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.315461:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.315464:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.315468:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c086 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.315475:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c086 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191892.315490:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008de7d4c1 reply state 00000000ff40ce62 transno 34359738722 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c08d lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.315501:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c08d lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.315507:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xa9dd9870 (ffff8af2331f1700) 00010000:00010000:1.0:1784191892.315509:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191892.315511:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191892.315541:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c07f lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdbd expref: 155 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.315569:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4c094 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdbd expref: 154 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.315577:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x24:0x0].0x0 (ffff8af2331f1100) 00010000:00010000:1.0:1784191892.315579:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191892.315581:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8600, rc 0) 00000100:00100000:1.0:1784191892.315665:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+155:123690:x1870858812409216:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1211us (1376us total) trans 34359738722 rc 0/0 00000100:00100000:1.0:1784191892.315674:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 622 00000100:00100000:2.0:1784191892.323794:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.327320:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812409344 00000100:00100000:0.0:1784191892.327336:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812409344 00000100:00100000:0.0:1784191892.327570:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 317 00000100:00100000:0.0:1784191892.327583:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:69110:x1870858812409344:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.327609:0:162395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.327633:0:162395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e67abe/0xfeec3c2dc5a4c0a2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bdc4 expref: -99 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191892.327665:0:162395:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x257:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191892.327712:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x257:0x0].0x0 since=5512s v=(0 0) 00010000:00010000:0.0:1784191892.327717:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x257:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.327727:0:162395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e67abe/0xfeec3c2dc5a4c0a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdc4 expref: 24 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.327746:0:162395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9e67abe/0xfeec3c2dc5a4c0a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdc4 expref: 24 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.327778:0:162395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010be400, rc 0) 00000100:00100000:0.0:1784191892.327866:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:69110:x1870858812409344:12345-192.168.204.16@tcp:101:cp.0 Request processed in 285us (4081us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.327874:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 317 00000100:00100000:3.0:1784191892.330421:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.330535:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812409472 00000100:00100000:0.0:1784191892.330556:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812409472 00000100:00100000:0.0:1784191892.330670:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 318 00000100:00100000:0.0:1784191892.330682:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:123690:x1870858812409472:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.330788:0:162385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.330812:0:162385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000664a8f24/0xfeec3c2dc5a4c0a9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bdcb expref: -99 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.330846:0:162385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9e67abe/0xfeec3c2dc5a4c0a2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdc4 expref: 25 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.330855:0:162385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x257:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.330860:0:162385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x257:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.330865:0:162385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000664a8f24/0xfeec3c2dc5a4c0a9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdcb expref: 25 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.330903:0:162385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9e67abe/0xfeec3c2dc5a4c0a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdc4 expref: 25 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.330919:0:162385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9e67abe/0xfeec3c2dc5a4c0a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdc4 expref: 25 pid: 162395 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191892.330949:0:162385:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:162385:1870858827964800:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191892.331053:0:162385:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111502780 going to sleep for 11 seconds 00000100:00100000:2.0:1784191892.337179:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.337264:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812409600 00000100:00100000:3.0:1784191892.337274:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812409600 00010000:00010000:3.0:1784191892.337315:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e67abe/0xfeec3c2dc5a4c0a2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdc4 expref: 26 pid: 162395 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191892.337369:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 165 00000100:00100000:3.0:1784191892.337379:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:69112:x1870858812409600:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191892.337396:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191892.337420:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9e67abe/0xfeec3c2dc5a4c0a2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdc4 expref: 26 pid: 162395 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.337437:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9e67abe/0xfeec3c2dc5a4c0a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdc4 expref: 26 pid: 162395 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.337478:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x257:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191892.337484:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x257:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191892.337493:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000664a8f24/0xfeec3c2dc5a4c0a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdcb expref: 26 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.337527:0:158650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000664a8f24/0xfeec3c2dc5a4c0a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdcb expref: 26 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.337583:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000664a8f24/0xfeec3c2dc5a4c0a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdcb expref: 26 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191892.337598:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:158650:1870858827964928:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191892.337644:0:162385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e67abe/0xfeec3c2dc5a4c0a2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdc4 expref: 26 pid: 162395 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191892.337659:0:162385:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:162385:1870858827964800:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191892.337708:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35a80 going to sleep for 11 seconds 00010000:00010000:0.0:1784191892.337721:0:162385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000664a8f24/0xfeec3c2dc5a4c0a9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdcb expref: 25 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.337734:0:162385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010bf000, rc 0) 00000100:00100000:0.0:1784191892.337765:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+25:123690:x1870858812409472:12345-192.168.204.16@tcp:101:cp.0 Request processed in 7085us (7415us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.337773:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 318 00000100:00100000:3.0:1784191892.341457:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.341725:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812409856 00000100:00100000:2.0:1784191892.341736:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812409856 00000100:00100000:2.0:1784191892.341799:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 172 00000100:00100000:2.0:1784191892.341812:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+155:123690:x1870858812409856:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191892.342374:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+156:123690:x1870858812409856:12345-192.168.204.16@tcp:35:cp.0 Request processed in 562us (929us total) trans 34359738723 rc 0/0 00000100:00100000:2.0:1784191892.342384:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 172 00000100:00100000:0.0:1784191892.342675:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:158650:1870858827964928:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191892.342731:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191892.342759:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:69112:x1870858812409600:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5381us (5593us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.342768:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 165 00000100:00100000:2.0:1784191892.350124:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.350304:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812409984 00000100:00100000:0.0:1784191892.350317:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812409984 00000100:00100000:0.0:1784191892.350384:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 623 00000100:00100000:0.0:1784191892.350396:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+156:123690:x1870858812409984:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.350921:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.350963:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c0b0 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bdd2 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.351042:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c0b7 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.351057:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c0b7 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.351071:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c0b7 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351316:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c0be lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351327:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c0be lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351334:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c0be lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351600:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c0b7 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351609:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c0b7 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351615:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c0b7 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351622:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c0b7 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351628:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010bf600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.351632:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c0b7 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351640:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c0b7 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351654:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.351666:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.351671:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c0b7 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351678:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c0b7 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351801:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c0be lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351807:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c0be lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351813:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c0be lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351818:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.351821:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c0be lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351827:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c0be lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351835:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x839e9634 (ffff8af2331f1c00) 00010000:00010000:1.0:1784191892.351838:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.351840:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c0be lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351846:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c0be lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351889:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c0b0 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdd2 expref: 157 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351908:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.351910:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.351914:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c0b0 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdd2 expref: 157 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.351924:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010be400, rc 0) 00000100:00100000:1.0:1784191892.352054:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+156:123690:x1870858812409984:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1659us (1941us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191892.352062:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 623 00000100:00100000:3.0:1784191892.362578:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.362666:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812410112 00000100:00100000:2.0:1784191892.362677:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812410112 00000100:00100000:2.0:1784191892.362784:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 624 00000100:00100000:2.0:1784191892.362796:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+156:123690:x1870858812410112:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.362821:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.362843:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c0c5 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bdd9 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.362925:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c0cc lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.362942:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c0cc lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.362955:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c0cc lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363232:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c0d3 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363242:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c0d3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363250:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c0d3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363314:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c0cc lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363322:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c0cc lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363327:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c0cc lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363334:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c0cc lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363340:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cd000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.363345:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c0cc lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363353:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c0cc lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363365:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.363368:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.363372:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c0cc lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363378:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c0cc lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363394:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c0d3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363400:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c0d3 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363413:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c0d3 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363628:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cc800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.363632:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c0d3 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363638:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c0d3 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363647:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x839e9634 (ffff8af2382d2100) 00010000:00010000:2.0:1784191892.363649:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.363652:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c0d3 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363658:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c0d3 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363724:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c0c5 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdd9 expref: 157 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363735:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.363737:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.363741:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c0c5 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdd9 expref: 157 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.363751:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cda00, rc 0) 00000100:00100000:2.0:1784191892.368900:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+156:123690:x1870858812410112:12345-192.168.204.16@tcp:101:cp.0 Request processed in 6091us (6318us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191892.368939:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 624 00000100:00100000:3.0:1784191892.375621:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.375748:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812410368 00000100:00100000:2.0:1784191892.375760:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812410368 00000100:00100000:2.0:1784191892.375827:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 625 00000100:00100000:2.0:1784191892.375838:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+156:123690:x1870858812410368:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.375870:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.375893:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cdc00/0xfeec3c2dc5a4c0da lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bde0 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376016:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c0e1 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376031:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c0e1 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376043:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c0e1 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376060:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c0e8 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376067:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c0e8 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376073:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c0e8 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191892.376399:0:158667:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1d4:0x0], index 1: 0 00080000:00000400:2.0:1784191892.376412:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191892.376434:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191892.376436:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191892.376439:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191892.376441:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191892.376443:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191892.376464:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191892.376467:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191892.376469:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191892.376471:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191892.376473:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191892.376475:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191892.376507:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191892.376509:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191892.376511:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191892.376513:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191892.376515:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191892.376517:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191892.376641:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4c0ef lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376651:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4c0ef lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376659:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4c0ef lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376735:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c0e1 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376742:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c0e1 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376749:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c0e1 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376763:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c0e1 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376769:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cc400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.376774:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c0e1 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376782:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c0e1 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376795:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.376798:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.376803:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c0e1 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376810:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c0e1 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191892.376827:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000765e0521 reply state 00000000e6647e8c transno 34359738724 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c0e8 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376838:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c0e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376844:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x839e9634 (ffff8af2382d2d00) 00010000:00010000:2.0:1784191892.376846:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191892.376849:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191892.376878:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cdc00/0xfeec3c2dc5a4c0da lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bde0 expref: 159 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376910:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4c0ef lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bde0 expref: 158 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.376918:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x25:0x0].0x0 (ffff8af2382d2500) 00010000:00010000:2.0:1784191892.376920:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191892.376923:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cce00, rc 0) 00000100:00100000:2.0:1784191892.377001:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+159:123690:x1870858812410368:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1165us (1392us total) trans 34359738724 rc 0/0 00000100:00100000:2.0:1784191892.377008:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 625 00000100:00100000:2.0:1784191892.387840:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.390576:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812410496 00000100:00100000:3.0:1784191892.390592:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812410496 00000100:00100000:2.0:1784191892.392972:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 319 00000100:00100000:2.0:1784191892.392989:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:69112:x1870858812410496:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.393013:0:162396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.393042:0:162396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c0fd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bde7 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191892.393072:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191892.393099:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d4:0x0].0x0 since=5512s v=(0 0) 00010000:00010000:2.0:1784191892.393104:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.393119:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c0fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bde7 expref: 24 pid: 162396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.393141:0:162396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c0fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bde7 expref: 24 pid: 162396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.393185:0:162396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cd600, rc 0) 00000100:00100000:2.0:1784191892.394957:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:69112:x1870858812410496:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1952us (7108us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191892.394974:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 319 00000100:00100000:0.0:1784191892.405353:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.405817:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812410624 00000100:00100000:2.0:1784191892.405828:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812410624 00000100:00100000:2.0:1784191892.405898:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 320 00000100:00100000:2.0:1784191892.405909:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:123690:x1870858812410624:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.405930:0:162386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.405952:0:162386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f714d7c/0xfeec3c2dc5a4c104 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bdee expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.405988:0:162386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c0fd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bde7 expref: 25 pid: 162396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.405998:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.406003:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.406008:0:162386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f714d7c/0xfeec3c2dc5a4c104 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdee expref: 25 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.406044:0:162386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c0fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bde7 expref: 25 pid: 162396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.406059:0:162386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c0fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bde7 expref: 25 pid: 162396 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191892.406092:0:162386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:162386:1870858827965056:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191892.406208:0:162386:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2206fd840 going to sleep for 11 seconds 00000100:00100000:0.0:1784191892.417580:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.417705:0:162386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:162386:1870858827965056:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191892.417750:0:162386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000f714d7c/0xfeec3c2dc5a4c104 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdee expref: 25 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.417772:0:162386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cdc00, rc 0) 00000100:00100000:2.0:1784191892.417829:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+25:123690:x1870858812410624:12345-192.168.204.16@tcp:101:cp.0 Request processed in 11922us (12489us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191892.417837:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 320 00000100:00100000:1.0:1784191892.419435:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812410752 00000100:00100000:1.0:1784191892.419449:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812410752 00010000:00010000:1.0:1784191892.419825:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c0fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bde7 expref: 25 pid: 162396 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191892.419922:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 166 00000100:00100000:1.0:1784191892.419932:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+25:69110:x1870858812410752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191892.419947:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191892.419969:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c0fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bde7 expref: 25 pid: 162396 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.419982:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c0fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bde7 expref: 25 pid: 162396 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.420006:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c0fd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bde7 expref: 25 pid: 162396 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.420043:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191892.420047:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191892.420055:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f714d7c/0xfeec3c2dc5a4c104 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdee expref: 24 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.420064:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f714d7c/0xfeec3c2dc5a4c104 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdee expref: 24 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.420120:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000f714d7c/0xfeec3c2dc5a4c104 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdee expref: 24 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191892.420135:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b85c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827965184:192.168.204.16@tcp:105: 00000100:00100000:1.0:1784191892.420227:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e69e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191892.424295:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.424562:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812411008 00000100:00100000:1.0:1784191892.424575:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812411008 00000100:00100000:1.0:1784191892.424646:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 173 00000100:00100000:1.0:1784191892.424656:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+159:123690:x1870858812411008:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:1.0:1784191892.425014:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+160:123690:x1870858812411008:12345-192.168.204.16@tcp:35:cp.0 Request processed in 358us (732us total) trans 34359738725 rc 0/0 00000100:00100000:1.0:1784191892.425023:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 173 00000100:00100000:1.0:1784191892.425072:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b85c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827965184:192.168.204.16@tcp:105: 00010000:00010000:1.0:1784191892.425092:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191892.425115:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:69110:x1870858812410752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5184us (7545us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191892.425138:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 166 00000100:00100000:0.0:1784191892.437636:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.438263:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812411136 00000100:00100000:1.0:1784191892.438275:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812411136 00000100:00100000:1.0:1784191892.438338:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 626 00000100:00100000:1.0:1784191892.438348:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+160:123690:x1870858812411136:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191892.438376:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191892.438399:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c10b lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bdf5 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.438653:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c112 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.438670:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c112 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.438683:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c112 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.438830:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c119 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.438839:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c119 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.438847:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c119 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.438893:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c112 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.438919:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c112 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.438925:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c112 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.438931:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c112 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.438937:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3f000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.438942:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c112 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.438950:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c112 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.438963:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.438966:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.438970:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c112 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.438977:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c112 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.438990:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c119 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.438996:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c119 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.439002:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c119 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.439013:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.439017:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c119 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.439023:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c119 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.439031:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9e90f16b (ffff8af2331f1c00) 00010000:00010000:1.0:1784191892.439034:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.439037:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c119 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.439043:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c119 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.439080:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c10b lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdf5 expref: 161 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.439252:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.439256:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.439261:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c10b lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdf5 expref: 161 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.439272:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3e200, rc 0) 00000100:00100000:1.0:1784191892.439389:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+160:123690:x1870858812411136:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1041us (1763us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191892.439398:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 626 00000100:00100000:1.0:1784191892.442570:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.442676:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812411264 00000100:00100000:2.0:1784191892.442810:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812411264 00000100:00100000:2.0:1784191892.442907:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 627 00000100:00100000:2.0:1784191892.442918:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+160:123690:x1870858812411264:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.442943:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.442964:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c120 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bdfc expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443035:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c127 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443049:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c127 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443060:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c127 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443085:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c12e lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443293:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c12e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443302:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c12e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443348:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c127 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443356:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c127 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443361:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c127 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443368:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c127 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443374:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cda00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.443378:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c127 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443386:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c127 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443399:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.443402:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.443406:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c127 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443422:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c127 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443439:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c12e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443445:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c12e lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443451:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c12e lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443457:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cc800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.443459:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c12e lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443555:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c12e lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443565:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9e90f16b (ffff8af2382d2100) 00010000:00010000:2.0:1784191892.443568:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.443571:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c12e lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443577:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c12e lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443614:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c120 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdfc expref: 161 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443639:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.443642:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.443646:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c120 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdfc expref: 161 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.443656:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cc400, rc 0) 00000100:00100000:2.0:1784191892.443961:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+160:123690:x1870858812411264:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1043us (1400us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191892.443970:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 627 00000100:00100000:0.0:1784191892.453360:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.454483:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812411520 00000100:00100000:2.0:1784191892.454495:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812411520 00000100:00100000:2.0:1784191892.454578:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 628 00000100:00100000:2.0:1784191892.454591:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+160:123690:x1870858812411520:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.454615:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.454639:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c135 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be03 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.454946:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c13c lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.454963:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c13c lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.454975:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c13c lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.454990:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c143 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.455006:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c143 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.455013:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c143 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191892.455350:0:158667:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x258:0x0], index 0: 0 00080000:00000400:2.0:1784191892.455363:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191892.455367:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191892.455369:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191892.455371:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191892.455373:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191892.455375:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191892.455391:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191892.455393:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191892.455395:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191892.455397:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191892.455399:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191892.455401:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191892.455488:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191892.455491:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191892.455493:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191892.455494:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191892.455496:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191892.455498:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191892.455616:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c14a lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.455626:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c14a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.455645:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c14a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.455682:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c13c lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.455994:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c13c lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.456001:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c13c lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.456008:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c13c lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.456014:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cd600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.456018:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c13c lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.456027:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c13c lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.456041:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.456044:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.456048:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c13c lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.456055:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c13c lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191892.456073:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007d495f20 reply state 000000005f42f196 transno 34359738726 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c143 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.456093:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c143 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.456099:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9e90f16b (ffff8af2382d2300) 00010000:00010000:2.0:1784191892.456101:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191892.456104:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191892.456141:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c135 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be03 expref: 163 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.456158:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c14a lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be03 expref: 162 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.456165:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x26:0x0].0x0 (ffff8af2382d2600) 00010000:00010000:2.0:1784191892.456167:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191892.456170:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cca00, rc 0) 00000100:00100000:2.0:1784191892.456291:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+163:123690:x1870858812411520:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1702us (2942us total) trans 34359738726 rc 0/0 00000100:00100000:2.0:1784191892.456299:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 628 00000100:00100000:1.0:1784191892.464289:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.464640:0:162390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812411648 00000100:00100000:3.0:1784191892.464651:0:162390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812411648 00000100:00100000:3.0:1784191892.464745:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 321 00000100:00100000:3.0:1784191892.464758:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:69110:x1870858812411648:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191892.464780:0:162390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191892.464804:0:162390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebbede44/0xfeec3c2dc5a4c158 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be0a expref: -99 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191892.464833:0:162390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x258:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191892.465115:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x258:0x0].0x0 since=5512s v=(0 0) 00010000:00010000:0.0:1784191892.465122:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x258:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.465134:0:162390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebbede44/0xfeec3c2dc5a4c158 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be0a expref: 25 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.465154:0:162390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ebbede44/0xfeec3c2dc5a4c158 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be0a expref: 25 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.465170:0:162390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3c00, rc 0) 00000100:00100000:0.0:1784191892.465253:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+25:69110:x1870858812411648:12345-192.168.204.16@tcp:101:cp.0 Request processed in 498us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.465260:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 321 00000100:00100000:0.0:1784191892.482911:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.482989:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812411776 00000100:00100000:3.0:1784191892.483003:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812411776 00000100:00100000:3.0:1784191892.483087:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 322 00000100:00100000:3.0:1784191892.483098:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+25:123690:x1870858812411776:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191892.483119:0:160165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191892.483144:0:160165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000656eaba/0xfeec3c2dc5a4c15f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x258:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be11 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.483186:0:160165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebbede44/0xfeec3c2dc5a4c158 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x258:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be0a expref: 26 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.483197:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x258:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191892.483202:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x258:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191892.483207:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000656eaba/0xfeec3c2dc5a4c15f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x258:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be11 expref: 26 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.483244:0:160165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ebbede44/0xfeec3c2dc5a4c158 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x258:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be0a expref: 26 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.483260:0:160165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ebbede44/0xfeec3c2dc5a4c158 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x258:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be0a expref: 26 pid: 162390 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191892.483278:0:160165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:160165:1870858827965312:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191892.483384:0:160165:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191892.492149:0:160165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:160165:1870858827965312:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191892.492190:0:160165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000656eaba/0xfeec3c2dc5a4c15f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x258:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be11 expref: 26 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.492240:0:160165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d533e00, rc 0) 00000100:00100000:3.0:1784191892.492306:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:123690:x1870858812411776:12345-192.168.204.16@tcp:101:cp.0 Request processed in 9208us (9406us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191892.492315:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 322 00000100:00100000:1.0:1784191892.501585:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.502126:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812411904 00000100:00100000:0.0:1784191892.502137:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812411904 00010000:00010000:0.0:1784191892.502182:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ebbede44/0xfeec3c2dc5a4c158 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x258:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be0a expref: 26 pid: 162390 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191892.502221:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 167 00000100:00100000:0.0:1784191892.502231:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af202d72050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:69112:x1870858812411904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191892.502247:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191892.502271:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ebbede44/0xfeec3c2dc5a4c158 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x258:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be0a expref: 26 pid: 162390 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.502287:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ebbede44/0xfeec3c2dc5a4c158 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x258:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be0a expref: 26 pid: 162390 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.502311:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebbede44/0xfeec3c2dc5a4c158 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x258:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be0a expref: 26 pid: 162390 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.502329:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x258:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.502334:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x258:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.502342:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000656eaba/0xfeec3c2dc5a4c15f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x258:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be11 expref: 25 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.502352:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000656eaba/0xfeec3c2dc5a4c15f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x258:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be11 expref: 25 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.502511:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000656eaba/0xfeec3c2dc5a4c15f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x258:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be11 expref: 25 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191892.502551:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827965440:192.168.204.16@tcp:105: 00000100:00100000:0.0:1784191892.502747:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111502780 going to sleep for 11 seconds 00000100:00100000:0.0:1784191892.514253:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.514379:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827965440:192.168.204.16@tcp:105: 00010000:00010000:3.0:1784191892.514411:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191892.514419:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812412160 00000100:00100000:1.0:1784191892.514429:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812412160 00000100:00100000:1.0:1784191892.514507:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 174 00000100:00100000:1.0:1784191892.514518:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105327450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+163:123690:x1870858812412160:12345-192.168.204.16@tcp:35:cp.0 00000001:00080000:1.0:1784191892.514831:0:158669:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738727 00000100:00100000:3.0:1784191892.514888:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af202d72050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+25:69112:x1870858812411904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 12658us (13314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191892.514898:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 167 00000100:00100000:1.0:1784191892.514927:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105327450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+165:123690:x1870858812412160:12345-192.168.204.16@tcp:35:cp.0 Request processed in 412us (691us total) trans 34359738728 rc 0/0 00000100:00100000:1.0:1784191892.514934:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 174 00000020:00080000:1.0:1784191892.514938:0:158669:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784191892.523231:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.523368:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812412288 00000100:00100000:1.0:1784191892.523379:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812412288 00000100:00100000:1.0:1784191892.523447:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 629 00000100:00100000:1.0:1784191892.523457:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+165:123690:x1870858812412288:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191892.523617:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191892.523640:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c166 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be18 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.523821:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c16d lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.523837:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c16d lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.523849:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c16d lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.523863:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c174 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.523886:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c174 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.523894:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c174 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.523945:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c16d lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.523953:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c16d lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.523959:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c16d lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.523967:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c16d lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.523974:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200031a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.523978:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c16d lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.523986:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c16d lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.523998:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.524001:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.524006:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c16d lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.524013:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c16d lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.524037:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c174 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.524044:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c174 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.524050:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c174 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.524055:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.524059:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c174 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.524065:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c174 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.524073:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x10fe8da8 (ffff8af2331f1c00) 00010000:00010000:1.0:1784191892.524076:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.524078:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c174 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.524084:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c174 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.524121:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c166 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be18 expref: 166 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.524132:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.524134:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.524145:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c166 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be18 expref: 166 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.524155:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200031600, rc 0) 00000100:00100000:2.0:1784191892.526298:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+165:123690:x1870858812412288:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2824us (3060us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191892.526315:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 629 00000100:00100000:0.0:1784191892.531444:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.531623:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812412416 00000100:00100000:2.0:1784191892.531637:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812412416 00000100:00100000:2.0:1784191892.531748:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 630 00000100:00100000:2.0:1784191892.531759:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+165:123690:x1870858812412416:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.531782:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.531828:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c17b lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be1f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.531906:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c182 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.531922:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c182 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.531936:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c182 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.531952:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c189 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.531959:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c189 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.531966:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c189 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.532011:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c182 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.532019:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c182 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.532025:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c182 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.532032:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c182 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.532049:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cd600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.532053:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c182 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.532061:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c182 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.532075:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.532078:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.532083:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c182 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.532104:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c182 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.532122:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c189 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.532128:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c189 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.532134:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c189 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.532139:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cc800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.532142:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c189 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.532148:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c189 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.532168:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x10fe8da8 (ffff8af2382d2100) 00010000:00010000:2.0:1784191892.532170:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.532174:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c189 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.532180:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c189 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.532217:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c17b lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be1f expref: 166 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.532226:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.532229:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.532233:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c17b lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be1f expref: 166 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.532243:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cd000, rc 0) 00000100:00100000:2.0:1784191892.532298:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+165:123690:x1870858812412416:12345-192.168.204.16@tcp:101:cp.0 Request processed in 541us (869us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191892.532305:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 630 00000100:00100000:0.0:1784191892.538499:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.538596:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812412672 00000100:00100000:1.0:1784191892.538608:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812412672 00000100:00100000:1.0:1784191892.538679:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 631 00000100:00100000:1.0:1784191892.538739:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+165:123690:x1870858812412672:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191892.538767:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191892.538792:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c190 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be26 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.538920:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c197 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.538937:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c197 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.538948:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c197 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.538964:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c19e lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.538971:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c19e lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.538978:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c19e lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191892.542430:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1d5:0x0], index 1: 0 00080000:00000400:1.0:1784191892.542470:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191892.542475:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191892.542478:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191892.542480:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191892.542483:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191892.542485:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191892.542508:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191892.542511:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191892.542513:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191892.542515:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191892.542517:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191892.542519:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191892.542568:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191892.542570:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191892.542572:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191892.542574:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191892.542577:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191892.542579:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191892.542748:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031200/0xfeec3c2dc5a4c1a5 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.542767:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031200/0xfeec3c2dc5a4c1a5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.542780:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031200/0xfeec3c2dc5a4c1a5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.542820:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c197 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.542828:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c197 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.542844:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c197 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.542851:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c197 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.542857:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.542862:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c197 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.542868:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c197 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.542882:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.542885:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.542890:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c197 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.542896:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030600/0xfeec3c2dc5a4c197 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191892.542911:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000922acce5 reply state 0000000039abfbd2 transno 34359738729 ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c19e lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.542922:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c19e lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.542928:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x10fe8da8 (ffff8af2331f1c00) 00010000:00010000:1.0:1784191892.542929:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191892.542932:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191892.542983:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c190 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be26 expref: 168 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.542999:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031200/0xfeec3c2dc5a4c1a5 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be26 expref: 167 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.543006:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x27:0x0].0x0 (ffff8af2331f1800) 00010000:00010000:1.0:1784191892.543008:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191892.543010:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200031200, rc 0) 00000100:00100000:1.0:1784191892.543085:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+168:123690:x1870858812412672:12345-192.168.204.16@tcp:101:cp.0 Request processed in 4396us (4596us total) trans 34359738729 rc 0/0 00000100:00100000:1.0:1784191892.543110:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 631 00010000:00010000:2.0:1784191892.558156:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191892.562752:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.562930:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812412800 00000100:00100000:3.0:1784191892.562943:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812412800 00000100:00100000:3.0:1784191892.563005:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 323 00000100:00100000:3.0:1784191892.563016:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:69111:x1870858812412800:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191892.563039:0:162391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191892.563069:0:162391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c1b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be2d expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191892.563098:0:162391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784191892.563119:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d5:0x0].0x0 since=5512s v=(0 0) 00010000:00010000:3.0:1784191892.563124:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191892.563133:0:162391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c1b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be2d expref: 25 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.563152:0:162391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c1b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be2d expref: 25 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.563181:0:162391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd68800, rc 0) 00000100:00100000:3.0:1784191892.563261:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+25:69111:x1870858812412800:12345-192.168.204.16@tcp:101:cp.0 Request processed in 247us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191892.563268:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 323 00000100:00100000:0.0:1784191892.567786:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.567875:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812412928 00000100:00100000:1.0:1784191892.567887:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812412928 00000100:00100000:1.0:1784191892.567952:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 324 00000100:00100000:1.0:1784191892.567963:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+25:123690:x1870858812412928:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191892.567983:0:162392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191892.568002:0:162392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff1434c0/0xfeec3c2dc5a4c1ba lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be34 expref: -99 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.568036:0:162392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c1b3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be2d expref: 26 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.568045:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191892.568050:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191892.568055:0:162392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff1434c0/0xfeec3c2dc5a4c1ba lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be34 expref: 26 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.568107:0:162392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c1b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be2d expref: 26 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.568123:0:162392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c1b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be2d expref: 26 pid: 162391 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191892.568138:0:162392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:162392:1870858827965568:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191892.568238:0:162392:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e69e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191892.571914:0:162392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:162392:1870858827965568:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191892.571952:0:162392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff1434c0/0xfeec3c2dc5a4c1ba lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be34 expref: 26 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.571974:0:162392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200030600, rc 0) 00000100:00100000:0.0:1784191892.572039:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:123690:x1870858812412928:12345-192.168.204.16@tcp:101:cp.0 Request processed in 4077us (4265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.572049:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 324 00000100:00100000:0.0:1784191892.576325:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.576590:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812413056 00000100:00100000:3.0:1784191892.576604:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812413056 00010000:00010000:3.0:1784191892.576654:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c1b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be2d expref: 26 pid: 162391 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191892.576848:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 168 00000100:00100000:3.0:1784191892.576858:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:69110:x1870858812413056:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191892.576877:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191892.576904:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c1b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be2d expref: 26 pid: 162391 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.576920:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c1b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be2d expref: 26 pid: 162391 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.576950:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c1b3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be2d expref: 26 pid: 162391 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.576970:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191892.576975:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191892.576983:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff1434c0/0xfeec3c2dc5a4c1ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be34 expref: 25 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.577011:0:158650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff1434c0/0xfeec3c2dc5a4c1ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be34 expref: 25 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.577050:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff1434c0/0xfeec3c2dc5a4c1ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be34 expref: 25 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191892.577066:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:158650:1870858827965696:192.168.204.16@tcp:105: 00000100:00100000:3.0:1784191892.577279:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784191892.593999:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.595639:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812413312 00000100:00100000:2.0:1784191892.595654:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812413312 00000100:00100000:2.0:1784191892.595783:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 175 00000100:00100000:2.0:1784191892.595794:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+168:123690:x1870858812413312:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191892.596098:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+169:123690:x1870858812413312:12345-192.168.204.16@tcp:35:cp.0 Request processed in 305us (2108us total) trans 34359738730 rc 0/0 00000100:00100000:2.0:1784191892.596123:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 175 00000100:00100000:3.0:1784191892.601373:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:158650:1870858827965696:192.168.204.16@tcp:105: 00010000:00010000:3.0:1784191892.601400:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191892.602043:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+25:69110:x1870858812413056:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 25180us (25721us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191892.602058:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 168 00000100:00100000:1.0:1784191892.608387:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.608586:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812413440 00000100:00100000:2.0:1784191892.608596:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812413440 00000100:00100000:2.0:1784191892.608750:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 632 00000100:00100000:2.0:1784191892.608761:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+169:123690:x1870858812413440:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.608789:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.608813:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c1c1 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be3b expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.608890:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c1c8 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.608906:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c1c8 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.608918:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c1c8 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.608933:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c1cf lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.608940:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c1cf lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.608947:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c1cf lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.609009:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c1c8 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.609016:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c1c8 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.609022:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c1c8 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.609029:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c1c8 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.609035:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cc800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.609039:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c1c8 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.609047:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c1c8 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.609060:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.609063:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.609068:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c1c8 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.609075:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c1c8 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.609093:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c1cf lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.609098:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c1cf lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.609111:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c1cf lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.609116:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cd600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.609119:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c1cf lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.609125:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c1cf lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.609133:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x6b7bd7c (ffff8af2382d2100) 00010000:00010000:2.0:1784191892.609135:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.609138:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c1cf lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.609143:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c1cf lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.609179:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c1c1 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be3b expref: 170 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.609191:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.609208:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.609213:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd000/0xfeec3c2dc5a4c1c1 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be3b expref: 170 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.609225:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cd000, rc 0) 00000100:00100000:2.0:1784191892.609294:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+169:123690:x1870858812413440:12345-192.168.204.16@tcp:101:cp.0 Request processed in 534us (921us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191892.609312:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 632 00000100:00100000:3.0:1784191892.612665:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.613437:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812413568 00000100:00100000:0.0:1784191892.613450:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812413568 00000100:00100000:0.0:1784191892.613569:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 633 00000100:00100000:0.0:1784191892.613581:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+169:123690:x1870858812413568:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.613608:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.613634:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be200/0xfeec3c2dc5a4c1d6 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be42 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613760:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c1dd lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613775:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c1dd lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613788:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c1dd lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613805:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfa00/0xfeec3c2dc5a4c1e4 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613814:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfa00/0xfeec3c2dc5a4c1e4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613821:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfa00/0xfeec3c2dc5a4c1e4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613864:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c1dd lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613873:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c1dd lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613880:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c1dd lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613888:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c1dd lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613894:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010bee00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191892.613905:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c1dd lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613913:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c1dd lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613926:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191892.613930:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.613935:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c1dd lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613943:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c1dd lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613959:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfa00/0xfeec3c2dc5a4c1e4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613966:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfa00/0xfeec3c2dc5a4c1e4 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613972:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfa00/0xfeec3c2dc5a4c1e4 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613978:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010bfa00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191892.613981:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfa00/0xfeec3c2dc5a4c1e4 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613987:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfa00/0xfeec3c2dc5a4c1e4 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.613994:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x6b7bd7c (ffff8af233110900) 00010000:00010000:0.0:1784191892.613996:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.614006:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfa00/0xfeec3c2dc5a4c1e4 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.614013:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfa00/0xfeec3c2dc5a4c1e4 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.614049:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be200/0xfeec3c2dc5a4c1d6 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be42 expref: 170 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.614060:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191892.614063:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.614066:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be200/0xfeec3c2dc5a4c1d6 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be42 expref: 170 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.614076:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010be200, rc 0) 00000100:00100000:0.0:1784191892.614381:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+169:123690:x1870858812413568:12345-192.168.204.16@tcp:101:cp.0 Request processed in 801us (1728us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191892.614389:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 633 00000100:00100000:3.0:1784191892.618136:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.618947:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812413824 00000100:00100000:0.0:1784191892.618961:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812413824 00000100:00100000:0.0:1784191892.619030:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 634 00000100:00100000:0.0:1784191892.619040:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+169:123690:x1870858812413824:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.619063:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.619087:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c1eb lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be49 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.619361:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c1f2 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.619390:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c1f2 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.619403:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c1f2 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.619419:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c1f9 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.619427:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c1f9 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.619433:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c1f9 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191892.620034:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x259:0x0], index 0: 0 00080000:00000400:0.0:1784191892.620051:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:0.0:1784191892.620055:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:0.0:1784191892.620058:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191892.620060:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191892.620062:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191892.620064:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191892.620081:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:0.0:1784191892.620084:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:0.0:1784191892.620086:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191892.620088:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191892.620106:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191892.620108:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191892.620145:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:0.0:1784191892.620148:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:0.0:1784191892.620149:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191892.620159:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191892.620161:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191892.620163:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191892.620559:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfc00/0xfeec3c2dc5a4c200 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.620573:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfc00/0xfeec3c2dc5a4c200 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.620582:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfc00/0xfeec3c2dc5a4c200 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.620619:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c1f2 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.620626:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c1f2 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.620633:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c1f2 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.620640:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c1f2 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.620645:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010be400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191892.620649:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c1f2 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.620657:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c1f2 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.620670:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191892.620673:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.620857:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c1f2 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.620867:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c1f2 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191892.620886:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b306f2ed reply state 00000000f7218256 transno 34359738731 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c1f9 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.620898:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c1f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.620904:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x6b7bd7c (ffff8af233110400) 00010000:00010000:0.0:1784191892.620906:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191892.620909:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191892.620943:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c1eb lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be49 expref: 172 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.620957:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfc00/0xfeec3c2dc5a4c200 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be49 expref: 171 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.620964:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x28:0x0].0x0 (ffff8af233110b00) 00010000:00010000:0.0:1784191892.620966:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191892.620968:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010bfc00, rc 0) 00000100:00100000:0.0:1784191892.621048:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+172:123690:x1870858812413824:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2009us (2925us total) trans 34359738731 rc 0/0 00000100:00100000:0.0:1784191892.621057:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 634 00000100:00100000:3.0:1784191892.625004:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.625398:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812413952 00000100:00100000:1.0:1784191892.625408:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812413952 00000100:00100000:1.0:1784191892.625470:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 325 00000100:00100000:1.0:1784191892.625480:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+25:69110:x1870858812413952:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191892.625497:0:162389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191892.625519:0:162389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c20e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be50 expref: -99 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784191892.625555:0:162389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x259:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191892.625575:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x259:0x0].0x0 since=5512s v=(0 0) 00010000:00010000:1.0:1784191892.625579:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x259:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191892.625589:0:162389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c20e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be50 expref: 26 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.625627:0:162389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c20e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be50 expref: 26 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.625640:0:162389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200030200, rc 0) 00000100:00100000:1.0:1784191892.625717:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:69110:x1870858812413952:12345-192.168.204.16@tcp:101:cp.0 Request processed in 231us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191892.625725:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 325 00000100:00100000:3.0:1784191892.628600:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.628719:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812414080 00000100:00100000:2.0:1784191892.628731:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812414080 00000100:00100000:2.0:1784191892.628785:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 326 00000100:00100000:2.0:1784191892.628795:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:123690:x1870858812414080:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.628813:0:160163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.628832:0:160163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007912d3f9/0xfeec3c2dc5a4c215 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x259:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be57 expref: -99 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.628863:0:160163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c20e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be50 expref: 27 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.628871:0:160163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x259:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.628876:0:160163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x259:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.628881:0:160163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007912d3f9/0xfeec3c2dc5a4c215 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x259:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be57 expref: 27 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.628918:0:160163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c20e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be50 expref: 27 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.628932:0:160163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c20e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be50 expref: 27 pid: 162389 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191892.628948:0:160163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:160163:1870858827965824:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191892.629038:0:160163:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2206fdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784191892.631675:0:160163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:160163:1870858827965824:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191892.631772:0:160163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007912d3f9/0xfeec3c2dc5a4c215 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x259:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be57 expref: 27 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.631797:0:160163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cd000, rc 0) 00000100:00100000:2.0:1784191892.631867:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:123690:x1870858812414080:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3073us (3277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191892.631877:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 326 00000100:00100000:3.0:1784191892.633898:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.634630:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812414208 00000100:00100000:1.0:1784191892.634643:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812414208 00010000:00010000:1.0:1784191892.634733:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c20e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be50 expref: 27 pid: 162389 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191892.634783:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 169 00000100:00100000:1.0:1784191892.634793:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:69111:x1870858812414208:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191892.634810:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191892.634833:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c20e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be50 expref: 27 pid: 162389 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.634850:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c20e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be50 expref: 27 pid: 162389 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.634874:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c20e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be50 expref: 27 pid: 162389 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.634910:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x259:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191892.634914:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x259:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191892.634923:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007912d3f9/0xfeec3c2dc5a4c215 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be57 expref: 26 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.634932:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007912d3f9/0xfeec3c2dc5a4c215 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be57 expref: 26 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.634972:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007912d3f9/0xfeec3c2dc5a4c215 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be57 expref: 26 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191892.634987:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b86d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827965952:192.168.204.16@tcp:105: 00000100:00100000:1.0:1784191892.635068:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e69eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191892.639499:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b86d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827965952:192.168.204.16@tcp:105: 00010000:00010000:1.0:1784191892.639532:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191892.639610:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:69111:x1870858812414208:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4817us (5718us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191892.639623:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 169 00000100:00100000:0.0:1784191892.641378:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.641849:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812414464 00000100:00100000:2.0:1784191892.641858:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812414464 00000100:00100000:2.0:1784191892.641917:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 176 00000100:00100000:2.0:1784191892.641927:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+172:123690:x1870858812414464:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191892.642256:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+173:123690:x1870858812414464:12345-192.168.204.16@tcp:35:cp.0 Request processed in 329us (884us total) trans 34359738732 rc 0/0 00000100:00100000:2.0:1784191892.642265:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 176 00000100:00100000:3.0:1784191892.646196:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.646297:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812414592 00000100:00100000:2.0:1784191892.646308:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812414592 00000100:00100000:2.0:1784191892.646375:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 635 00000100:00100000:2.0:1784191892.646386:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+173:123690:x1870858812414592:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.646413:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.646434:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c21c lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be5e expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.646508:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c223 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.646521:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c223 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.646557:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c223 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.646573:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c22a lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.646580:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c22a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.646585:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c22a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.646633:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c223 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.646641:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c223 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.646647:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c223 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.646654:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c223 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.646660:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cc800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.646664:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c223 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.646671:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c223 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.646684:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.648235:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.648245:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c223 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.648255:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c223 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.648281:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c22a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.648288:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c22a lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.648294:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c22a lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.648299:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cda00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.648302:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c22a lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.648308:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c22a lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.648321:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x37dcc2d3 (ffff8af2382d2100) 00010000:00010000:2.0:1784191892.648323:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.648327:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c22a lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.648332:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c22a lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.648385:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c21c lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be5e expref: 174 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.648407:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.648409:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.648413:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c21c lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be5e expref: 174 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.648424:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cd600, rc 0) 00000100:00100000:2.0:1784191892.648729:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+173:123690:x1870858812414592:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2342us (2541us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191892.648737:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 635 00000100:00100000:3.0:1784191892.653126:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.653535:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812414720 00000100:00100000:1.0:1784191892.653554:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812414720 00000100:00100000:1.0:1784191892.653624:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 636 00000100:00100000:1.0:1784191892.653635:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+173:123690:x1870858812414720:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191892.653658:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191892.653681:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c231 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be65 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.653796:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c238 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.653810:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c238 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.653822:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c238 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.653837:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c23f lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.653843:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c23f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.653850:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c23f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.653904:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c238 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.653911:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c238 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.653918:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c238 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.653924:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c238 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.653930:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.653942:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c238 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.653949:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c238 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.653961:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.653964:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.653969:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c238 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.653976:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c238 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.653990:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c23f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.653996:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c23f lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.654001:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c23f lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.654006:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200031600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.654009:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c23f lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.654015:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c23f lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.654022:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x37dcc2d3 (ffff8af2331f1f00) 00010000:00010000:1.0:1784191892.654024:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.654035:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c23f lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.654041:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c23f lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.654081:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c231 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be65 expref: 174 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.654523:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.654528:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.654533:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c231 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be65 expref: 174 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.654554:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200030200, rc 0) 00000100:00100000:1.0:1784191892.654632:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+173:123690:x1870858812414720:12345-192.168.204.16@tcp:101:cp.0 Request processed in 998us (1517us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191892.654639:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 636 00000100:00100000:0.0:1784191892.662826:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.663062:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812414976 00000100:00100000:1.0:1784191892.663074:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812414976 00000100:00100000:1.0:1784191892.663143:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 637 00000100:00100000:1.0:1784191892.663154:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+173:123690:x1870858812414976:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191892.663177:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191892.663199:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c246 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be6c expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.663311:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c24d lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.663349:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c24d lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.663361:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c24d lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.663378:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030a00/0xfeec3c2dc5a4c254 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.663385:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030a00/0xfeec3c2dc5a4c254 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.663391:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030a00/0xfeec3c2dc5a4c254 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191892.663972:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1d6:0x0], index 1: 0 00080000:00000400:1.0:1784191892.663988:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191892.663992:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191892.663995:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191892.663997:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191892.663999:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191892.664002:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191892.664021:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191892.664024:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191892.664026:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191892.664028:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191892.664030:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191892.664032:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191892.664066:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191892.664069:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191892.664071:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191892.664083:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191892.664085:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191892.664087:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191892.664310:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c25b lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.664323:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c25b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.664331:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c25b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.664366:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c24d lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.664374:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c24d lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.664380:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c24d lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.664388:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c24d lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.664394:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.664399:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c24d lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.664406:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c24d lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.664420:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.664423:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.664435:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c24d lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.664442:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c24d lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191892.664458:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000c88904c reply state 000000005b67b8a3 transno 34359738733 ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030a00/0xfeec3c2dc5a4c254 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.664472:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030a00/0xfeec3c2dc5a4c254 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.664478:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x37dcc2d3 (ffff8af2331f1000) 00010000:00010000:1.0:1784191892.664480:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191892.664483:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191892.664519:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c246 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be6c expref: 176 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.664534:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c25b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be6c expref: 175 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.664552:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x29:0x0].0x0 (ffff8af210e98100) 00010000:00010000:1.0:1784191892.664555:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191892.664558:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3e200, rc 0) 00000100:00100000:1.0:1784191892.664963:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+176:123690:x1870858812414976:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1537us (1874us total) trans 34359738733 rc 0/0 00000100:00100000:1.0:1784191892.664974:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 637 00000100:00100000:3.0:1784191892.676329:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.676438:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812415104 00000100:00100000:0.0:1784191892.676478:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812415104 00000100:00100000:0.0:1784191892.676563:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 327 00000100:00100000:0.0:1784191892.676575:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1051f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+25:69112:x1870858812415104:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.676599:0:160166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.676625:0:160166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8d574bd/0xfeec3c2dc5a4c269 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be73 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191892.676651:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191892.676672:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d6:0x0].0x0 since=5512s v=(0 0) 00010000:00010000:0.0:1784191892.676677:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.676846:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d574bd/0xfeec3c2dc5a4c269 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be73 expref: 26 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.676870:0:160166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8d574bd/0xfeec3c2dc5a4c269 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be73 expref: 26 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.676885:0:160166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010be200, rc 0) 00000100:00100000:0.0:1784191892.676944:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1051f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:69112:x1870858812415104:12345-192.168.204.16@tcp:101:cp.0 Request processed in 371us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.676951:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 327 00000100:00100000:3.0:1784191892.688480:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.688618:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812415232 00000100:00100000:0.0:1784191892.688632:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812415232 00000100:00100000:0.0:1784191892.688746:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 328 00000100:00100000:0.0:1784191892.688758:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:123690:x1870858812415232:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.688778:0:162339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.688797:0:162339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000689dcc0/0xfeec3c2dc5a4c270 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be7a expref: -99 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.688851:0:162339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8d574bd/0xfeec3c2dc5a4c269 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be73 expref: 27 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.688861:0:162339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.688866:0:162339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.688872:0:162339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000689dcc0/0xfeec3c2dc5a4c270 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->114687] (req 0->114687) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be7a expref: 27 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.688913:0:162339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a8d574bd/0xfeec3c2dc5a4c269 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be73 expref: 27 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.688930:0:162339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a8d574bd/0xfeec3c2dc5a4c269 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be73 expref: 27 pid: 160166 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191892.688947:0:162339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:162339:1870858827966080:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191892.689039:0:162339:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111502a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784191892.693101:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.693206:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812415360 00000100:00100000:1.0:1784191892.693216:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812415360 00010000:00010000:1.0:1784191892.693264:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d574bd/0xfeec3c2dc5a4c269 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be73 expref: 28 pid: 160166 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191892.693339:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 170 00000100:00100000:1.0:1784191892.693350:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:69110:x1870858812415360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191892.693366:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191892.693389:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8d574bd/0xfeec3c2dc5a4c269 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be73 expref: 28 pid: 160166 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.693405:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8d574bd/0xfeec3c2dc5a4c269 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be73 expref: 28 pid: 160166 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.693434:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191892.693438:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191892.693446:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000689dcc0/0xfeec3c2dc5a4c270 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be7a expref: 28 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.693457:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000689dcc0/0xfeec3c2dc5a4c270 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be7a expref: 28 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.693512:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000689dcc0/0xfeec3c2dc5a4c270 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be7a expref: 28 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191892.693528:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b86d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827966208:192.168.204.16@tcp:105: 00000100:00100000:1.0:1784191892.693631:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e69e480 going to sleep for 11 seconds 00010000:00010000:0.0:1784191892.696225:0:162339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8d574bd/0xfeec3c2dc5a4c269 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be73 expref: 28 pid: 160166 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191892.696250:0:162339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:162339:1870858827966080:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191892.696284:0:162339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000689dcc0/0xfeec3c2dc5a4c270 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be7a expref: 27 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.696326:0:162339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010bfa00, rc 0) 00000100:00100000:0.0:1784191892.696396:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:123690:x1870858812415232:12345-192.168.204.16@tcp:101:cp.0 Request processed in 7639us (7927us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.696405:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 328 00000100:00100000:1.0:1784191892.696514:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b86d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827966208:192.168.204.16@tcp:105: 00010000:00010000:1.0:1784191892.696535:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191892.696571:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:69110:x1870858812415360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3223us (3489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191892.696580:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 170 00000100:00100000:3.0:1784191892.701114:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.701261:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812415616 00000100:00100000:2.0:1784191892.701271:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812415616 00000100:00100000:2.0:1784191892.701333:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 177 00000100:00100000:2.0:1784191892.701344:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+176:123690:x1870858812415616:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191892.701793:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+177:123690:x1870858812415616:12345-192.168.204.16@tcp:35:cp.0 Request processed in 345us (584us total) trans 34359738734 rc 0/0 00000100:00100000:2.0:1784191892.701802:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 177 00000100:00100000:3.0:1784191892.706402:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.706580:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812415744 00000100:00100000:2.0:1784191892.706593:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812415744 00000100:00100000:2.0:1784191892.706655:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 638 00000100:00100000:2.0:1784191892.706666:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+177:123690:x1870858812415744:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.706844:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.706868:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c277 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be81 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.706934:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c27e lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.706967:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c27e lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.706977:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c27e lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.706993:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c285 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707000:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c285 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707006:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c285 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707053:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c27e lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707060:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c27e lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707067:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c27e lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707072:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c27e lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707078:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cda00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.707083:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c27e lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707581:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c27e lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707606:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.707609:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.707614:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c27e lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707621:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c27e lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707639:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c285 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707646:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c285 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707652:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c285 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707657:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cc800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.707660:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c285 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707665:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c285 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707671:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xa4bfea24 (ffff8af2382d2100) 00010000:00010000:2.0:1784191892.707674:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.707676:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c285 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707681:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c285 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707783:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c277 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be81 expref: 178 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707794:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.707796:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.707800:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c277 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be81 expref: 178 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.707809:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cd600, rc 0) 00000100:00100000:2.0:1784191892.707889:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+177:123690:x1870858812415744:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1223us (1496us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191892.707898:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 638 00000100:00100000:3.0:1784191892.710803:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.710905:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812415872 00000100:00100000:1.0:1784191892.710915:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812415872 00000100:00100000:1.0:1784191892.710980:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 639 00000100:00100000:1.0:1784191892.710990:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+177:123690:x1870858812415872:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191892.711013:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191892.711036:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c28c lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be88 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711314:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c293 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711330:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c293 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711341:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c293 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711357:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c29a lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711364:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c29a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711371:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c29a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711438:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c293 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711445:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c293 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711452:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c293 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711458:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c293 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711464:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.711468:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c293 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711476:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c293 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711491:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.711494:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.711499:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c293 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711505:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c293 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711519:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c29a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711526:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c29a lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711549:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c29a lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711554:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.711557:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c29a lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711562:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c29a lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711570:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xa4bfea24 (ffff8af2331f1f00) 00010000:00010000:1.0:1784191892.711572:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.711575:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c29a lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711580:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c29a lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711614:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c28c lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be88 expref: 178 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711624:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.711626:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.711630:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c28c lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be88 expref: 178 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.711639:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3f000, rc 0) 00000100:00100000:1.0:1784191892.711899:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+177:123690:x1870858812415872:12345-192.168.204.16@tcp:101:cp.0 Request processed in 907us (1102us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191892.711916:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 639 00000100:00100000:1.0:1784191892.715512:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.715627:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812416128 00000100:00100000:0.0:1784191892.715639:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812416128 00000100:00100000:0.0:1784191892.715744:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 640 00000100:00100000:0.0:1784191892.715755:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+177:123690:x1870858812416128:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.715780:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.715806:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be200/0xfeec3c2dc5a4c2a1 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be8f expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.715931:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c2a8 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.715949:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c2a8 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.715962:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c2a8 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.715979:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4c2af lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.715986:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4c2af lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.715993:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4c2af lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191892.716375:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x25a:0x0], index 0: 0 00080000:00000400:0.0:1784191892.716388:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191892.716393:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191892.716395:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191892.716398:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191892.716400:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191892.716402:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191892.716420:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191892.716423:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191892.716424:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191892.716427:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191892.716429:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191892.716431:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191892.716459:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191892.716462:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191892.716464:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191892.716466:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191892.716468:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191892.716470:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191892.716584:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfe00/0xfeec3c2dc5a4c2b6 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.716595:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfe00/0xfeec3c2dc5a4c2b6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.716602:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfe00/0xfeec3c2dc5a4c2b6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.716636:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c2a8 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.716655:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c2a8 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.716661:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c2a8 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.716669:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c2a8 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.716674:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010bee00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191892.716678:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c2a8 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.716686:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c2a8 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.716727:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191892.716730:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.716734:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c2a8 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.716741:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c2a8 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191892.716764:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039c6b7a0 reply state 00000000963e4b14 transno 34359738735 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4c2af lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.716776:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4c2af lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.716782:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xa4bfea24 (ffff8af233110000) 00010000:00010000:0.0:1784191892.716793:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191892.716796:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191892.716832:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be200/0xfeec3c2dc5a4c2a1 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be8f expref: 180 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.716849:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfe00/0xfeec3c2dc5a4c2b6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be8f expref: 179 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.716856:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x2a:0x0].0x0 (ffff8af233110600) 00010000:00010000:0.0:1784191892.716858:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191892.716861:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010bfe00, rc 0) 00000100:00100000:0.0:1784191892.716931:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+180:123690:x1870858812416128:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1178us (1431us total) trans 34359738735 rc 0/0 00000100:00100000:0.0:1784191892.716941:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 640 00000100:00100000:3.0:1784191892.721398:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.721497:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812416256 00000100:00100000:2.0:1784191892.721508:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812416256 00000100:00100000:2.0:1784191892.721590:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 329 00000100:00100000:2.0:1784191892.721604:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:69110:x1870858812416256:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.721625:0:162394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.721645:0:162394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c2c4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be96 expref: -99 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191892.721675:0:162394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191892.721754:0:162394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25a:0x0].0x0 since=5512s v=(0 0) 00010000:00010000:2.0:1784191892.721759:0:162394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.721770:0:162394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c2c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be96 expref: 27 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.721811:0:162394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c2c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be96 expref: 27 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.721825:0:162394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cd600, rc 0) 00000100:00100000:2.0:1784191892.721878:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:69110:x1870858812416256:12345-192.168.204.16@tcp:101:cp.0 Request processed in 278us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191892.721885:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 329 00000100:00100000:3.0:1784191892.733474:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.733624:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812416384 00000100:00100000:0.0:1784191892.733635:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812416384 00000100:00100000:0.0:1784191892.733743:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 330 00000100:00100000:0.0:1784191892.733754:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:123690:x1870858812416384:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.733776:0:162398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.733797:0:162398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8d574bd/0xfeec3c2dc5a4c2cb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8be9d expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.733830:0:162398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c2c4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x25a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be96 expref: 28 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.733838:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.733842:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.733856:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8d574bd/0xfeec3c2dc5a4c2cb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 3 type: EXT [0->36863] (req 0->36863) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be9d expref: 28 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.733894:0:162398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c2c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be96 expref: 28 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.733910:0:162398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c2c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x25a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be96 expref: 28 pid: 162394 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191892.733925:0:162398:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:162398:1870858827966336:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191892.734005:0:162398:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111502c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784191892.737397:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.737727:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812416512 00000100:00100000:2.0:1784191892.737739:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812416512 00010000:00010000:2.0:1784191892.737785:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c2c4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x25a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be96 expref: 29 pid: 162394 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191892.737834:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 171 00000100:00100000:2.0:1784191892.737844:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:69111:x1870858812416512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191892.737859:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191892.737881:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c2c4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x25a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be96 expref: 29 pid: 162394 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.737896:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c2c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x25a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be96 expref: 29 pid: 162394 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.737924:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.737929:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.737937:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8d574bd/0xfeec3c2dc5a4c2cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be9d expref: 29 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.737965:0:158650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8d574bd/0xfeec3c2dc5a4c2cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be9d expref: 29 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.738007:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a8d574bd/0xfeec3c2dc5a4c2cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be9d expref: 29 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191892.738021:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:158650:1870858827966464:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191892.738112:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2206fdf00 going to sleep for 11 seconds 00010000:00010000:0.0:1784191892.739254:0:162398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c2c4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x25a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be96 expref: 29 pid: 162394 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191892.739279:0:162398:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:162398:1870858827966336:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191892.739309:0:162398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a8d574bd/0xfeec3c2dc5a4c2cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be9d expref: 28 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.739321:0:162398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010be200, rc 0) 00000100:00100000:0.0:1784191892.739382:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:123690:x1870858812416384:12345-192.168.204.16@tcp:101:cp.0 Request processed in 5630us (5920us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.739391:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 330 00000100:00100000:2.0:1784191892.742756:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:158650:1870858827966464:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191892.742790:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191892.742848:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:69111:x1870858812416512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5005us (5461us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191892.742859:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 171 00000100:00100000:1.0:1784191892.746880:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.746974:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812416768 00000100:00100000:2.0:1784191892.746986:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812416768 00000100:00100000:2.0:1784191892.747054:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 178 00000100:00100000:2.0:1784191892.747065:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+180:123690:x1870858812416768:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191892.747404:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+181:123690:x1870858812416768:12345-192.168.204.16@tcp:35:cp.0 Request processed in 341us (536us total) trans 34359738736 rc 0/0 00000100:00100000:2.0:1784191892.747413:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 178 00000100:00100000:1.0:1784191892.750893:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.751003:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812416896 00000100:00100000:3.0:1784191892.751017:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812416896 00000100:00100000:3.0:1784191892.751099:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 641 00000100:00100000:3.0:1784191892.751110:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+181:123690:x1870858812416896:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191892.751137:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191892.751158:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c2d2 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bea4 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751240:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69c00/0xfeec3c2dc5a4c2d9 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751256:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69c00/0xfeec3c2dc5a4c2d9 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751269:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69c00/0xfeec3c2dc5a4c2d9 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751286:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69200/0xfeec3c2dc5a4c2e0 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751292:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69200/0xfeec3c2dc5a4c2e0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751298:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69200/0xfeec3c2dc5a4c2e0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751341:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69c00/0xfeec3c2dc5a4c2d9 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751349:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69c00/0xfeec3c2dc5a4c2d9 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751375:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69c00/0xfeec3c2dc5a4c2d9 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751381:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69c00/0xfeec3c2dc5a4c2d9 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751387:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd69c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.751391:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69c00/0xfeec3c2dc5a4c2d9 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751398:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69c00/0xfeec3c2dc5a4c2d9 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751410:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191892.751413:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.751419:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69c00/0xfeec3c2dc5a4c2d9 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751425:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69c00/0xfeec3c2dc5a4c2d9 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751440:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69200/0xfeec3c2dc5a4c2e0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751446:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69200/0xfeec3c2dc5a4c2e0 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751452:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69200/0xfeec3c2dc5a4c2e0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751457:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd69200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.751468:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69200/0xfeec3c2dc5a4c2e0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751474:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69200/0xfeec3c2dc5a4c2e0 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751482:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xc2bba7e5 (ffff8af2112b6700) 00010000:00010000:3.0:1784191892.751485:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.751487:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69200/0xfeec3c2dc5a4c2e0 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751493:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69200/0xfeec3c2dc5a4c2e0 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751528:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c2d2 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bea4 expref: 182 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751549:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191892.751551:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.751555:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c2d2 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bea4 expref: 182 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.751566:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd68800, rc 0) 00000100:00100000:3.0:1784191892.751636:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+181:123690:x1870858812416896:12345-192.168.204.16@tcp:101:cp.0 Request processed in 528us (755us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191892.751643:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 641 00000100:00100000:1.0:1784191892.754969:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.755082:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812417024 00000100:00100000:2.0:1784191892.755101:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812417024 00000100:00100000:2.0:1784191892.755167:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 642 00000100:00100000:2.0:1784191892.755178:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+181:123690:x1870858812417024:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.755216:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.755243:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c2e7 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8beab expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755325:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c2ee lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755341:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c2ee lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755352:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c2ee lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755367:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c2f5 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755374:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c2f5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755380:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c2f5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755422:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c2ee lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755429:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c2ee lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755435:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c2ee lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755442:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c2ee lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755456:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cda00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.755460:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c2ee lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755480:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c2ee lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755492:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.755495:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.755500:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c2ee lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755507:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c2ee lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755524:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c2f5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755530:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c2f5 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755546:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c2f5 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755551:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2ccc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.755554:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c2f5 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755560:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c2f5 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755580:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xc2bba7e5 (ffff8af2382d2e00) 00010000:00010000:2.0:1784191892.755583:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.755586:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c2f5 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755593:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c2f5 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755631:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c2e7 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beab expref: 182 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755642:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.755644:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.755648:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c2e7 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beab expref: 182 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.755658:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cc800, rc 0) 00000100:00100000:2.0:1784191892.755779:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+181:123690:x1870858812417024:12345-192.168.204.16@tcp:101:cp.0 Request processed in 602us (819us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191892.755787:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 642 00000100:00100000:1.0:1784191892.763071:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.763188:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812417280 00000100:00100000:2.0:1784191892.763201:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812417280 00000100:00100000:2.0:1784191892.763282:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 643 00000100:00100000:2.0:1784191892.763292:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+181:123690:x1870858812417280:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.763318:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.763342:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c2fc lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8beb2 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.763474:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c303 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.763492:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c303 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.763504:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c303 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.763521:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4c30a lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.763528:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4c30a lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.763534:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4c30a lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191892.763912:0:158666:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1d7:0x0], index 1: 0 00080000:00000400:2.0:1784191892.763925:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191892.763929:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191892.763931:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191892.763933:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191892.763935:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191892.763937:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191892.763954:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191892.763957:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191892.763959:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191892.763961:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191892.763963:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191892.763972:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191892.764005:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191892.764008:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191892.764010:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191892.764012:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191892.764014:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191892.764016:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191892.764110:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4c311 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.764119:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4c311 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.764127:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4c311 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.764156:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c303 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.764164:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c303 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.764170:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c303 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.764177:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c303 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.764183:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cc400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.764188:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c303 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.764196:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c303 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.764216:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.764219:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.764223:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c303 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.764230:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c303 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191892.764246:0:158666:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000051ebd5f7 reply state 000000006224c960 transno 34359738737 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4c30a lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.764257:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4c30a lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.764264:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xc2bba7e5 (ffff8af2382d2b00) 00010000:00010000:2.0:1784191892.764266:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191892.764269:0:158666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191892.764298:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c2fc lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beb2 expref: 184 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.764315:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4c311 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beb2 expref: 183 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.764323:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x2b:0x0].0x0 (ffff8af2382d2400) 00010000:00010000:2.0:1784191892.764325:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191892.764328:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7400, rc 0) 00000100:00100000:2.0:1784191892.764399:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+184:123690:x1870858812417280:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1108us (1338us total) trans 34359738737 rc 0/0 00000100:00100000:2.0:1784191892.764407:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 643 00000100:00100000:1.0:1784191892.768977:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.769115:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812417408 00000100:00100000:3.0:1784191892.769127:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812417408 00000100:00100000:3.0:1784191892.769196:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 331 00000100:00100000:3.0:1784191892.769208:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:69112:x1870858812417408:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191892.769247:0:162391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191892.769269:0:162391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c31f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8beb9 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191892.769295:0:162391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784191892.769315:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d7:0x0].0x0 since=5512s v=(0 0) 00010000:00010000:3.0:1784191892.769320:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191892.769330:0:162391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c31f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beb9 expref: 27 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.769349:0:162391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c31f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beb9 expref: 27 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.769362:0:162391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd68800, rc 0) 00000100:00100000:3.0:1784191892.769425:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:69112:x1870858812417408:12345-192.168.204.16@tcp:101:cp.0 Request processed in 218us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191892.769432:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 331 00000100:00100000:1.0:1784191892.773821:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.773965:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812417536 00000100:00100000:3.0:1784191892.773975:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812417536 00000100:00100000:3.0:1784191892.774039:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 332 00000100:00100000:3.0:1784191892.774050:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:123690:x1870858812417536:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191892.774070:0:161232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191892.774106:0:161232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adc4f613/0xfeec3c2dc5a4c326 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bec0 expref: -99 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.774140:0:161232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c31f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beb9 expref: 28 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.774165:0:161232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191892.774170:0:161232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191892.774176:0:161232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adc4f613/0xfeec3c2dc5a4c326 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bec0 expref: 28 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.774213:0:161232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c31f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beb9 expref: 28 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.774228:0:161232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c31f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beb9 expref: 28 pid: 162391 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191892.774243:0:161232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:161232:1870858827966592:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191892.774324:0:161232:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cf35a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784191892.777385:0:161232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:161232:1870858827966592:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191892.777422:0:161232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000adc4f613/0xfeec3c2dc5a4c326 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bec0 expref: 28 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.777442:0:161232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd69200, rc 0) 00000100:00100000:3.0:1784191892.777510:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:123690:x1870858812417536:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3462us (3700us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191892.777518:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 332 00000100:00100000:1.0:1784191892.779508:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.779978:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812417664 00000100:00100000:2.0:1784191892.779988:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812417664 00010000:00010000:2.0:1784191892.780029:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c31f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beb9 expref: 28 pid: 162391 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191892.780114:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 172 00000100:00100000:2.0:1784191892.780123:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:69109:x1870858812417664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191892.780137:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191892.780158:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c31f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beb9 expref: 28 pid: 162391 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.780172:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c31f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beb9 expref: 28 pid: 162391 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.780195:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c31f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beb9 expref: 28 pid: 162391 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.780211:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.780216:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.780224:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000adc4f613/0xfeec3c2dc5a4c326 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bec0 expref: 27 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.780233:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adc4f613/0xfeec3c2dc5a4c326 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bec0 expref: 27 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.780266:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000adc4f613/0xfeec3c2dc5a4c326 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bec0 expref: 27 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191892.780297:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827966720:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191892.780376:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af22051aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1784191892.782909:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827966720:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191892.782939:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191892.782993:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:69109:x1870858812417664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2871us (3547us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191892.783005:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 172 00000100:00100000:1.0:1784191892.789434:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.789556:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812417920 00000100:00100000:2.0:1784191892.789568:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812417920 00000100:00100000:2.0:1784191892.789632:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 179 00000100:00100000:2.0:1784191892.789644:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+184:123690:x1870858812417920:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191892.790009:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+185:123690:x1870858812417920:12345-192.168.204.16@tcp:35:cp.0 Request processed in 366us (585us total) trans 34359738738 rc 0/0 00000100:00100000:2.0:1784191892.790017:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 179 00000100:00100000:1.0:1784191892.793579:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.793730:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812418048 00000100:00100000:0.0:1784191892.793748:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812418048 00000100:00100000:0.0:1784191892.793816:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 644 00000100:00100000:0.0:1784191892.793826:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+185:123690:x1870858812418048:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.793875:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.793898:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c32d lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bec7 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.793965:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c334 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.793979:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c334 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.793992:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c334 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794009:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c33b lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794016:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c33b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794023:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c33b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794065:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c334 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794072:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c334 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794078:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c334 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794085:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c334 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794111:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010be400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191892.794116:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c334 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794123:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c334 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794137:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191892.794139:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.794144:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c334 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794150:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c334 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794164:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c33b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794170:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c33b lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794175:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c33b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794180:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010be600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191892.794183:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c33b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794189:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c33b lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794208:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x2fbacb41 (ffff8af214e83700) 00010000:00010000:0.0:1784191892.794211:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.794214:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c33b lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794220:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c33b lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794258:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c32d lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bec7 expref: 186 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794269:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191892.794271:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.794274:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c32d lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bec7 expref: 186 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.794284:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010bee00, rc 0) 00000100:00100000:0.0:1784191892.794345:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+185:123690:x1870858812418048:12345-192.168.204.16@tcp:101:cp.0 Request processed in 520us (776us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191892.794352:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 644 00000100:00100000:1.0:1784191892.797568:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.797652:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812418176 00000100:00100000:0.0:1784191892.797664:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812418176 00000100:00100000:0.0:1784191892.797756:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 645 00000100:00100000:0.0:1784191892.797768:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+185:123690:x1870858812418176:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.797790:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.797812:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bec00/0xfeec3c2dc5a4c342 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bece expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.797899:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c349 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.797912:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c349 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.797923:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c349 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.797936:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c350 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.797942:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c350 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.797947:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c350 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.797989:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c349 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.797997:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c349 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.798004:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c349 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.798010:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c349 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.798016:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010bf200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191892.798027:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c349 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.798034:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c349 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.798046:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191892.798049:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.798053:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c349 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.798061:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c349 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.798075:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c350 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.798081:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c350 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.798086:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c350 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.798103:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010bea00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191892.798106:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c350 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.798112:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c350 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.798120:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x2fbacb41 (ffff8af214e83d00) 00010000:00010000:0.0:1784191892.798122:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.798132:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c350 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.798138:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c350 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.798174:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bec00/0xfeec3c2dc5a4c342 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bece expref: 186 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.798183:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191892.798185:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.798188:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bec00/0xfeec3c2dc5a4c342 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bece expref: 186 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.798196:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010bec00, rc 0) 00000100:00100000:0.0:1784191892.798257:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+185:123690:x1870858812418176:12345-192.168.204.16@tcp:101:cp.0 Request processed in 492us (698us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191892.798264:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 645 00000100:00100000:1.0:1784191892.802125:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.802235:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812418432 00000100:00100000:3.0:1784191892.802246:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812418432 00000100:00100000:3.0:1784191892.802314:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 646 00000100:00100000:3.0:1784191892.802348:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+185:123690:x1870858812418432:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191892.802372:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191892.802395:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69c00/0xfeec3c2dc5a4c357 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bed5 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.802558:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c35e lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.802575:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c35e lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.802586:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c35e lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.802603:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68000/0xfeec3c2dc5a4c365 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.802610:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68000/0xfeec3c2dc5a4c365 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.802616:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68000/0xfeec3c2dc5a4c365 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191892.803010:0:164531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x25b:0x0], index 0: 0 00080000:00000400:3.0:1784191892.803021:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191892.803024:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191892.803026:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191892.803028:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191892.803030:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191892.803032:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191892.803047:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191892.803058:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191892.803060:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191892.803062:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191892.803064:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191892.803066:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191892.803099:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191892.803102:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191892.803104:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191892.803106:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191892.803108:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191892.803110:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191892.803204:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69400/0xfeec3c2dc5a4c36c lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.803215:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69400/0xfeec3c2dc5a4c36c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.803223:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69400/0xfeec3c2dc5a4c36c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.803257:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c35e lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.803265:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c35e lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.803271:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c35e lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.803278:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c35e lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.803284:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd69e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.803295:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c35e lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.803303:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c35e lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.803316:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191892.803320:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.803324:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c35e lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.803331:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c35e lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191892.803345:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fa8cae44 reply state 00000000368a41dc transno 34359738739 ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68000/0xfeec3c2dc5a4c365 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.803356:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68000/0xfeec3c2dc5a4c365 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.803362:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x2fbacb41 (ffff8af2277f6000) 00010000:00010000:3.0:1784191892.803365:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191892.803368:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784191892.803397:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69c00/0xfeec3c2dc5a4c357 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bed5 expref: 188 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.803413:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69400/0xfeec3c2dc5a4c36c lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bed5 expref: 187 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.803420:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x2c:0x0].0x0 (ffff8af2277f6300) 00010000:00010000:3.0:1784191892.803422:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784191892.803431:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd69400, rc 0) 00000100:00100000:3.0:1784191892.803493:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+188:123690:x1870858812418432:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1148us (1382us total) trans 34359738739 rc 0/0 00000100:00100000:3.0:1784191892.803501:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 646 00000100:00100000:1.0:1784191892.812306:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.812420:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812418560 00000100:00100000:2.0:1784191892.812430:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812418560 00000100:00100000:2.0:1784191892.812623:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 333 00000100:00100000:2.0:1784191892.812634:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:69109:x1870858812418560:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.812655:0:162389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.812680:0:162389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c37a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bedc expref: -99 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191892.812763:0:162389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191892.812784:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25b:0x0].0x0 since=5512s v=(0 0) 00010000:00010000:2.0:1784191892.812810:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.812821:0:162389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c37a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bedc expref: 28 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.812841:0:162389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c37a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bedc expref: 28 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.812856:0:162389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cd600, rc 0) 00000100:00100000:2.0:1784191892.812915:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:69109:x1870858812418560:12345-192.168.204.16@tcp:101:cp.0 Request processed in 283us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191892.812922:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 333 00000100:00100000:1.0:1784191892.816183:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.816818:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812418688 00000100:00100000:0.0:1784191892.816830:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812418688 00000100:00100000:0.0:1784191892.816894:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 334 00000100:00100000:0.0:1784191892.816905:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:123690:x1870858812418688:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.816926:0:162395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.816945:0:162395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000307c76b1/0xfeec3c2dc5a4c381 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bee3 expref: -99 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.816982:0:162395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c37a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bedc expref: 29 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.817014:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.817019:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.817025:0:162395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000307c76b1/0xfeec3c2dc5a4c381 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bee3 expref: 29 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.817068:0:162395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c37a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bedc expref: 29 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.817085:0:162395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c37a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bedc expref: 29 pid: 162389 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191892.817270:0:162395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:162395:1870858827966848:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191892.817486:0:162395:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111502c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191892.823567:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.823655:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.823737:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812418816 00000100:00100000:3.0:1784191892.823751:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812418816 00002000:00100000:3.0:1784191892.823822:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x246:0x0] (0->902) req@ffff8af210300380 x1870858812418816/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:63/0 lens 1392/0 e 0 to 0 dl 1784191903 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191892.823836:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af210300380 with x1870858812418816 ext(0->902) 00002000:00010000:3.0:1784191892.823843:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af210300380 00000100:00100000:3.0:1784191892.823874:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2 00000100:00100000:3.0:1784191892.823886:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:69112:x1870858812418816:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:3.0:1784191892.824180:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:3.0:1784191892.824185:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:3.0:1784191892.824187:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:3.0:1784191892.824190:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:3.0:1784191892.824192:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:3.0:1784191892.824194:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191892.825223:0:162395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:162395:1870858827966848:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191892.825262:0:162395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000307c76b1/0xfeec3c2dc5a4c381 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bee3 expref: 30 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.825284:0:162395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010bec00, rc 0) 00000100:00100000:0.0:1784191892.825335:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:123690:x1870858812418688:12345-192.168.204.16@tcp:101:cp.0 Request processed in 8431us (9161us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.825344:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 334 00000100:00100000:0.0:1784191892.825375:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812418944 00000100:00100000:0.0:1784191892.825380:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812418944 00000100:00100000:3.0:1784191892.825424:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.827017:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812419072 00000100:00100000:1.0:1784191892.827030:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812419072 00010000:00010000:1.0:1784191892.827073:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c37a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bedc expref: 31 pid: 162389 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191892.827610:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 173 00000100:00100000:1.0:1784191892.827625:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:69110:x1870858812419072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191892.827641:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191892.827669:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c37a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bedc expref: 31 pid: 162389 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.827730:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c37a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bedc expref: 31 pid: 162389 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.827761:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa34cf88/0xfeec3c2dc5a4c37a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bedc expref: 31 pid: 162389 timeout: 5612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.827782:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25b:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1784191892.827788:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191892.827797:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000307c76b1/0xfeec3c2dc5a4c381 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bee3 expref: 30 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.827807:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000307c76b1/0xfeec3c2dc5a4c381 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bee3 expref: 30 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.827848:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000307c76b1/0xfeec3c2dc5a4c381 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bee3 expref: 30 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191892.827863:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc65f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827966976:192.168.204.16@tcp:105: 00000100:00100000:1.0:1784191892.827961:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e69e480 going to sleep for 11 seconds 00000100:00100000:2.0:1784191892.828704:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 335 00000100:00100000:2.0:1784191892.828729:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:69112:x1870858812418944:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:2.0:1784191892.828852:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:69112:x1870858812418944:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 137us (5296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191892.828861:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 335 00000001:00080000:1.0:1784191892.830804:0:160160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836548 is committed 00000001:00100000:1.0:1784191892.830830:0:160160:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000100:00100000:1.0:1784191892.835015:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc65f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827966976:192.168.204.16@tcp:105: 00010000:00010000:1.0:1784191892.835049:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191892.835143:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:69110:x1870858812419072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7522us (9717us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191892.835155:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 173 00000100:00100000:3.0:1784191892.837038:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.837135:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.837161:0:160169:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1784191892.837171:0:160169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1784191892.837299:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812419200 00000100:00100000:3.0:1784191892.837308:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812419200 00002000:00100000:3.0:1784191892.837357:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1c3:0x0] (0->5633) req@ffff8af210300700 x1870858812419200/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:63/0 lens 6128/0 e 0 to 0 dl 1784191903 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191892.837382:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af210300700 with x1870858812419200 ext(0->5633) 00002000:00010000:3.0:1784191892.837388:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af210300700 00000100:00100000:3.0:1784191892.837864:0:166438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3 00000100:00100000:3.0:1784191892.837874:0:166438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:69109:x1870858812419200:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:3.0:1784191892.838141:0:166438:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:3.0:1784191892.838146:0:166438:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:3.0:1784191892.838148:0:166438:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:3.0:1784191892.838150:0:166438:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:3.0:1784191892.838152:0:166438:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:3.0:1784191892.838154:0:166438:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:1.0:1784191892.839125:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812419328 00000100:00100000:1.0:1784191892.839135:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812419328 00000100:00100000:1.0:1784191892.839186:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 336 00000100:00100000:1.0:1784191892.839194:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:69111:x1870858812419328:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:1.0:1784191892.839312:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:69111:x1870858812419328:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 118us (2284us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191892.839320:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 336 00000001:00080000:0.0:1784191892.842026:0:160977:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869239 is committed 00000001:00100000:0.0:1784191892.842069:0:160977:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000100:00100000:2.0:1784191892.843339:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:69112:x1870858812418816:12345-192.168.204.16@tcp:4:cp.0 Request processed in 19445us (19674us total) trans 21474836549 rc 0/0 00000100:00100000:2.0:1784191892.843353:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2 00002000:00100000:2.0:1784191892.843367:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x246:0x0] (0->902) req@ffff8af210300380 x1870858812418816/t21474836549(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:63/0 lens 1392/448 e 0 to 0 dl 1784191903 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191892.843378:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af210300380 with x1870858812418816 ext(0->902) 00002000:00010000:2.0:1784191892.843385:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af210300380 00000100:00100000:0.0:1784191892.844956:0:166438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:69109:x1870858812419200:12345-192.168.204.16@tcp:4:cp.0 Request processed in 7066us (7804us total) trans 17179869240 rc 0/0 00000100:00100000:0.0:1784191892.844972:0:166438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3 00002000:00100000:0.0:1784191892.844984:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1c3:0x0] (0->5633) req@ffff8af210300700 x1870858812419200/t17179869240(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:63/0 lens 6128/448 e 0 to 0 dl 1784191903 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191892.844995:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af210300700 with x1870858812419200 ext(0->5633) 00002000:00010000:0.0:1784191892.845001:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af210300700 00000100:00100000:0.0:1784191892.847424:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.847476:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.847505:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.847603:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812419840 00000100:00100000:1.0:1784191892.847613:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812419840 00000100:00100000:1.0:1784191892.847667:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 337 00000100:00100000:1.0:1784191892.847677:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:69109:x1870858812419840:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:1.0:1784191892.847812:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:69109:x1870858812419840:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 137us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191892.847820:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 337 00000100:00100000:3.0:1784191892.847890:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812419712 00000100:00100000:3.0:1784191892.847894:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812419712 00002000:00100000:3.0:1784191892.847918:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x247:0x0] (0->391199) req@ffff8af22dc81f80 x1870858812419712/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:63/0 lens 488/0 e 0 to 0 dl 1784191903 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191892.847929:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af22dc81f80 with x1870858812419712 ext(0->391199) 00002000:00010000:3.0:1784191892.847935:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af22dc81f80 00000100:00100000:3.0:1784191892.847948:0:160169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4 00000100:00100000:3.0:1784191892.847953:0:160169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:69111:x1870858812419712:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:2.0:1784191892.849116:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812419584 00000100:00100000:2.0:1784191892.849126:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812419584 00000100:00100000:2.0:1784191892.849184:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 180 00000100:00100000:2.0:1784191892.849193:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105325050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+188:123690:x1870858812419584:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191892.849561:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105325050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+189:123690:x1870858812419584:12345-192.168.204.16@tcp:35:cp.0 Request processed in 368us (2145us total) trans 34359738740 rc 0/0 00000100:00100000:2.0:1784191892.849568:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 180 00000100:00100000:3.0:1784191892.853401:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.853624:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812419968 00000100:00100000:2.0:1784191892.853637:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812419968 00000100:00100000:2.0:1784191892.853754:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 647 00000100:00100000:2.0:1784191892.853766:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+189:123690:x1870858812419968:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.853795:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.853937:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c388 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8beea expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854013:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c38f lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854027:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c38f lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854041:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c38f lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854057:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c396 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854063:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c396 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854069:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c396 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854128:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c38f lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854135:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c38f lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854141:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c38f lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854148:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c38f lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854154:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cc800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.854158:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c38f lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854166:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c38f lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854178:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.854181:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.854186:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c38f lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854192:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c38f lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854207:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c396 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854213:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c396 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854226:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c396 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854231:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2ccc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.854233:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c396 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854239:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c396 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854246:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xff118af2 (ffff8af2382d2700) 00010000:00010000:2.0:1784191892.854249:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.854251:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c396 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854257:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c396 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854292:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c388 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beea expref: 190 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854303:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.854306:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.854309:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c388 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beea expref: 190 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.854319:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cc400, rc 0) 00000100:00100000:2.0:1784191892.854380:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+189:123690:x1870858812419968:12345-192.168.204.16@tcp:101:cp.0 Request processed in 615us (989us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191892.854396:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 647 00080000:00000400:1.0:1784191892.865008:0:160169:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:1.0:1784191892.865019:0:160169:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:1.0:1784191892.865021:0:160169:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:1.0:1784191892.865024:0:160169:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:1.0:1784191892.865026:0:160169:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:1.0:1784191892.865028:0:160169:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:1.0:1784191892.867084:0:160169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:69111:x1870858812419712:12345-192.168.204.16@tcp:4:cp.0 Request processed in 19116us (19594us total) trans 21474836550 rc 0/0 00000100:00100000:1.0:1784191892.867099:0:160169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4 00002000:00100000:1.0:1784191892.867113:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x247:0x0] (0->391199) req@ffff8af22dc81f80 x1870858812419712/t21474836550(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:63/0 lens 488/448 e 0 to 0 dl 1784191903 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191892.867142:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af22dc81f80 with x1870858812419712 ext(0->391199) 00002000:00010000:1.0:1784191892.867149:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af22dc81f80 00000001:00080000:1.0:1784191892.867448:0:158645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738740 is committed 00000001:00080000:1.0:1784191892.867632:0:158645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738649 is committed 00010000:00010000:3.0:1784191892.867842:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b312 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.867855:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b312 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.867863:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b312 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.867879:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.867884:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b312 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.867892:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b312 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.867909:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4632c348 (ffff8af23d0d5b00) 00010000:00010000:3.0:1784191892.867912:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.867917:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b312 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.867924:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4b312 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4632c348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.867945:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b319 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.867951:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b319 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.867957:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b319 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.867962:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.867964:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b319 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.867969:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b319 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.867989:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191892.867992:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.867995:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b319 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868001:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4b319 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868019:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4b44d lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868025:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4b44d lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868031:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4b44d lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868035:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af242073800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.868039:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4b44d lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868044:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4b44d lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868051:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x45c0cf9c (ffff8af210dfe200) 00010000:00010000:3.0:1784191892.868053:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.868056:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4b44d lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868061:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4b44d lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868089:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b4cb lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868096:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b4cb lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868101:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b4cb lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868107:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.868110:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b4cb lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868117:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b4cb lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868127:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x56569231 (ffff8af207498600) 00010000:00010000:3.0:1784191892.868130:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.868134:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b4cb lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868140:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4b4cb lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868158:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b52d lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868165:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b52d lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868171:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b52d lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868184:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7fc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.868188:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b52d lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868195:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b52d lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868204:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xa6e7eec (ffff8af207498800) 00010000:00010000:3.0:1784191892.868207:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.868210:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b52d lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868216:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4b52d lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868235:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b588 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868241:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b588 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868248:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b588 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868253:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341aa00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.868256:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b588 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868263:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b588 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868282:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe6b34bd0 (ffff8af210dfee00) 00010000:00010000:3.0:1784191892.868284:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.868287:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b588 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868293:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4b588 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868314:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4b5e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868321:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4b5e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868327:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4b5e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868331:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.868333:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4b5e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868339:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4b5e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868346:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9ca112ae (ffff8af20db3d800) 00010000:00010000:3.0:1784191892.868348:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.868351:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4b5e3 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868357:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4b5e3 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868383:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b63e lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868390:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b63e lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868396:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b63e lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868401:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341a400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.868404:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b63e lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868410:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b63e lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868419:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9fe9a331 (ffff8af203904400) 00010000:00010000:3.0:1784191892.868421:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.868425:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b63e lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868431:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4b63e lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868448:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532200/0xfeec3c2dc5a4b699 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868471:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532200/0xfeec3c2dc5a4b699 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868478:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532200/0xfeec3c2dc5a4b699 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868490:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d532200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.868494:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532200/0xfeec3c2dc5a4b699 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868500:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532200/0xfeec3c2dc5a4b699 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868509:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x151c8ac3 (ffff8af203904700) 00010000:00010000:3.0:1784191892.868512:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.868514:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532200/0xfeec3c2dc5a4b699 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868520:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d532200/0xfeec3c2dc5a4b699 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868551:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4b6f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868557:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4b6f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868563:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4b6f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868568:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.868571:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4b6f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868577:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4b6f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868595:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x15c8a56e (ffff8af203904300) 00010000:00010000:3.0:1784191892.868597:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.868600:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4b6f4 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868605:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4b6f4 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868622:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4b74f lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868628:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4b74f lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868633:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4b74f lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868638:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.868640:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4b74f lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868646:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4b74f lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868654:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe7eb4718 (ffff8af203904900) 00010000:00010000:3.0:1784191892.868655:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.868658:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4b74f lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868662:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4b74f lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868763:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4b7aa lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868771:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4b7aa lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868777:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4b7aa lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868782:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.868785:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4b7aa lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868791:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4b7aa lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868798:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x48840fb6 (ffff8af20db3d300) 00010000:00010000:3.0:1784191892.868800:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.868803:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4b7aa lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868809:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4b7aa lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868825:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4b805 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868831:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4b805 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868836:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4b805 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868847:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af110db2e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.868850:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4b805 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868856:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4b805 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868864:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x48e4a31f (ffff8af110071f00) 00010000:00010000:3.0:1784191892.868867:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.868871:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4b805 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868877:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4b805 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868895:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4b860 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868900:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4b860 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868906:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4b860 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868910:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.868912:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4b860 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868917:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4b860 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868935:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xbf79d746 (ffff8af202c46400) 00010000:00010000:3.0:1784191892.868937:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.868941:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4b860 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868947:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4b860 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868960:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4b8bb lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868965:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4b8bb lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868970:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4b8bb lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868975:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.868978:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4b8bb lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868983:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4b8bb lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868989:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xb34b709f (ffff8af202c46900) 00010000:00010000:3.0:1784191892.868991:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.868993:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4b8bb lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.868998:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4b8bb lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869019:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b916 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869025:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b916 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869030:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b916 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869034:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.869037:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b916 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869042:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b916 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869049:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9b815f19 (ffff8af202c46e00) 00010000:00010000:3.0:1784191892.869052:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.869054:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b916 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869060:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4b916 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869071:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b971 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869077:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b971 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869083:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b971 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869096:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.869098:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b971 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869104:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b971 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869113:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe9fa0db8 (ffff8af202c46c00) 00010000:00010000:3.0:1784191892.869115:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.869117:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b971 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869122:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4b971 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869138:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b9cc lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869143:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b9cc lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869149:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b9cc lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869153:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.869156:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b9cc lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869162:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b9cc lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869180:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xc025ca7 (ffff8af207498200) 00010000:00010000:3.0:1784191892.869183:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.869186:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b9cc lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869192:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4b9cc lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869210:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4ba27 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869215:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4ba27 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869221:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4ba27 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869225:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d6600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.869228:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4ba27 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869234:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4ba27 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869242:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xecc4f14 (ffff8af219b92600) 00010000:00010000:3.0:1784191892.869244:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.869247:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4ba27 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869253:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4ba27 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869276:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ba82 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869284:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ba82 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869290:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ba82 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869295:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341a200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.869297:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ba82 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869303:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ba82 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869311:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x712be7d1 (ffff8af207499f00) 00010000:00010000:3.0:1784191892.869313:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.869316:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ba82 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869322:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ba82 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869338:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4badd lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869345:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4badd lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869350:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4badd lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869363:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874b200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.869367:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4badd lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869374:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4badd lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869383:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x4ee593e6 (ffff8af207499a00) 00010000:00010000:3.0:1784191892.869385:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.869388:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4badd lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869395:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4badd lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869413:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4bb38 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869420:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4bb38 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869427:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4bb38 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869433:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.869436:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4bb38 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869443:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4bb38 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869462:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xf0a46efb (ffff8af219b92b00) 00010000:00010000:3.0:1784191892.869465:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.869468:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4bb38 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869474:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4bb38 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869490:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4bb93 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869496:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4bb93 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869502:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4bb93 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869507:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ec00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.869510:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4bb93 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869516:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4bb93 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869525:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x267dbf88 (ffff8af219b92300) 00010000:00010000:3.0:1784191892.869527:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.869530:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4bb93 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869552:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4bb93 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869577:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbee lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869583:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbee lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869590:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbee lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869596:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.869599:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbee lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869605:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbee lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869613:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xd946e4d2 (ffff8af2331f1d00) 00010000:00010000:3.0:1784191892.869616:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.869619:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbee lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869625:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4bbee lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869639:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4bc49 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869646:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4bc49 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869652:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4bc49 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869664:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ea00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.869667:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4bc49 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869673:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4bc49 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869681:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x7584afcd (ffff8af210e98000) 00010000:00010000:3.0:1784191892.869684:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.869739:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4bc49 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869746:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4bc49 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869763:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4bca4 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869770:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4bca4 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869776:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4bca4 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869782:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3ec00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.869785:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4bca4 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869792:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4bca4 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869811:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xf4c8ca43 (ffff8af110071c00) 00010000:00010000:3.0:1784191892.869813:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.869816:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4bca4 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869822:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4bca4 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869837:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bcff lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869844:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bcff lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869850:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bcff lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869855:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d6200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.869858:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bcff lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869865:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bcff lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869873:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x130bf32a (ffff8af210e98900) 00010000:00010000:3.0:1784191892.869875:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.869878:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bcff lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869884:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4bcff lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869907:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4bd5a lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869914:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4bd5a lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869920:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4bd5a lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869926:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.869930:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4bd5a lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869936:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4bd5a lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869945:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe00215d9 (ffff8af2112b6600) 00010000:00010000:3.0:1784191892.869948:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.869951:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4bd5a lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869957:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4bd5a lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869970:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bdb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869976:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bdb5 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869982:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bdb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.869994:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3fa00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.869998:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bdb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870005:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bdb5 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870013:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x868dff87 (ffff8af2112b6d00) 00010000:00010000:3.0:1784191892.870016:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.870019:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bdb5 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870025:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4bdb5 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870042:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4be10 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870048:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4be10 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870055:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4be10 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870060:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.870062:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4be10 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870069:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4be10 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870088:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x39c3d8fe (ffff8af2331f1300) 00010000:00010000:3.0:1784191892.870090:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.870094:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4be10 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870100:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4400/0xfeec3c2dc5a4be10 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870116:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4be6b lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870122:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4be6b lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870128:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4be6b lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870134:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874a200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.870136:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4be6b lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870142:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4be6b lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870150:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x5b30f298 (ffff8af207499600) 00010000:00010000:3.0:1784191892.870152:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.870155:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4be6b lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870161:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4be6b lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870186:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4bec6 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870193:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4bec6 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870199:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4bec6 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870204:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cde00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.870207:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4bec6 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870213:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4bec6 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870222:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x2893e4db (ffff8af2382d2a00) 00010000:00010000:3.0:1784191892.870224:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.870227:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4bec6 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870233:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4bec6 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870247:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bf21 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870253:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bf21 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870259:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bf21 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870271:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cd800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.870274:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bf21 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870281:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bf21 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870289:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x49aa722d (ffff8af2382d2200) 00010000:00010000:3.0:1784191892.870291:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.870294:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bf21 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870300:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4bf21 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870315:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf7c lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870320:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf7c lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870325:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf7c lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870329:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.870332:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf7c lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870337:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf7c lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870353:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x4c7a76ee (ffff8af2331f1400) 00010000:00010000:3.0:1784191892.870355:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.870358:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf7c lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870364:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4bf7c lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870380:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfd7 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870386:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfd7 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870392:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfd7 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870397:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874b000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.870400:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfd7 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870405:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfd7 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870413:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x610aa076 (ffff8af233110800) 00010000:00010000:3.0:1784191892.870415:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.870418:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfd7 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870423:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4bfd7 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870446:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c032 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870453:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c032 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870459:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c032 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870465:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874a800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.870468:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c032 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870474:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c032 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870482:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x72a71b3d (ffff8af233110200) 00010000:00010000:3.0:1784191892.870484:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.870486:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c032 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870491:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c032 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870505:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c08d lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870511:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c08d lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870517:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c08d lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870528:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.870532:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c08d lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870553:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c08d lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870562:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xa9dd9870 (ffff8af2331f1700) 00010000:00010000:3.0:1784191892.870565:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.870568:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c08d lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870574:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c08d lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870591:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c0e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870596:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c0e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870601:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c0e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870605:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cc200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.870608:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c0e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870613:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c0e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870631:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x839e9634 (ffff8af2382d2d00) 00010000:00010000:3.0:1784191892.870633:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.870636:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c0e8 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870641:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c0e8 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870657:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c143 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870663:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c143 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870668:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c143 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870673:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cd200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.870675:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c143 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870681:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c143 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870725:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9e90f16b (ffff8af2382d2300) 00010000:00010000:3.0:1784191892.870728:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.870731:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c143 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870737:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c143 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870763:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c19e lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870769:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c19e lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870774:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c19e lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870779:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200031a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.870782:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c19e lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870787:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c19e lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870795:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x10fe8da8 (ffff8af2331f1c00) 00010000:00010000:3.0:1784191892.870797:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.870800:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c19e lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870805:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c19e lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870819:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c1f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870825:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c1f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870831:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c1f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870842:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010bf600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.870846:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c1f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870852:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c1f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870860:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x6b7bd7c (ffff8af233110400) 00010000:00010000:3.0:1784191892.870862:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.870865:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c1f9 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870872:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c1f9 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870889:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030a00/0xfeec3c2dc5a4c254 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870895:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030a00/0xfeec3c2dc5a4c254 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870900:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030a00/0xfeec3c2dc5a4c254 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870906:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.870908:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030a00/0xfeec3c2dc5a4c254 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870914:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030a00/0xfeec3c2dc5a4c254 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870932:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x37dcc2d3 (ffff8af2331f1000) 00010000:00010000:3.0:1784191892.870934:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.870937:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030a00/0xfeec3c2dc5a4c254 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870942:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030a00/0xfeec3c2dc5a4c254 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870956:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4c2af lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870962:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4c2af lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870967:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4c2af lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870971:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010be000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.870974:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4c2af lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870979:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4c2af lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.870986:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xa4bfea24 (ffff8af233110000) 00010000:00010000:3.0:1784191892.870988:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.870991:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4c2af lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.871002:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4c2af lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.871024:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4c30a lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.871030:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4c30a lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.871036:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4c30a lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.871040:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.871043:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4c30a lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.871048:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4c30a lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.871055:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xc2bba7e5 (ffff8af2382d2b00) 00010000:00010000:3.0:1784191892.871057:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.871059:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4c30a lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.871064:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4c30a lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.871076:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68000/0xfeec3c2dc5a4c365 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.871081:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68000/0xfeec3c2dc5a4c365 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.871086:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68000/0xfeec3c2dc5a4c365 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.871096:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.871099:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68000/0xfeec3c2dc5a4c365 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.871105:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68000/0xfeec3c2dc5a4c365 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.871112:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x2fbacb41 (ffff8af2277f6000) 00010000:00010000:3.0:1784191892.871114:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.871116:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68000/0xfeec3c2dc5a4c365 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.871121:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68000/0xfeec3c2dc5a4c365 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191892.875076:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.875235:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.875717:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812420096 00000100:00100000:2.0:1784191892.875728:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812420096 00002000:00100000:2.0:1784191892.875784:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1c4:0x0] (0->1734) req@ffff8af10d29dc00 x1870858812420096/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:63/0 lens 2224/0 e 0 to 0 dl 1784191903 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191892.875796:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10d29dc00 with x1870858812420096 ext(0->1734) 00002000:00010000:2.0:1784191892.875801:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af10d29dc00 00000100:00100000:2.0:1784191892.875830:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5 00000100:00100000:2.0:1784191892.875839:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:69109:x1870858812420096:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:2.0:1784191892.876074:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:2.0:1784191892.876079:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191892.876081:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:2.0:1784191892.876083:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191892.876085:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191892.876087:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191892.876871:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:69109:x1870858812420096:12345-192.168.204.16@tcp:4:cp.0 Request processed in 1027us (1631us total) trans 17179869241 rc 0/0 00000100:00100000:2.0:1784191892.876882:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5 00002000:00100000:2.0:1784191892.876890:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1c4:0x0] (0->1734) req@ffff8af10d29dc00 x1870858812420096/t17179869241(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:63/0 lens 2224/448 e 0 to 0 dl 1784191903 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191892.876899:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10d29dc00 with x1870858812420096 ext(0->1734) 00002000:00010000:2.0:1784191892.876904:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af10d29dc00 00000100:00100000:3.0:1784191892.877124:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.877419:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812420352 00000100:00100000:2.0:1784191892.877427:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812420352 00000100:00100000:2.0:1784191892.878562:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 648 00000100:00100000:2.0:1784191892.878583:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+54:123690:x1870858812420352:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.878630:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.878654:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c39d lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bef1 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.878862:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3a4 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.878878:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3a4 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.878889:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3a4 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.878905:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c3ab lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.878913:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c3ab lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.878919:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c3ab lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.878964:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3a4 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.878972:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3a4 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.878978:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3a4 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.878985:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3a4 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.878999:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cc800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.879004:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3a4 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.879012:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3a4 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.879025:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.879028:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.879033:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3a4 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.879040:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3a4 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.879055:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c3ab lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.879061:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c3ab lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.879067:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c3ab lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.879072:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cda00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.879075:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c3ab lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.879081:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c3ab lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.879100:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xff118af2 (ffff8af2382d2700) 00010000:00010000:2.0:1784191892.879103:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.879105:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c3ab lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.879111:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c3ab lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.879149:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c39d lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bef1 expref: 55 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.879159:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.879161:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.879165:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c39d lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bef1 expref: 55 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.879173:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2ccc00, rc 0) 00000100:00100000:2.0:1784191892.879243:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+54:123690:x1870858812420352:12345-192.168.204.16@tcp:101:cp.0 Request processed in 669us (2120us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191892.879250:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 648 00000100:00100000:3.0:1784191892.882913:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.883532:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812420224 00000100:00100000:1.0:1784191892.883553:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812420224 00000100:00100000:0.0:1784191892.883672:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812420608 00000100:00100000:0.0:1784191892.883677:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812420608 00000100:00100000:0.0:1784191892.883754:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 649 00000100:00100000:0.0:1784191892.883766:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+54:123690:x1870858812420608:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.883789:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.883821:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c3b2 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bef8 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.883936:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf400/0xfeec3c2dc5a4c3b9 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.883953:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf400/0xfeec3c2dc5a4c3b9 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.883966:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf400/0xfeec3c2dc5a4c3b9 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.884002:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be800/0xfeec3c2dc5a4c3c0 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.884009:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be800/0xfeec3c2dc5a4c3c0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.884016:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be800/0xfeec3c2dc5a4c3c0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191892.884382:0:158665:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1d8:0x0], index 1: 0 00080000:00000400:0.0:1784191892.884395:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 252 < left 278, rollback = 2 00080000:00000400:0.0:1784191892.884398:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:0.0:1784191892.884401:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191892.884403:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 1/3/2 00080000:00000400:0.0:1784191892.884405:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/1, delete: 0/0/0 00080000:00000400:0.0:1784191892.884407:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191892.884423:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 252 < left 278, rollback = 2 00080000:00000400:0.0:1784191892.884426:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:0.0:1784191892.884428:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191892.884430:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 1/3/2 00080000:00000400:0.0:1784191892.884431:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/1, delete: 0/0/0 00080000:00000400:0.0:1784191892.884433:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191892.884465:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 250 < left 278, rollback = 2 00080000:00000400:0.0:1784191892.884468:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:0.0:1784191892.884469:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191892.884472:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/1, punch: 0/0/0, quota 1/3/2 00080000:00000400:0.0:1784191892.884473:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/3, delete: 0/0/0 00080000:00000400:0.0:1784191892.884475:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191892.884583:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf800/0xfeec3c2dc5a4c3c7 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.884606:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf800/0xfeec3c2dc5a4c3c7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.884614:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf800/0xfeec3c2dc5a4c3c7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.884652:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf400/0xfeec3c2dc5a4c3b9 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.884660:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf400/0xfeec3c2dc5a4c3b9 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.884666:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf400/0xfeec3c2dc5a4c3b9 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.884672:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf400/0xfeec3c2dc5a4c3b9 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.884678:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010bf400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191892.884683:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf400/0xfeec3c2dc5a4c3b9 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.884725:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf400/0xfeec3c2dc5a4c3b9 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.884739:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191892.884742:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191892.884747:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf400/0xfeec3c2dc5a4c3b9 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.884753:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf400/0xfeec3c2dc5a4c3b9 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191892.884775:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c97f7e17 reply state 00000000d039eca2 transno 34359738741 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be800/0xfeec3c2dc5a4c3c0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.884787:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be800/0xfeec3c2dc5a4c3c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.884793:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xff118af2 (ffff8af214e83d00) 00010000:00010000:0.0:1784191892.884796:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191892.884799:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191892.884831:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be400/0xfeec3c2dc5a4c3b2 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bef8 expref: 57 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.884847:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf800/0xfeec3c2dc5a4c3c7 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bef8 expref: 56 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.884854:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x2d:0x0].0x0 (ffff8af214e83700) 00010000:00010000:0.0:1784191892.884856:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191892.884858:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010bf800, rc 0) 00000100:00100000:2.0:1784191892.884892:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 338 00000100:00100000:2.0:1784191892.884900:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:69112:x1870858812420224:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:0.0:1784191892.884926:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+57:123690:x1870858812420608:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1163us (2028us total) trans 34359738741 rc 0/0 00000100:00100000:0.0:1784191892.884933:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 649 00000100:00100000:1.0:1784191892.889600:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.889921:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812420736 00000100:00100000:3.0:1784191892.889936:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812420736 00000100:00100000:3.0:1784191892.890008:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 339 00000100:00100000:3.0:1784191892.890020:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:69112:x1870858812420736:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191892.890042:0:162391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191892.890066:0:162391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4c3d5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8beff expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191892.890092:0:162391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784191892.890126:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d8:0x0].0x0 since=5513s v=(0 0) 00010000:00010000:3.0:1784191892.890131:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191892.890142:0:162391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4c3d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beff expref: 32 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.890163:0:162391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4c3d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beff expref: 32 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.890176:0:162391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd68000, rc 0) 00000100:00100000:3.0:1784191892.890243:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:69112:x1870858812420736:12345-192.168.204.16@tcp:101:cp.0 Request processed in 226us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191892.890251:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 339 00000001:00080000:0.0:1784191892.896772:0:160977:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869241 is committed 00000100:00100000:3.0:1784191892.896980:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:69112:x1870858812420224:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 12074us (21908us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191892.896993:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 338 00000100:00100000:1.0:1784191892.904678:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.904805:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812420864 00000100:00100000:0.0:1784191892.904816:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812420864 00000100:00100000:0.0:1784191892.904871:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 340 00000100:00100000:0.0:1784191892.904882:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:123690:x1870858812420864:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.904903:0:162392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.904940:0:162392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9e67abe/0xfeec3c2dc5a4c3dc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf06 expref: -99 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.904973:0:162392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4c3d5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beff expref: 28 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.904983:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.904987:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.904993:0:162392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e67abe/0xfeec3c2dc5a4c3dc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf06 expref: 28 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.905030:0:162392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4c3d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beff expref: 28 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.905047:0:162392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4c3d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beff expref: 28 pid: 162391 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191892.905061:0:162392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:162392:1870858827967104:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191892.905144:0:162392:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af203b79180 going to sleep for 11 seconds 00000100:00100000:1.0:1784191892.907819:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.907946:0:162392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:162392:1870858827967104:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191892.907984:0:162392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9e67abe/0xfeec3c2dc5a4c3dc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf06 expref: 28 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.908007:0:162392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010be400, rc 0) 00000100:00100000:0.0:1784191892.908072:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:123690:x1870858812420864:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3192us (3404us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.908102:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 340 00000100:00100000:2.0:1784191892.908244:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812420992 00000100:00100000:2.0:1784191892.908251:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812420992 00010000:00010000:2.0:1784191892.908282:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4c3d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beff expref: 28 pid: 162391 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191892.908332:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 174 00000100:00100000:2.0:1784191892.908340:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23b101450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:69109:x1870858812420992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191892.908353:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191892.908377:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4c3d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beff expref: 28 pid: 162391 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.908391:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4c3d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beff expref: 28 pid: 162391 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.908415:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4c3d5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beff expref: 28 pid: 162391 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.908429:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.908433:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.908441:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9e67abe/0xfeec3c2dc5a4c3dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf06 expref: 27 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.908451:0:158650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e67abe/0xfeec3c2dc5a4c3dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf06 expref: 27 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.908487:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f9e67abe/0xfeec3c2dc5a4c3dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf06 expref: 27 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191892.908502:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:158650:1870858827967232:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191892.908586:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af106955b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784191892.914353:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:158650:1870858827967232:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191892.914381:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191892.914444:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23b101450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:69109:x1870858812420992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6103us (6641us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191892.914455:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 174 00000100:00100000:3.0:1784191892.915154:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.915586:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812421248 00000100:00100000:2.0:1784191892.915595:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812421248 00000100:00100000:2.0:1784191892.915637:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 181 00000100:00100000:2.0:1784191892.915645:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+57:123690:x1870858812421248:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191892.915966:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+58:123690:x1870858812421248:12345-192.168.204.16@tcp:35:cp.0 Request processed in 321us (816us total) trans 34359738742 rc 0/0 00000100:00100000:2.0:1784191892.915974:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 181 00000100:00100000:3.0:1784191892.919596:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.919721:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.919865:0:160171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812421376 00000100:00100000:0.0:1784191892.919877:0:160171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812421376 00002000:00100000:0.0:1784191892.919932:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x248:0x0] (0->9973) req@ffff8af10d29e680 x1870858812421376/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:63/0 lens 10464/0 e 0 to 0 dl 1784191903 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191892.919944:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10d29e680 with x1870858812421376 ext(0->9973) 00002000:00010000:0.0:1784191892.919950:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10d29e680 00000100:00100000:0.0:1784191892.919984:0:160171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6 00000100:00100000:0.0:1784191892.919994:0:160171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:69109:x1870858812421376:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:0.0:1784191892.920243:0:160171:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191892.920248:0:160171:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191892.920250:0:160171:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191892.920252:0:160171:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191892.920255:0:160171:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191892.920257:0:160171:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191892.921033:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812421504 00000100:00100000:2.0:1784191892.921040:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812421504 00000100:00100000:2.0:1784191892.921078:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 341 00000100:00100000:2.0:1784191892.921086:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+34:69111:x1870858812421504:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:1.0:1784191892.922287:0:160171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+34:69109:x1870858812421376:12345-192.168.204.16@tcp:4:cp.0 Request processed in 2287us (2591us total) trans 21474836551 rc 0/0 00000100:00100000:1.0:1784191892.922298:0:160171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6 00002000:00100000:1.0:1784191892.922311:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x248:0x0] (0->9973) req@ffff8af10d29e680 x1870858812421376/t21474836551(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:63/0 lens 10464/448 e 0 to 0 dl 1784191903 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191892.922321:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10d29e680 with x1870858812421376 ext(0->9973) 00002000:00010000:1.0:1784191892.922327:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10d29e680 00000001:00080000:1.0:1784191892.924315:0:160160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836551 is committed 00000100:00100000:2.0:1784191892.924659:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:69111:x1870858812421504:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 3567us (5069us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191892.924670:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 341 00000100:00100000:3.0:1784191892.926876:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.928004:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812421632 00000100:00100000:2.0:1784191892.928018:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812421632 00000100:00100000:2.0:1784191892.928101:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 650 00000100:00100000:2.0:1784191892.928113:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+58:123690:x1870858812421632:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.928143:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.928182:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c3e3 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf0d expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928253:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3ea lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928267:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3ea lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928279:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3ea lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928297:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c3f1 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928304:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c3f1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928312:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c3f1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928357:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3ea lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928365:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3ea lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928372:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3ea lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928378:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3ea lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928395:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cc800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.928399:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3ea lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928406:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3ea lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928417:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.928420:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.928424:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3ea lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928430:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c3ea lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928445:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c3f1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928450:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c3f1 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928529:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c3f1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928544:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2ccc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.928547:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c3f1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928553:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c3f1 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928573:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xb2d5a33e (ffff8af216636000) 00010000:00010000:2.0:1784191892.928575:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.928578:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c3f1 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928584:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c3f1 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928619:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c3e3 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf0d expref: 59 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928629:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.928632:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.928634:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c3e3 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf0d expref: 59 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.928646:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cda00, rc 0) 00000100:00100000:2.0:1784191892.928974:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+58:123690:x1870858812421632:12345-192.168.204.16@tcp:101:cp.0 Request processed in 862us (2106us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191892.928983:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 650 00000100:00100000:3.0:1784191892.931560:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.931874:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812421760 00000100:00100000:1.0:1784191892.931887:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812421760 00000100:00100000:1.0:1784191892.931946:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 651 00000100:00100000:1.0:1784191892.931957:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+58:123690:x1870858812421760:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191892.931981:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191892.932003:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c3f8 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf14 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932113:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c3ff lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932129:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c3ff lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932142:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c3ff lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932158:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c406 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932165:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c406 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932171:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c406 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932221:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c3ff lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932227:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c3ff lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932234:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c3ff lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932242:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c3ff lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932249:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.932260:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c3ff lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932267:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c3ff lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932279:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.932282:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.932287:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c3ff lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932294:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c3ff lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932307:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c406 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932313:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c406 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932319:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c406 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932323:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191892.932326:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c406 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932332:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c406 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932339:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xb2d5a33e (ffff8af20dabcf00) 00010000:00010000:1.0:1784191892.932341:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.932350:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c406 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932356:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c406 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932391:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c3f8 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf14 expref: 59 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932402:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191892.932404:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191892.932407:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c3f8 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf14 expref: 59 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.932418:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200031600, rc 0) 00000100:00100000:1.0:1784191892.932488:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+58:123690:x1870858812421760:12345-192.168.204.16@tcp:101:cp.0 Request processed in 533us (938us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191892.932496:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 651 00000100:00100000:1.0:1784191892.936419:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.936683:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812422016 00000100:00100000:2.0:1784191892.936725:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812422016 00000100:00100000:2.0:1784191892.936796:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 652 00000100:00100000:2.0:1784191892.936807:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+58:123690:x1870858812422016:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.936831:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.936853:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c40d lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf1b expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.936996:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c414 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.937011:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c414 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.937023:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c414 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.937039:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c41b lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.937046:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c41b lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.937053:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c41b lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191892.938038:0:158665:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x25c:0x0], index 0: 0 00080000:00000400:2.0:1784191892.938058:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191892.938063:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191892.938066:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191892.938068:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191892.938070:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191892.938072:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191892.938234:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191892.938237:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191892.938239:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191892.938241:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191892.938243:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191892.938259:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191892.938299:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191892.938302:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191892.938304:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191892.938306:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191892.938308:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191892.938311:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191892.938439:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c422 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.938469:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c422 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.938482:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c422 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.938523:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c414 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.938531:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c414 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.938551:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c414 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.938558:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c414 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.938565:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2ccc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.938569:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c414 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.938577:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c414 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.938599:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.938602:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.938607:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c414 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.938614:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c414 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191892.938630:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000029e05af reply state 000000008b53fcfc transno 34359738743 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c41b lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.938642:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c41b lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.938649:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xb2d5a33e (ffff8af216636000) 00010000:00010000:2.0:1784191892.938651:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191892.938654:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191892.938994:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c40d lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf1b expref: 61 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.939018:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c422 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf1b expref: 60 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.939026:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x2e:0x0].0x0 (ffff8af216636900) 00010000:00010000:2.0:1784191892.939028:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191892.939031:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cd200, rc 0) 00000100:00100000:2.0:1784191892.939288:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+61:123690:x1870858812422016:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2480us (2879us total) trans 34359738743 rc 0/0 00000100:00100000:2.0:1784191892.939298:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 652 00000100:00100000:3.0:1784191892.943407:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.943598:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812422144 00000100:00100000:2.0:1784191892.943611:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812422144 00000100:00100000:2.0:1784191892.943682:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 342 00000100:00100000:2.0:1784191892.943723:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:69112:x1870858812422144:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.943743:0:162385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.943766:0:162385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccf1a979/0xfeec3c2dc5a4c430 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf22 expref: -99 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191892.943794:0:162385:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191892.943814:0:162385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25c:0x0].0x0 since=5513s v=(0 0) 00010000:00010000:2.0:1784191892.943819:0:162385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.943829:0:162385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccf1a979/0xfeec3c2dc5a4c430 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf22 expref: 28 pid: 162385 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.943847:0:162385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ccf1a979/0xfeec3c2dc5a4c430 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf22 expref: 28 pid: 162385 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.943861:0:162385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cc400, rc 0) 00000100:00100000:2.0:1784191892.944303:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:69112:x1870858812422144:12345-192.168.204.16@tcp:101:cp.0 Request processed in 582us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191892.944310:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 342 00000100:00100000:3.0:1784191892.947380:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.947596:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812422272 00000100:00100000:1.0:1784191892.947607:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812422272 00000100:00100000:1.0:1784191892.947660:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 343 00000100:00100000:1.0:1784191892.947669:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:123690:x1870858812422272:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191892.947702:0:162395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191892.947732:0:162395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f487fd9/0xfeec3c2dc5a4c437 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf29 expref: -99 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.947767:0:162395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ccf1a979/0xfeec3c2dc5a4c430 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf22 expref: 29 pid: 162385 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.947795:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191892.947799:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191892.947805:0:162395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f487fd9/0xfeec3c2dc5a4c437 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x25c:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf29 expref: 29 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.947842:0:162395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ccf1a979/0xfeec3c2dc5a4c430 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf22 expref: 29 pid: 162385 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.947858:0:162395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ccf1a979/0xfeec3c2dc5a4c430 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf22 expref: 29 pid: 162385 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191892.947873:0:162395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:162395:1870858827967360:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191892.947961:0:162395:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e69e300 going to sleep for 11 seconds 00000100:00100000:0.0:1784191892.954861:0:162395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:162395:1870858827967360:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191892.954900:0:162395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f487fd9/0xfeec3c2dc5a4c437 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x25c:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf29 expref: 29 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.954921:0:162395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200030a00, rc 0) 00000100:00100000:0.0:1784191892.955013:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:123690:x1870858812422272:12345-192.168.204.16@tcp:101:cp.0 Request processed in 7344us (7648us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.955022:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 343 00000100:00100000:1.0:1784191892.955121:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.955257:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812422400 00000100:00100000:2.0:1784191892.955265:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812422400 00010000:00010000:2.0:1784191892.955297:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ccf1a979/0xfeec3c2dc5a4c430 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf22 expref: 29 pid: 162385 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191892.955334:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 175 00000100:00100000:2.0:1784191892.955356:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:69110:x1870858812422400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191892.955370:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191892.955394:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ccf1a979/0xfeec3c2dc5a4c430 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf22 expref: 29 pid: 162385 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.955408:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ccf1a979/0xfeec3c2dc5a4c430 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf22 expref: 29 pid: 162385 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.955432:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccf1a979/0xfeec3c2dc5a4c430 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf22 expref: 29 pid: 162385 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.955446:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.955451:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.956029:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f487fd9/0xfeec3c2dc5a4c437 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf29 expref: 28 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.956040:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f487fd9/0xfeec3c2dc5a4c437 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf29 expref: 28 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.956081:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002f487fd9/0xfeec3c2dc5a4c437 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf29 expref: 28 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191892.956107:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827967488:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191892.956854:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cd2f780 going to sleep for 11 seconds 00000100:00100000:3.0:1784191892.960623:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.960665:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812422656 00000100:00100000:3.0:1784191892.960675:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812422656 00000100:00100000:3.0:1784191892.960866:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 182 00000100:00100000:3.0:1784191892.960878:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+61:123690:x1870858812422656:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191892.961244:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+62:123690:x1870858812422656:12345-192.168.204.16@tcp:35:cp.0 Request processed in 367us (629us total) trans 34359738744 rc 0/0 00000100:00100000:3.0:1784191892.961253:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 182 00000100:00100000:2.0:1784191892.962098:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827967488:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191892.962132:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191892.962166:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:69110:x1870858812422400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6810us (7045us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191892.962174:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 175 00000100:00100000:3.0:1784191892.965978:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.966049:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812422784 00000100:00100000:2.0:1784191892.966058:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812422784 00000100:00100000:2.0:1784191892.966128:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 653 00000100:00100000:2.0:1784191892.966139:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+62:123690:x1870858812422784:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.966165:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.966187:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c43e lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf30 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966259:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c445 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966273:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c445 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966284:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c445 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966298:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c44c lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966306:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c44c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966312:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c44c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966375:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c445 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966382:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c445 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966388:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c445 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966393:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c445 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966398:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2ccc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.966402:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c445 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966408:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c445 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966419:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.966422:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.966427:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c445 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966432:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c445 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966448:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c44c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966465:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c44c lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966477:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c44c lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966483:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cc200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.966485:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c44c lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966491:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c44c lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966499:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x4958ff4 (ffff8af216636400) 00010000:00010000:2.0:1784191892.966501:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.966504:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c44c lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966511:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c44c lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966560:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c43e lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf30 expref: 63 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966570:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.966572:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.966575:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c43e lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf30 expref: 63 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.966586:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cda00, rc 0) 00000100:00100000:2.0:1784191892.966650:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+62:123690:x1870858812422784:12345-192.168.204.16@tcp:101:cp.0 Request processed in 513us (686us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191892.966665:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 653 00000100:00100000:3.0:1784191892.969390:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.969942:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812422912 00000100:00100000:2.0:1784191892.969953:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812422912 00000100:00100000:2.0:1784191892.970012:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 654 00000100:00100000:2.0:1784191892.970021:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+62:123690:x1870858812422912:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.970043:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.970063:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4c453 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf37 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970135:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c45a lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970149:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c45a lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970159:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c45a lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970174:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c461 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970180:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c461 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970186:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c461 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970226:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c45a lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970250:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c45a lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970255:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c45a lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970261:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c45a lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970266:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cde00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.970271:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c45a lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970278:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c45a lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970290:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.970293:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.970297:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c45a lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970305:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c45a lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970322:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c461 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970328:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c461 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970334:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c461 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970347:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cd600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191892.970350:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c461 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970356:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c461 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970365:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x4958ff4 (ffff8af219b92e00) 00010000:00010000:2.0:1784191892.970367:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.970370:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c461 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970375:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c461 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970412:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4c453 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf37 expref: 63 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970422:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191892.970424:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191892.970428:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd800/0xfeec3c2dc5a4c453 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf37 expref: 63 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.970437:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cd800, rc 0) 00000100:00100000:2.0:1784191892.970724:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+62:123690:x1870858812422912:12345-192.168.204.16@tcp:101:cp.0 Request processed in 701us (1343us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191892.970732:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 654 00000100:00100000:3.0:1784191892.979065:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.979133:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812423168 00000100:00100000:3.0:1784191892.979145:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812423168 00000100:00100000:3.0:1784191892.979216:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 655 00000100:00100000:3.0:1784191892.979228:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+62:123690:x1870858812423168:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191892.979255:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191892.979283:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68c00/0xfeec3c2dc5a4c468 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf3e expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.979410:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c46f lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.979428:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c46f lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.979443:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c46f lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.979474:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68400/0xfeec3c2dc5a4c476 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.979482:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68400/0xfeec3c2dc5a4c476 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.979513:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68400/0xfeec3c2dc5a4c476 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191892.979897:0:158665:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1d9:0x0], index 1: 0 00080000:00000400:3.0:1784191892.979910:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191892.979914:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191892.979916:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191892.979919:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191892.979921:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191892.979923:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191892.979940:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191892.979943:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191892.979945:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191892.979947:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191892.979949:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191892.979951:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191892.979979:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191892.979982:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191892.979984:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191892.979986:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191892.979988:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191892.979990:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191892.980089:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68a00/0xfeec3c2dc5a4c47d lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.980100:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68a00/0xfeec3c2dc5a4c47d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.980108:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68a00/0xfeec3c2dc5a4c47d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.980161:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c46f lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.980169:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c46f lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.980176:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c46f lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.980183:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c46f lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.980189:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd69e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191892.980194:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c46f lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.980202:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c46f lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.980217:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191892.980220:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191892.980225:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c46f lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.980233:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c46f lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191892.980249:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000c3b5eab reply state 00000000dd09477a transno 34359738745 ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68400/0xfeec3c2dc5a4c476 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.980261:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68400/0xfeec3c2dc5a4c476 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.980276:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x4958ff4 (ffff8af215ff6100) 00010000:00010000:3.0:1784191892.980279:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191892.980282:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784191892.980317:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68c00/0xfeec3c2dc5a4c468 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf3e expref: 65 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.980333:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68a00/0xfeec3c2dc5a4c47d lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf3e expref: 64 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191892.980341:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x2f:0x0].0x0 (ffff8af215ff6500) 00010000:00010000:3.0:1784191892.980343:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784191892.980346:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd68a00, rc 0) 00000100:00100000:3.0:1784191892.980419:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+65:123690:x1870858812423168:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1193us (1365us total) trans 34359738745 rc 0/0 00000100:00100000:3.0:1784191892.980427:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 655 00000100:00100000:3.0:1784191892.984426:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191892.984638:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812423296 00000100:00100000:0.0:1784191892.984652:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812423296 00000100:00100000:0.0:1784191892.984781:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 344 00000100:00100000:0.0:1784191892.984793:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+27:69110:x1870858812423296:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191892.984819:0:162386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191892.984850:0:162386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a7a209b/0xfeec3c2dc5a4c48b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf45 expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191892.984885:0:162386:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191892.984905:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d9:0x0].0x0 since=5513s v=(0 0) 00010000:00010000:0.0:1784191892.984909:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191892.984920:0:162386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a7a209b/0xfeec3c2dc5a4c48b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf45 expref: 28 pid: 162386 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.984942:0:162386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004a7a209b/0xfeec3c2dc5a4c48b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf45 expref: 28 pid: 162386 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191892.984956:0:162386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010bf400, rc 0) 00000100:00100000:0.0:1784191892.985015:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:69110:x1870858812423296:12345-192.168.204.16@tcp:101:cp.0 Request processed in 224us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191892.985022:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 344 00000100:00100000:1.0:1784191892.988090:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191892.988422:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812423424 00000100:00100000:2.0:1784191892.988451:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812423424 00000100:00100000:2.0:1784191892.988658:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 345 00000100:00100000:2.0:1784191892.988671:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:123690:x1870858812423424:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191892.988733:0:162394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191892.988758:0:162394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6185cba/0xfeec3c2dc5a4c492 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf4c expref: -99 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.988800:0:162394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a7a209b/0xfeec3c2dc5a4c48b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf45 expref: 29 pid: 162386 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.988811:0:162394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.988816:0:162394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191892.988822:0:162394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6185cba/0xfeec3c2dc5a4c492 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf4c expref: 29 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.988865:0:162394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a7a209b/0xfeec3c2dc5a4c48b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf45 expref: 29 pid: 162386 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.988883:0:162394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a7a209b/0xfeec3c2dc5a4c48b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf45 expref: 29 pid: 162386 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191892.988898:0:162394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:162394:1870858827967616:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191892.988987:0:162394:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cd2f780 going to sleep for 11 seconds 00000100:00100000:1.0:1784191892.992847:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191892.992884:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812423552 00000100:00100000:1.0:1784191892.992894:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812423552 00010000:00010000:1.0:1784191892.992941:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a7a209b/0xfeec3c2dc5a4c48b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf45 expref: 30 pid: 162386 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191892.992985:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 176 00000100:00100000:1.0:1784191892.992997:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:69111:x1870858812423552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191892.993014:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191892.993057:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a7a209b/0xfeec3c2dc5a4c48b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf45 expref: 30 pid: 162386 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.993073:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a7a209b/0xfeec3c2dc5a4c48b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf45 expref: 30 pid: 162386 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.993114:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191892.993120:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191892.993129:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6185cba/0xfeec3c2dc5a4c492 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf4c expref: 30 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.993141:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6185cba/0xfeec3c2dc5a4c492 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf4c expref: 30 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191892.993183:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c6185cba/0xfeec3c2dc5a4c492 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf4c expref: 30 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191892.993200:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc67800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827967744:192.168.204.16@tcp:105: 00000100:00100000:1.0:1784191892.993280:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e69e9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1784191892.994850:0:162394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a7a209b/0xfeec3c2dc5a4c48b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf45 expref: 30 pid: 162386 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191892.994897:0:162394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:162394:1870858827967616:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191892.994931:0:162394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c6185cba/0xfeec3c2dc5a4c492 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf4c expref: 29 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191892.994944:0:162394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cd800, rc 0) 00000100:00100000:2.0:1784191892.995002:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:123690:x1870858812423424:12345-192.168.204.16@tcp:101:cp.0 Request processed in 6333us (6923us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191892.995010:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 345 00000100:00100000:3.0:1784191892.998106:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc67800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827967744:192.168.204.16@tcp:105: 00010000:00010000:3.0:1784191892.998137:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191892.998195:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:69111:x1870858812423552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5199us (5360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191892.998205:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 176 00000100:00100000:1.0:1784191892.999573:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191892.999849:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812423808 00000100:00100000:3.0:1784191892.999858:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812423808 00000100:00100000:3.0:1784191892.999907:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 183 00000100:00100000:3.0:1784191892.999916:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+65:123690:x1870858812423808:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191893.000211:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+66:123690:x1870858812423808:12345-192.168.204.16@tcp:35:cp.0 Request processed in 295us (645us total) trans 34359738746 rc 0/0 00000100:00100000:3.0:1784191893.000236:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 183 00000100:00100000:0.0:1784191893.004983:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784191893.005008:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827967872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784191893.005070:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191893.005891:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827968000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191893.005936:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191893.006745:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827968128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784191893.006787:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191893.006831:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784191893.006837:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827968256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784191893.006861:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191893.006898:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827967872 00000100:00100000:1.0:1784191893.006922:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827967872 00000100:00100000:1.0:1784191893.006971:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827968128 00000100:00100000:0.0:1784191893.006972:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827968256 00000100:00100000:1.0:1784191893.006974:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827968128 00000100:00100000:0.0:1784191893.006976:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827968256 00000100:00100000:1.0:1784191893.006988:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1784191893.007086:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827967872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784191893.007114:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 815104 granted 21256128 pending 0 free 71176192 avail 63946752 00000100:00100000:1.0:1784191893.007171:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827967872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 174us (2099us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.007235:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827967872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191893.008726:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1784191893.008767:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1784191893.008782:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827968128:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784191893.008798:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827968000 00000100:00100000:2.0:1784191893.008806:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827968000 00000100:00100000:2.0:1784191893.008853:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:2.0:1784191893.008860:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:106500:x1870858827968000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784191893.008897:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42545152 avail 36413440 00000100:00100000:0.0:1784191893.008901:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1784191893.008912:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827968256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784191893.008944:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 679936 granted 26068928 pending 0 free 70651904 avail 63000576 00002000:00000024:1.0:1784191893.008991:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 815104 granted 21256128 pending 0 free 71176192 avail 63946752 00000100:00100000:0.0:1784191893.009043:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827968256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (2179us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191893.009050:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1784191893.010124:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827968128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1343us (3329us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191893.010137:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:1.0:1784191893.010170:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784191893.010176:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784191893.010236:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827968256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784191893.010250:0:106501:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869239 gen 2 00000100:00100000:1.0:1784191893.010273:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827968128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784191893.010441:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:106500:x1870858827968000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1578us (4501us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.010451:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:2.0:1784191893.010674:0:106500:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 34359738649 gen 2 00000004:00080000:2.0:1784191893.010681:0:106500:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738640 committed transno 34359738649 00000004:00080000:2.0:1784191893.010876:0:106500:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738641 committed transno 34359738649 00000004:00080000:2.0:1784191893.010906:0:106500:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738642 committed transno 34359738649 00000004:00080000:2.0:1784191893.010945:0:106500:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738643 committed transno 34359738649 00000004:00080000:2.0:1784191893.010960:0:106500:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738644 committed transno 34359738649 00000004:00080000:2.0:1784191893.010983:0:106500:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738645 committed transno 34359738649 00000004:00080000:2.0:1784191893.010999:0:106500:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738646 committed transno 34359738649 00000004:00080000:2.0:1784191893.011014:0:106500:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738647 committed transno 34359738649 00000004:00080000:2.0:1784191893.011039:0:106500:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738648 committed transno 34359738649 00000004:00080000:2.0:1784191893.011051:0:106500:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738649 committed transno 34359738649 00000100:00100000:2.0:1784191893.011072:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827968000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784191893.011167:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.011251:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812423936 00000100:00100000:3.0:1784191893.011258:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812423936 00000100:00100000:3.0:1784191893.011379:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 656 00000100:00100000:3.0:1784191893.011388:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+66:123690:x1870858812423936:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.011413:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.011436:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68c00/0xfeec3c2dc5a4c499 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf53 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011511:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4a0 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011526:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4a0 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011549:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4a0 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011565:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4a7 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011571:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4a7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011576:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4a7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011628:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4a0 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011647:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4a0 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011654:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4a0 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011660:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4a0 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011667:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd69e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191893.011671:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4a0 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011678:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4a0 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011732:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191893.011736:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.011741:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4a0 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011747:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4a0 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011760:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4a7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011765:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4a7 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011770:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4a7 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011780:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191893.011783:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4a7 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011788:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4a7 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011795:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x57ba1cca (ffff8af215ff6000) 00010000:00010000:3.0:1784191893.011798:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.011800:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4a7 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011806:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4a7 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011840:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68c00/0xfeec3c2dc5a4c499 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf53 expref: 67 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011850:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191893.011852:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.011856:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68c00/0xfeec3c2dc5a4c499 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf53 expref: 67 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.011864:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd68c00, rc 0) 00000100:00100000:2.0:1784191893.012178:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+66:123690:x1870858812423936:12345-192.168.204.16@tcp:101:cp.0 Request processed in 788us (1010us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191893.012186:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 656 00000100:00100000:3.0:1784191893.016919:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:1.0:1784191893.017064:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784191893.017179:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812424064 00000100:00100000:2.0:1784191893.017192:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812424064 00000100:00100000:2.0:1784191893.017264:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 657 00000100:00100000:2.0:1784191893.017276:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+66:123690:x1870858812424064:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.017301:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.017325:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c4ae lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf5a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017402:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c4b5 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017421:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c4b5 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017438:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c4b5 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017456:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c4bc lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017478:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c4bc lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017487:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c4bc lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017547:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c4b5 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017555:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c4b5 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017562:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c4b5 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017569:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c4b5 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017575:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cde00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.017580:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c4b5 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017588:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c4b5 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017601:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.017604:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.017610:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c4b5 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017617:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c4b5 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017643:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c4bc lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017650:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c4bc lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017656:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c4bc lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017661:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cda00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.017664:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c4bc lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017670:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c4bc lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017679:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x57ba1cca (ffff8af2047f9f00) 00010000:00010000:2.0:1784191893.017681:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.017684:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c4bc lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017715:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c4bc lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017753:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c4ae lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf5a expref: 67 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017766:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.017768:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.017779:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c4ae lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf5a expref: 67 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.017790:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cd600, rc 0) 00000100:00100000:2.0:1784191893.017947:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+66:123690:x1870858812424064:12345-192.168.204.16@tcp:101:cp.0 Request processed in 672us (1040us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191893.017955:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 657 00000100:00100000:1.0:1784191893.023626:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.023872:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812424320 00000100:00100000:3.0:1784191893.023884:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812424320 00000100:00100000:3.0:1784191893.023950:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 658 00000100:00100000:3.0:1784191893.023961:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+66:123690:x1870858812424320:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.024000:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.024026:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68c00/0xfeec3c2dc5a4c4c3 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf61 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.024155:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4ca lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.024173:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4ca lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.024185:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4ca lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.024200:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4d1 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.024206:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4d1 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.024213:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4d1 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191893.025087:0:158667:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x25d:0x0], index 0: 0 00080000:00000400:3.0:1784191893.025104:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191893.025108:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191893.025111:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191893.025113:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191893.025114:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191893.025116:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191893.025135:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191893.025138:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191893.025150:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191893.025152:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191893.025154:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191893.025156:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191893.025192:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191893.025195:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191893.025197:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191893.025199:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191893.025201:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191893.025202:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191893.025313:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69c00/0xfeec3c2dc5a4c4d8 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.025328:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69c00/0xfeec3c2dc5a4c4d8 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.025337:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69c00/0xfeec3c2dc5a4c4d8 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.025620:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4ca lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.025629:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4ca lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.025636:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4ca lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.025643:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4ca lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.025649:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191893.025654:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4ca lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.025661:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4ca lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.025674:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191893.025677:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.025683:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4ca lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.025859:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c4ca lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191893.025876:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003dfd0f45 reply state 000000000c948bef transno 34359738747 ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4d1 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.025898:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.025904:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x57ba1cca (ffff8af215ff6000) 00010000:00010000:0.0:1784191893.025907:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191893.025910:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191893.025951:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68c00/0xfeec3c2dc5a4c4c3 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf61 expref: 69 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.025966:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69c00/0xfeec3c2dc5a4c4d8 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf61 expref: 68 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.025973:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x30:0x0].0x0 (ffff8af215ff6700) 00010000:00010000:0.0:1784191893.025975:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191893.025978:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd69c00, rc 0) 00000100:00100000:0.0:1784191893.026083:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+69:123690:x1870858812424320:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2123us (2468us total) trans 34359738747 rc 0/0 00000100:00100000:0.0:1784191893.026092:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 658 00000100:00100000:1.0:1784191893.029398:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.029577:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812424448 00000100:00100000:3.0:1784191893.029589:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812424448 00000100:00100000:3.0:1784191893.029754:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 346 00000100:00100000:3.0:1784191893.029765:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:69112:x1870858812424448:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.029786:0:162398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.029812:0:162398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c4e6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf68 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191893.029845:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784191893.029867:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25d:0x0].0x0 since=5513s v=(0 0) 00010000:00010000:3.0:1784191893.029872:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.029883:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c4e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf68 expref: 29 pid: 162398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.029922:0:162398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c4e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf68 expref: 29 pid: 162398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.029938:0:162398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd68200, rc 0) 00000100:00100000:3.0:1784191893.030007:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:69112:x1870858812424448:12345-192.168.204.16@tcp:101:cp.0 Request processed in 244us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191893.030016:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 346 00000100:00080000:1.0:1784191893.030370:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784191893.033467:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.033635:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812424576 00000100:00100000:2.0:1784191893.033647:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812424576 00000100:00100000:3.0:1784191893.033799:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 347 00000100:00100000:3.0:1784191893.033812:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:123690:x1870858812424576:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.033835:0:160165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.033857:0:160165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d1638d4/0xfeec3c2dc5a4c4ed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf6f expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.033896:0:160165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c4e6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf68 expref: 30 pid: 162398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.033905:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.033909:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.033915:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d1638d4/0xfeec3c2dc5a4c4ed lrc: 4/0,0 mode: --/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf6f expref: 30 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.033955:0:160165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c4e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf68 expref: 30 pid: 162398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.033993:0:160165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c4e6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf68 expref: 30 pid: 162398 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191893.034007:0:160165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec87800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:160165:1870858827968384:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191893.034104:0:160165:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af205de4540 going to sleep for 11 seconds 00000100:00100000:2.0:1784191893.037203:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.037301:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812424704 00000100:00100000:0.0:1784191893.037311:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812424704 00010000:00010000:0.0:1784191893.037365:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c4e6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf68 expref: 31 pid: 162398 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.037408:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 177 00000100:00100000:0.0:1784191893.037418:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:69110:x1870858812424704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191893.037434:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191893.037485:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c4e6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf68 expref: 31 pid: 162398 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.037501:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c4e6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf68 expref: 31 pid: 162398 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.037542:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.037548:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.037560:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000d1638d4/0xfeec3c2dc5a4c4ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf6f expref: 31 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.037574:0:158650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d1638d4/0xfeec3c2dc5a4c4ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf6f expref: 31 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.037621:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000d1638d4/0xfeec3c2dc5a4c4ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf6f expref: 31 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.037636:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:158650:1870858827968512:192.168.204.16@tcp:105: 00000100:00100000:0.0:1784191893.037915:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9ec00 going to sleep for 11 seconds 00010000:00010000:3.0:1784191893.038487:0:160165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c4e6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf68 expref: 31 pid: 162398 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191893.038504:0:160165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec87800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:160165:1870858827968384:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191893.038546:0:160165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d1638d4/0xfeec3c2dc5a4c4ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf6f expref: 30 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.038557:0:160165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd69600, rc 0) 00000100:00100000:3.0:1784191893.038605:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:123690:x1870858812424576:12345-192.168.204.16@tcp:101:cp.0 Request processed in 4797us (5160us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191893.038614:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 347 00000100:00100000:2.0:1784191893.043309:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.043373:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812424960 00000100:00100000:3.0:1784191893.043383:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812424960 00000100:00100000:3.0:1784191893.043462:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 184 00000100:00100000:3.0:1784191893.043474:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+69:123690:x1870858812424960:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191893.043846:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+70:123690:x1870858812424960:12345-192.168.204.16@tcp:35:cp.0 Request processed in 373us (544us total) trans 34359738748 rc 0/0 00000100:00100000:3.0:1784191893.043854:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 184 00000100:00100000:0.0:1784191893.044349:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:158650:1870858827968512:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191893.044374:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191893.044415:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:69110:x1870858812424704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6998us (7225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191893.044425:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 177 00000100:00100000:2.0:1784191893.048350:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.048459:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812425088 00000100:00100000:1.0:1784191893.048470:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812425088 00000100:00100000:1.0:1784191893.048564:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 659 00000100:00100000:1.0:1784191893.048576:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+70:123690:x1870858812425088:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191893.048604:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191893.048627:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c4f4 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf76 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.048850:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c4fb lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.048866:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c4fb lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.048878:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c4fb lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.048893:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c502 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.048900:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c502 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.048906:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c502 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.048946:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c4fb lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.048952:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c4fb lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.048958:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c4fb lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.048975:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c4fb lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.048981:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.048986:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c4fb lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.048993:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c4fb lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.049005:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.049008:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.049013:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c4fb lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.049020:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c4fb lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.049036:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c502 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.049042:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c502 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.049047:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c502 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.049052:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200031600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.049055:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c502 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.049070:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c502 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.049078:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x407c6222 (ffff8af20dabcf00) 00010000:00010000:1.0:1784191893.049080:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.049083:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c502 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.049088:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c502 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.049126:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c4f4 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf76 expref: 71 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.049137:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.049139:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.049143:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c4f4 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf76 expref: 71 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.049151:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200030e00, rc 0) 00000100:00100000:1.0:1784191893.049223:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+70:123690:x1870858812425088:12345-192.168.204.16@tcp:101:cp.0 Request processed in 649us (883us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191893.049230:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 659 00000100:00100000:2.0:1784191893.052522:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.052638:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812425216 00000100:00100000:0.0:1784191893.052650:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812425216 00000100:00100000:0.0:1784191893.052786:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 660 00000100:00100000:0.0:1784191893.052797:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+70:123690:x1870858812425216:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.052820:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.052841:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4c509 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf7d expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.052907:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c510 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.052922:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c510 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.052933:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c510 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.052947:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c517 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.052953:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c517 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.052959:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c517 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.052998:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c510 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.053004:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c510 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.053010:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c510 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.053027:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c510 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.053033:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010bf600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191893.053037:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c510 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.053044:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c510 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.053058:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191893.053061:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.053065:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c510 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.053072:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c510 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.053085:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c517 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.053317:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c517 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.053325:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c517 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.053330:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010be600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191893.053334:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c517 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.053351:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c517 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.053361:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x407c6222 (ffff8af216687400) 00010000:00010000:0.0:1784191893.053363:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.053366:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c517 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.053372:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c517 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.053408:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4c509 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf7d expref: 71 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.053418:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191893.053421:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.053425:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4c509 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf7d expref: 71 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.053433:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010be000, rc 0) 00000100:00100000:0.0:1784191893.053498:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+70:123690:x1870858812425216:12345-192.168.204.16@tcp:101:cp.0 Request processed in 702us (985us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191893.053506:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 660 00000100:00100000:2.0:1784191893.056992:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.057209:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812425472 00000100:00100000:0.0:1784191893.057223:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812425472 00000100:00100000:0.0:1784191893.057290:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 661 00000100:00100000:0.0:1784191893.057300:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+70:123690:x1870858812425472:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.057341:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.057366:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c51e lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf84 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.057647:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c525 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.057664:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c525 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.057676:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c525 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.058599:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c52c lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.058613:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c52c lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.058622:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c52c lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191893.059260:0:158667:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1da:0x0], index 1: 0 00080000:00000400:0.0:1784191893.059275:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191893.059279:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191893.059282:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191893.059284:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191893.059286:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191893.059287:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191893.059305:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191893.059308:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191893.059323:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191893.059325:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191893.059327:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191893.059328:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191893.059366:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191893.059370:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191893.059371:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191893.059373:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191893.059376:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191893.059377:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191893.059670:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf400/0xfeec3c2dc5a4c533 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.059681:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf400/0xfeec3c2dc5a4c533 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.059818:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf400/0xfeec3c2dc5a4c533 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.059859:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c525 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.059866:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c525 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.059872:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c525 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.059879:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c525 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.059884:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010bf200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191893.059888:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c525 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.059904:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c525 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.059915:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191893.059918:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.059922:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c525 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.059928:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c525 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191893.059941:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007baf258f reply state 00000000e5ddfe75 transno 34359738749 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c52c lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.059952:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c52c lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.059958:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x407c6222 (ffff8af216687300) 00010000:00010000:0.0:1784191893.059960:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191893.059963:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191893.059999:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bee00/0xfeec3c2dc5a4c51e lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf84 expref: 73 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.060013:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf400/0xfeec3c2dc5a4c533 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf84 expref: 72 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.060020:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x31:0x0].0x0 (ffff8af216687d00) 00010000:00010000:0.0:1784191893.060022:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191893.060024:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010bf400, rc 0) 00000100:00100000:0.0:1784191893.060370:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+73:123690:x1870858812425472:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3070us (3388us total) trans 34359738749 rc 0/0 00000100:00100000:0.0:1784191893.060381:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 661 00000100:00100000:2.0:1784191893.064320:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.064388:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812425600 00000100:00100000:3.0:1784191893.064400:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812425600 00000100:00100000:3.0:1784191893.064545:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 348 00000100:00100000:3.0:1784191893.064557:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+28:69110:x1870858812425600:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.064581:0:161232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.064607:0:161232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c541 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf8b expref: -99 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191893.064635:0:161232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784191893.064658:0:161232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1da:0x0].0x0 since=5513s v=(0 0) 00010000:00010000:3.0:1784191893.064663:0:161232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.064674:0:161232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c541 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf8b expref: 29 pid: 161232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.064732:0:161232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c541 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf8b expref: 29 pid: 161232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.064749:0:161232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd68200, rc 0) 00000100:00100000:3.0:1784191893.064814:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:69110:x1870858812425600:12345-192.168.204.16@tcp:101:cp.0 Request processed in 259us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191893.064821:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 348 00000100:00080000:1.0:1784191893.066275:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784191893.068895:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.068990:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812425728 00000100:00100000:0.0:1784191893.069000:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812425728 00000100:00100000:0.0:1784191893.069063:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 349 00000100:00100000:0.0:1784191893.069074:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:123690:x1870858812425728:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.069102:0:160163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.069123:0:160163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db153155/0xfeec3c2dc5a4c548 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf92 expref: -99 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.069156:0:160163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c541 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf8b expref: 30 pid: 161232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.069166:0:160163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.069171:0:160163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.069178:0:160163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db153155/0xfeec3c2dc5a4c548 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf92 expref: 30 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.069210:0:160163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c541 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf8b expref: 30 pid: 161232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.069226:0:160163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c541 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf8b expref: 30 pid: 161232 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.069240:0:160163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:160163:1870858827968640:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191893.069340:0:160163:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9e600 going to sleep for 11 seconds 00000100:00100000:2.0:1784191893.072448:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.072611:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812425856 00000100:00100000:1.0:1784191893.072620:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812425856 00010000:00010000:1.0:1784191893.072662:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c541 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf8b expref: 31 pid: 161232 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191893.072764:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 178 00000100:00100000:1.0:1784191893.072774:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:69112:x1870858812425856:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191893.072792:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191893.072817:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c541 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf8b expref: 31 pid: 161232 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.072833:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c541 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf8b expref: 31 pid: 161232 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.072859:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191893.072864:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191893.072880:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000db153155/0xfeec3c2dc5a4c548 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf92 expref: 31 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.072892:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db153155/0xfeec3c2dc5a4c548 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf92 expref: 31 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.072934:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000db153155/0xfeec3c2dc5a4c548 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf92 expref: 31 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191893.072950:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc67800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827968768:192.168.204.16@tcp:105: 00000100:00100000:1.0:1784191893.073028:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e69e3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784191893.073194:0:160163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097d60b4d/0xfeec3c2dc5a4c541 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf8b expref: 31 pid: 161232 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.073210:0:160163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:160163:1870858827968640:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191893.073236:0:160163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000db153155/0xfeec3c2dc5a4c548 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf92 expref: 30 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.073247:0:160163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010bee00, rc 0) 00000100:00100000:0.0:1784191893.073277:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:123690:x1870858812425728:12345-192.168.204.16@tcp:101:cp.0 Request processed in 4205us (4397us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191893.073285:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 349 00000100:00100000:3.0:1784191893.078651:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.078762:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc67800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827968768:192.168.204.16@tcp:105: 00010000:00010000:1.0:1784191893.078808:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191893.078870:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:69112:x1870858812425856:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6098us (6434us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191893.078880:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 178 00000100:00100000:2.0:1784191893.079409:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812426112 00000100:00100000:2.0:1784191893.079417:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812426112 00000100:00100000:2.0:1784191893.079470:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 185 00000100:00100000:2.0:1784191893.079479:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+73:123690:x1870858812426112:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191893.079922:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+74:123690:x1870858812426112:12345-192.168.204.16@tcp:35:cp.0 Request processed in 444us (1279us total) trans 34359738750 rc 0/0 00000100:00100000:2.0:1784191893.079930:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 185 00000100:00100000:3.0:1784191893.083810:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.083913:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812426240 00000100:00100000:1.0:1784191893.083923:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812426240 00000100:00100000:1.0:1784191893.083990:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 662 00000100:00100000:1.0:1784191893.084000:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+74:123690:x1870858812426240:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191893.084032:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191893.084057:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c54f lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bf99 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084143:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c556 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084156:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c556 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084167:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c556 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084181:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c55d lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084187:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c55d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084193:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c55d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084270:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c556 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084277:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c556 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084282:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c556 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084288:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c556 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084294:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200031600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.084299:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c556 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084305:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c556 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084318:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.084320:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.084324:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c556 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084330:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c556 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084343:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c55d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084349:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c55d lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084359:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c55d lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084364:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.084367:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c55d lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084373:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c55d lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084381:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x239dea14 (ffff8af20dabcf00) 00010000:00010000:1.0:1784191893.084383:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.084386:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c55d lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084391:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c55d lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084421:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c54f lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf99 expref: 75 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084431:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.084433:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.084436:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c54f lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf99 expref: 75 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.084444:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200030e00, rc 0) 00000100:00100000:1.0:1784191893.084517:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+74:123690:x1870858812426240:12345-192.168.204.16@tcp:101:cp.0 Request processed in 519us (719us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191893.084543:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 662 00000100:00100000:0.0:1784191893.088685:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.088856:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812426368 00000100:00100000:2.0:1784191893.088871:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812426368 00000100:00100000:2.0:1784191893.088935:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 663 00000100:00100000:2.0:1784191893.088945:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+74:123690:x1870858812426368:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.088980:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.089002:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c564 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bfa0 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089073:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c56b lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089088:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c56b lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089114:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c56b lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089128:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c572 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089134:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c572 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089140:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c572 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089183:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c56b lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089189:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c56b lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089195:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c56b lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089202:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c56b lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089214:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cda00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.089219:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c56b lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089225:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c56b lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089239:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.089242:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.089246:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c56b lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089252:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c56b lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089267:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c572 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089272:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c572 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089277:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c572 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089282:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cd600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.089284:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c572 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089291:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c572 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089307:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x239dea14 (ffff8af2047f9f00) 00010000:00010000:2.0:1784191893.089310:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.089312:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c572 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089318:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c572 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089351:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c564 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfa0 expref: 75 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089362:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.089364:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.089368:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c564 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfa0 expref: 75 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.089377:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cde00, rc 0) 00000100:00100000:2.0:1784191893.089445:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+74:123690:x1870858812426368:12345-192.168.204.16@tcp:101:cp.0 Request processed in 502us (774us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191893.089452:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 663 00000100:00100000:2.0:1784191893.093193:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.093591:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812426624 00000100:00100000:0.0:1784191893.093603:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812426624 00000100:00100000:0.0:1784191893.093681:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 664 00000100:00100000:0.0:1784191893.093731:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+74:123690:x1870858812426624:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.093757:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.093782:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c579 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bfa7 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.093904:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c580 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.093920:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c580 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.093953:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c580 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.093969:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c587 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.093978:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c587 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.093985:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c587 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191893.094315:0:158667:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x25e:0x0], index 0: 0 00080000:00000400:0.0:1784191893.094329:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191893.094332:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191893.094334:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191893.094336:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191893.094339:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191893.094341:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191893.094358:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191893.094361:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191893.094363:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191893.094365:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191893.094367:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191893.094369:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191893.094396:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191893.094400:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191893.094401:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191893.094403:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191893.094405:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191893.094414:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191893.094506:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4c58e lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.094515:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4c58e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.094522:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4c58e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.094570:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c580 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.094577:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c580 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.094583:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c580 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.094590:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c580 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.094596:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010bf600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191893.094600:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c580 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.094607:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c580 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.094619:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191893.094622:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.094626:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c580 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.094644:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c580 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191893.094659:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017912448 reply state 00000000816fdbfb transno 34359738751 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c587 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.094670:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c587 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.094676:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x239dea14 (ffff8af216687400) 00010000:00010000:0.0:1784191893.094678:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191893.094680:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191893.094736:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c579 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfa7 expref: 77 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.094752:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4c58e lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfa7 expref: 76 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.094759:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x32:0x0].0x0 (ffff8af216687700) 00010000:00010000:0.0:1784191893.094761:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191893.094763:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db2e00, rc 0) 00000100:00100000:0.0:1784191893.094832:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+77:123690:x1870858812426624:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1141us (1649us total) trans 34359738751 rc 0/0 00000100:00100000:0.0:1784191893.094840:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 664 00000100:00100000:0.0:1784191893.100225:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.100350:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812426752 00000100:00100000:2.0:1784191893.100359:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812426752 00000100:00100000:2.0:1784191893.100427:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 350 00000100:00100000:2.0:1784191893.100438:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:69112:x1870858812426752:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.100467:0:162396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.100492:0:162396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d2146cb/0xfeec3c2dc5a4c59c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bfae expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191893.100546:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191893.100568:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25e:0x0].0x0 since=5513s v=(0 0) 00010000:00010000:2.0:1784191893.100572:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.100581:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d2146cb/0xfeec3c2dc5a4c59c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfae expref: 30 pid: 162396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.100600:0:162396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d2146cb/0xfeec3c2dc5a4c59c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfae expref: 30 pid: 162396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.100613:0:162396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cde00, rc 0) 00000100:00100000:2.0:1784191893.100669:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:69112:x1870858812426752:12345-192.168.204.16@tcp:101:cp.0 Request processed in 233us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.100676:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 350 00000100:00100000:2.0:1784191893.104133:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.104217:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812426880 00000100:00100000:0.0:1784191893.104227:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812426880 00000100:00100000:0.0:1784191893.104289:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 351 00000100:00100000:0.0:1784191893.104314:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:123690:x1870858812426880:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.104333:0:160166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.104353:0:160166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebbede44/0xfeec3c2dc5a4c5a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bfb5 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.104385:0:160166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000d2146cb/0xfeec3c2dc5a4c59c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x25e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfae expref: 31 pid: 162396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.104394:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.104399:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.104404:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebbede44/0xfeec3c2dc5a4c5a3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x25e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfb5 expref: 31 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.104440:0:160166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000d2146cb/0xfeec3c2dc5a4c59c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfae expref: 31 pid: 162396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.104456:0:160166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000d2146cb/0xfeec3c2dc5a4c59c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x25e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfae expref: 31 pid: 162396 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.104471:0:160166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:160166:1870858827968896:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191893.104562:0:160166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9e780 going to sleep for 11 seconds 00000100:00100000:2.0:1784191893.112674:0:160166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:160166:1870858827968896:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191893.112772:0:160166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ebbede44/0xfeec3c2dc5a4c5a3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x25e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfb5 expref: 31 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.112800:0:160166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3c00, rc 0) 00000100:00100000:2.0:1784191893.112874:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:123690:x1870858812426880:12345-192.168.204.16@tcp:101:cp.0 Request processed in 8560us (8753us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.112886:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 351 00000100:00100000:3.0:1784191893.115052:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.115160:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812427008 00000100:00100000:0.0:1784191893.115171:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812427008 00010000:00010000:0.0:1784191893.115218:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000d2146cb/0xfeec3c2dc5a4c59c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x25e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfae expref: 31 pid: 162396 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.115294:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 179 00000100:00100000:0.0:1784191893.115305:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:69109:x1870858812427008:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191893.115323:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191893.115349:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000d2146cb/0xfeec3c2dc5a4c59c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x25e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfae expref: 31 pid: 162396 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.115364:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000d2146cb/0xfeec3c2dc5a4c59c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfae expref: 31 pid: 162396 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.115391:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d2146cb/0xfeec3c2dc5a4c59c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x25e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfae expref: 31 pid: 162396 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.115410:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.115415:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.115424:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebbede44/0xfeec3c2dc5a4c5a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfb5 expref: 30 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.115434:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebbede44/0xfeec3c2dc5a4c5a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfb5 expref: 30 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.115488:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ebbede44/0xfeec3c2dc5a4c5a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfb5 expref: 30 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.115505:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc82a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827969024:192.168.204.16@tcp:105: 00000100:00100000:0.0:1784191893.115610:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9e180 going to sleep for 11 seconds 00000100:00100000:3.0:1784191893.118612:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc82a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827969024:192.168.204.16@tcp:105: 00010000:00010000:3.0:1784191893.118641:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191893.118756:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:69109:x1870858812427008:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3451us (3713us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191893.118770:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 179 00000100:00100000:3.0:1784191893.122817:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.122962:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812427264 00000100:00100000:1.0:1784191893.122973:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812427264 00000100:00100000:1.0:1784191893.123041:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 186 00000100:00100000:1.0:1784191893.123052:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105327c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+77:123690:x1870858812427264:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:1.0:1784191893.123392:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105327c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+78:123690:x1870858812427264:12345-192.168.204.16@tcp:35:cp.0 Request processed in 340us (583us total) trans 34359738752 rc 0/0 00000100:00100000:1.0:1784191893.123399:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 186 00000100:00100000:0.0:1784191893.135964:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.136307:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812427392 00000100:00100000:3.0:1784191893.136319:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812427392 00000100:00100000:2.0:1784191893.137675:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 665 00000100:00100000:2.0:1784191893.137721:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+78:123690:x1870858812427392:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.137769:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.137795:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c5aa lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bfbc expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.137879:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5b1 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.137898:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5b1 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.137910:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5b1 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.137925:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5b8 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.137932:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5b8 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.137938:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5b8 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.137977:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5b1 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.137983:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5b1 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.137989:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5b1 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.137995:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5b1 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.138007:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cda00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.138012:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5b1 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.138019:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5b1 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.138032:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.138034:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.138040:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5b1 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.138047:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5b1 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.138066:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5b8 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.138071:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5b8 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.138077:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5b8 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.138081:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2ccc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.138084:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5b8 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.138090:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5b8 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.138303:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x130f79e0 (ffff8af2047f9800) 00010000:00010000:2.0:1784191893.138305:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.138309:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5b8 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.138315:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5b8 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.138353:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c5aa lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfbc expref: 79 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.138379:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.138381:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.138385:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c5aa lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfbc expref: 79 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.138397:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cd600, rc 0) 00000100:00100000:2.0:1784191893.139992:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+78:123690:x1870858812427392:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2290us (4023us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191893.140005:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 665 00000100:00100000:1.0:1784191893.154429:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.154811:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812427520 00000100:00100000:3.0:1784191893.154824:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812427520 00000100:00100000:3.0:1784191893.154898:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 666 00000100:00100000:3.0:1784191893.154909:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+78:123690:x1870858812427520:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.154933:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.154958:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c5bf lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bfc3 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155026:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c5c6 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155040:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c5c6 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155050:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c5c6 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155066:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c5cd lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155074:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c5cd lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155080:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c5cd lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155141:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c5c6 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155149:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c5c6 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155155:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c5c6 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155162:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c5c6 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155168:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd69a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191893.155172:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c5c6 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155179:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c5c6 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155191:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191893.155194:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.155198:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c5c6 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155204:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c5c6 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155216:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c5cd lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155222:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c5cd lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155233:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c5cd lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155238:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191893.155240:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c5cd lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155245:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c5cd lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155252:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x130f79e0 (ffff8af215ff6f00) 00010000:00010000:3.0:1784191893.155254:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.155256:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c5cd lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155262:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c5cd lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155294:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c5bf lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfc3 expref: 79 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155304:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191893.155306:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.155309:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c5bf lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfc3 expref: 79 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.155317:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd68600, rc 0) 00000100:00100000:3.0:1784191893.155391:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+78:123690:x1870858812427520:12345-192.168.204.16@tcp:101:cp.0 Request processed in 484us (974us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191893.155407:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 666 00000100:00100000:3.0:1784191893.164094:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.164634:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812427776 00000100:00100000:2.0:1784191893.164645:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812427776 00000100:00100000:2.0:1784191893.164745:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 667 00000100:00100000:2.0:1784191893.164755:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+78:123690:x1870858812427776:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.164780:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.164812:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c5d4 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bfca expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.164940:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5db lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.164956:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5db lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.164967:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5db lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.164979:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5e2 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.164985:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5e2 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.164991:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5e2 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191893.165318:0:164531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1db:0x0], index 1: 0 00080000:00000400:2.0:1784191893.165333:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.165337:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.165339:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.165341:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.165343:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.165345:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191893.165363:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.165366:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.165368:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.165370:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.165372:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.165381:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191893.165419:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.165422:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.165424:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.165425:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.165427:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.165428:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191893.165541:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c5e9 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.165551:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c5e9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.165559:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c5e9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.165597:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5db lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.165605:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5db lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.165611:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5db lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.165618:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5db lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.165623:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2ccc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.165627:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5db lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.165635:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5db lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.165654:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.165657:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.165662:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5db lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.165669:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c5db lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191893.165684:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ac9d78ee reply state 00000000bde47d9a transno 34359738753 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5e2 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.165719:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.165725:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x130f79e0 (ffff8af2047f9800) 00010000:00010000:2.0:1784191893.165727:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191893.165730:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191893.165762:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c5d4 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfca expref: 81 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.165781:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c5e9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfca expref: 80 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.165789:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x33:0x0].0x0 (ffff8af2047f9900) 00010000:00010000:2.0:1784191893.165791:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191893.165793:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cc400, rc 0) 00000100:00100000:2.0:1784191893.165870:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+81:123690:x1870858812427776:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1116us (1787us total) trans 34359738753 rc 0/0 00000100:00100000:2.0:1784191893.165878:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 667 00000100:00100000:1.0:1784191893.176254:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.176346:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812427904 00000100:00100000:0.0:1784191893.176356:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812427904 00000100:00100000:0.0:1784191893.176421:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 352 00000100:00100000:0.0:1784191893.176433:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+29:69109:x1870858812427904:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.176453:0:162386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.176476:0:162386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009163203/0xfeec3c2dc5a4c5f7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bfd1 expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191893.176504:0:162386:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191893.176526:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1db:0x0].0x0 since=5513s v=(0 0) 00010000:00010000:0.0:1784191893.176541:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.176552:0:162386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009163203/0xfeec3c2dc5a4c5f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfd1 expref: 30 pid: 162386 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.176572:0:162386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009163203/0xfeec3c2dc5a4c5f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfd1 expref: 30 pid: 162386 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.176586:0:162386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874b200, rc 0) 00000100:00100000:0.0:1784191893.176661:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:69109:x1870858812427904:12345-192.168.204.16@tcp:101:cp.0 Request processed in 230us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191893.176668:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 352 00000100:00100000:3.0:1784191893.207432:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.207848:0:162390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812428032 00000100:00100000:0.0:1784191893.207858:0:162390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812428032 00000100:00100000:0.0:1784191893.207923:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 353 00000100:00100000:0.0:1784191893.207934:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:123690:x1870858812428032:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.207973:0:162390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.207994:0:162390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4c5fe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bfd8 expref: -99 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.208028:0:162390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009163203/0xfeec3c2dc5a4c5f7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfd1 expref: 31 pid: 162386 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.208038:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.208042:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.208049:0:162390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4c5fe lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfd8 expref: 31 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.208086:0:162390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009163203/0xfeec3c2dc5a4c5f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfd1 expref: 31 pid: 162386 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.208101:0:162390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009163203/0xfeec3c2dc5a4c5f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfd1 expref: 31 pid: 162386 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.208116:0:162390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:162390:1870858827969152:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191893.208211:0:162390:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1784191893.227988:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.228087:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812428160 00000100:00100000:1.0:1784191893.228097:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812428160 00010000:00010000:1.0:1784191893.228146:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009163203/0xfeec3c2dc5a4c5f7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfd1 expref: 32 pid: 162386 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191893.228196:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 180 00000100:00100000:1.0:1784191893.228208:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:69112:x1870858812428160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191893.228227:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191893.228251:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009163203/0xfeec3c2dc5a4c5f7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfd1 expref: 32 pid: 162386 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.228266:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009163203/0xfeec3c2dc5a4c5f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfd1 expref: 32 pid: 162386 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.228294:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191893.228317:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191893.228326:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4c5fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfd8 expref: 32 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.228337:0:158650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4c5fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfd8 expref: 32 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.228378:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4c5fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfd8 expref: 32 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191893.228395:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc65500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:158650:1870858827969280:192.168.204.16@tcp:105: 00000100:00100000:1.0:1784191893.228491:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e69e9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784191893.229310:0:162390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009163203/0xfeec3c2dc5a4c5f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfd1 expref: 32 pid: 162386 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.229328:0:162390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:162390:1870858827969152:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191893.229356:0:162390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4c5fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfd8 expref: 31 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.229379:0:162390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874b800, rc 0) 00000100:00100000:0.0:1784191893.229418:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:123690:x1870858812428032:12345-192.168.204.16@tcp:101:cp.0 Request processed in 21486us (21998us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191893.229427:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 353 00000100:00100000:1.0:1784191893.234992:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.235071:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812428416 00000100:00100000:2.0:1784191893.235081:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812428416 00000100:00100000:2.0:1784191893.235149:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 187 00000100:00100000:2.0:1784191893.235160:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+81:123690:x1870858812428416:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191893.235729:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+82:123690:x1870858812428416:12345-192.168.204.16@tcp:35:cp.0 Request processed in 568us (746us total) trans 34359738754 rc 0/0 00000100:00100000:2.0:1784191893.235738:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 187 00000100:00100000:0.0:1784191893.236197:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc65500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:158650:1870858827969280:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191893.236241:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191893.236276:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:69112:x1870858812428160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8071us (8299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191893.236284:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 180 00000100:00100000:3.0:1784191893.244635:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.246766:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812428544 00000100:00100000:2.0:1784191893.246786:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812428544 00000100:00100000:2.0:1784191893.246884:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 668 00000100:00100000:2.0:1784191893.246896:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+82:123690:x1870858812428544:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.246921:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.246949:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c605 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bfdf expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.247030:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c60c lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.247200:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c60c lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.247217:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c60c lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.247248:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c613 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.247257:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c613 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.247284:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c613 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.247333:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c60c lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.247341:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c60c lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.247347:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c60c lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.247354:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c60c lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.247360:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2ccc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.247364:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c60c lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.247370:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c60c lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.247383:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.247385:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.247390:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c60c lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.247396:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c60c lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.247413:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c613 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.247426:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c613 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.247432:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c613 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.247437:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cde00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.247441:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c613 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.247447:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c613 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.248344:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xc735cef4 (ffff8af2047f9c00) 00010000:00010000:2.0:1784191893.248350:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.248356:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c613 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.248363:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c613 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.248415:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c605 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfdf expref: 83 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.248427:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.248429:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.248433:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c605 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfdf expref: 83 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.248457:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cd600, rc 0) 00000100:00100000:2.0:1784191893.249990:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+82:123690:x1870858812428544:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3077us (5346us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191893.250009:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 668 00000100:00100000:0.0:1784191893.258869:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.258975:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812428672 00000100:00100000:2.0:1784191893.258985:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812428672 00000100:00100000:2.0:1784191893.259051:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 669 00000100:00100000:2.0:1784191893.259062:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+82:123690:x1870858812428672:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.259086:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.259107:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c61a lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bfe6 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259186:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c621 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259201:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c621 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259214:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c621 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259231:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c628 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259238:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c628 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259245:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c628 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259308:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c621 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259316:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c621 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259322:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c621 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259328:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c621 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259334:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cc200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.259339:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c621 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259346:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c621 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259358:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.259361:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.259365:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c621 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259371:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c621 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259385:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c628 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259392:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c628 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259406:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c628 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259411:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ea00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.259414:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c628 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259421:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c628 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259429:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xc735cef4 (ffff8af2047f9600) 00010000:00010000:2.0:1784191893.259432:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.259435:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c628 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259441:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c628 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259491:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c61a lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfe6 expref: 83 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259503:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.259505:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.259509:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c61a lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfe6 expref: 83 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.259519:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2ccc00, rc 0) 00000100:00100000:2.0:1784191893.259582:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+82:123690:x1870858812428672:12345-192.168.204.16@tcp:101:cp.0 Request processed in 521us (724us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191893.259599:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 669 00000100:00100000:1.0:1784191893.265719:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.265894:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812428928 00000100:00100000:0.0:1784191893.265905:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812428928 00000100:00100000:0.0:1784191893.265972:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 670 00000100:00100000:0.0:1784191893.265981:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+82:123690:x1870858812428928:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.266003:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.266034:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c62f lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bfed expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.266175:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4c636 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.266191:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4c636 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.266203:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4c636 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.266239:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4c63d lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.266248:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4c63d lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.266254:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4c63d lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191893.266587:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x25f:0x0], index 0: 0 00080000:00000400:0.0:1784191893.266600:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:0.0:1784191893.266603:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:0.0:1784191893.266606:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191893.266608:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191893.266611:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191893.266613:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191893.266627:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:0.0:1784191893.266630:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:0.0:1784191893.266631:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191893.266634:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191893.266636:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191893.266638:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191893.266663:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:0.0:1784191893.266665:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:0.0:1784191893.266667:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191893.266669:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191893.266671:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191893.266673:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191893.266807:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c644 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.266829:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c644 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.266837:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c644 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.266873:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4c636 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.266881:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4c636 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.266888:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4c636 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.266894:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4c636 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.266900:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874a200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191893.266903:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4c636 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.266911:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4c636 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.266923:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191893.266926:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.266930:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4c636 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.266936:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a200/0xfeec3c2dc5a4c636 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191893.266968:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bd2747c2 reply state 00000000c52af862 transno 34359738755 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4c63d lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.266979:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4c63d lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.266985:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xc735cef4 (ffff8af216687000) 00010000:00010000:0.0:1784191893.266987:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191893.266990:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191893.267019:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ba00/0xfeec3c2dc5a4c62f lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfed expref: 85 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.267032:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c644 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfed expref: 84 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.267039:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x34:0x0].0x0 (ffff8af216687f00) 00010000:00010000:0.0:1784191893.267042:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191893.267044:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874a800, rc 0) 00000100:00100000:0.0:1784191893.267129:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+85:123690:x1870858812428928:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1148us (1421us total) trans 34359738755 rc 0/0 00000100:00100000:0.0:1784191893.267137:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 670 00000100:00100000:0.0:1784191893.270734:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.270777:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812429056 00000100:00100000:2.0:1784191893.270790:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812429056 00000100:00100000:2.0:1784191893.270860:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 354 00000100:00100000:2.0:1784191893.270873:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:69112:x1870858812429056:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.270896:0:162391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.270921:0:162391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf3c24e7/0xfeec3c2dc5a4c652 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bff4 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191893.270953:0:162391:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191893.270978:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25f:0x0].0x0 since=5513s v=(0 0) 00010000:00010000:2.0:1784191893.270983:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.270994:0:162391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf3c24e7/0xfeec3c2dc5a4c652 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bff4 expref: 31 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.271014:0:162391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cf3c24e7/0xfeec3c2dc5a4c652 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bff4 expref: 31 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.271027:0:162391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7fc00, rc 0) 00000100:00100000:2.0:1784191893.271099:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:69112:x1870858812429056:12345-192.168.204.16@tcp:101:cp.0 Request processed in 229us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.271107:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 354 00000100:00100000:2.0:1784191893.280823:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.280884:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812429184 00000100:00100000:0.0:1784191893.280894:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812429184 00000100:00100000:0.0:1784191893.281001:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 355 00000100:00100000:0.0:1784191893.281014:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:123690:x1870858812429184:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.281037:0:162387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.281092:0:162387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d8b7604/0xfeec3c2dc5a4c659 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8bffb expref: -99 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.281148:0:162387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf3c24e7/0xfeec3c2dc5a4c652 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bff4 expref: 32 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.281159:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.281164:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.281169:0:162387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d8b7604/0xfeec3c2dc5a4c659 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bffb expref: 32 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.281204:0:162387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cf3c24e7/0xfeec3c2dc5a4c652 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bff4 expref: 32 pid: 162391 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.281218:0:162387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cf3c24e7/0xfeec3c2dc5a4c652 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bff4 expref: 32 pid: 162391 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.281243:0:162387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:162387:1870858827969408:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191893.281337:0:162387:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191893.288894:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.289964:0:162387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:162387:1870858827969408:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191893.290004:0:162387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d8b7604/0xfeec3c2dc5a4c659 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bffb expref: 32 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.290027:0:162387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874ba00, rc 0) 00000100:00100000:0.0:1784191893.290099:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:123690:x1870858812429184:12345-192.168.204.16@tcp:101:cp.0 Request processed in 9087us (9289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191893.290127:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 355 00000100:00100000:2.0:1784191893.292261:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812429312 00000100:00100000:2.0:1784191893.292277:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812429312 00010000:00010000:2.0:1784191893.292339:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cf3c24e7/0xfeec3c2dc5a4c652 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bff4 expref: 32 pid: 162391 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.292430:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 181 00000100:00100000:2.0:1784191893.292440:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23b101050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:69109:x1870858812429312:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191893.292455:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191893.292479:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cf3c24e7/0xfeec3c2dc5a4c652 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bff4 expref: 32 pid: 162391 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.292506:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cf3c24e7/0xfeec3c2dc5a4c652 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bff4 expref: 32 pid: 162391 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.292542:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf3c24e7/0xfeec3c2dc5a4c652 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bff4 expref: 32 pid: 162391 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.292559:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.292563:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.292572:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000d8b7604/0xfeec3c2dc5a4c659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bffb expref: 31 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.292582:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d8b7604/0xfeec3c2dc5a4c659 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bffb expref: 31 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.292623:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000d8b7604/0xfeec3c2dc5a4c659 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bffb expref: 31 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.292665:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827969536:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191893.292812:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cd2ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191893.304027:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.304088:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812429568 00000100:00100000:0.0:1784191893.304096:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812429568 00000100:00100000:0.0:1784191893.304155:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 188 00000100:00100000:0.0:1784191893.304166:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+85:123690:x1870858812429568:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:0.0:1784191893.304452:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+86:123690:x1870858812429568:12345-192.168.204.16@tcp:35:cp.0 Request processed in 287us (433us total) trans 34359738756 rc 0/0 00000100:00100000:0.0:1784191893.304460:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 188 00000100:00100000:0.0:1784191893.304640:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827969536:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191893.304661:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191893.304717:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23b101050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:69109:x1870858812429312:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 12278us (15837us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191893.304726:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 181 00000100:00100000:0.0:1784191893.307491:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.308165:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812429696 00000100:00100000:3.0:1784191893.308176:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812429696 00000100:00100000:1.0:1784191893.308274:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 671 00000100:00100000:1.0:1784191893.308287:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+86:123690:x1870858812429696:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191893.308317:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191893.308342:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c660 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c002 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308414:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c667 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308430:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c667 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308442:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c667 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308478:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c66e lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308485:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c66e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308785:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c66e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308839:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c667 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308845:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c667 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308851:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c667 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308857:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c667 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308863:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200031600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.308867:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c667 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308874:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c667 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308888:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.308891:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.308896:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c667 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308910:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c667 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308923:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c66e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308928:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c66e lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308933:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c66e lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308938:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.308940:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c66e lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308945:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c66e lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308952:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x21aa2247 (ffff8af20dabcf00) 00010000:00010000:1.0:1784191893.308954:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.308956:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c66e lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308961:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c66e lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.308995:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c660 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c002 expref: 87 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.309018:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.309020:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.309024:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c660 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c002 expref: 87 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.309033:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200030400, rc 0) 00000100:00100000:1.0:1784191893.309177:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+86:123690:x1870858812429696:12345-192.168.204.16@tcp:101:cp.0 Request processed in 893us (1694us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191893.309186:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 671 00000100:00100000:0.0:1784191893.315841:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.316036:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812429824 00000100:00100000:2.0:1784191893.316061:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812429824 00000100:00100000:2.0:1784191893.316152:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 672 00000100:00100000:2.0:1784191893.316164:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+86:123690:x1870858812429824:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.316189:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.316214:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4c675 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c009 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316293:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c67c lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316310:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c67c lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316323:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c67c lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316337:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c683 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316344:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c683 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316350:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c683 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316415:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c67c lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316422:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c67c lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316428:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c67c lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316435:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c67c lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316442:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ea00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.316447:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c67c lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316455:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c67c lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316469:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.316472:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.316477:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c67c lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316484:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c67c lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316498:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c683 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316505:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c683 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316519:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c683 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316524:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.316537:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c683 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316544:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c683 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316553:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x21aa2247 (ffff8af2047f9600) 00010000:00010000:2.0:1784191893.316555:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.316558:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c683 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316855:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c683 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316899:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4c675 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c009 expref: 87 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316910:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.316913:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.316917:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4c675 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c009 expref: 87 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.316927:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7fc00, rc 0) 00000100:00100000:2.0:1784191893.316992:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+86:123690:x1870858812429824:12345-192.168.204.16@tcp:101:cp.0 Request processed in 830us (1162us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191893.317008:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 672 00000100:00100000:0.0:1784191893.320420:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.320704:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812430080 00000100:00100000:2.0:1784191893.320716:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812430080 00000100:00100000:2.0:1784191893.320832:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 673 00000100:00100000:2.0:1784191893.320844:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+86:123690:x1870858812430080:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.320867:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.320896:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c68a lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c010 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.321023:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c691 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.321039:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c691 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.321058:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c691 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.321075:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c698 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.321082:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c698 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.321089:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c698 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191893.322565:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1dc:0x0], index 1: 0 00080000:00000400:2.0:1784191893.322589:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.322615:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.322617:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.322619:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.322622:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.322623:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191893.322644:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.322647:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.322649:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.322650:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.322653:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.322655:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191893.322702:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.322706:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.322708:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.322709:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.322711:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.322713:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191893.322833:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c69f lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.322848:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c69f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.322859:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c69f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.322895:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c691 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.322902:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c691 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.322908:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c691 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.322921:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c691 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.322927:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2ccc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.322930:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c691 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.322937:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c691 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.322955:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.322958:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.322962:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c691 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.322968:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2ccc00/0xfeec3c2dc5a4c691 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191893.322981:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002958b796 reply state 00000000f110bbab transno 34359738757 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c698 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.322990:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c698 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.322996:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x21aa2247 (ffff8af2047f9e00) 00010000:00010000:2.0:1784191893.322998:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191893.323001:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191893.323039:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c68a lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c010 expref: 89 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.323067:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c69f lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c010 expref: 88 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.323075:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x35:0x0].0x0 (ffff8af2047f9000) 00010000:00010000:2.0:1784191893.323077:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191893.323079:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cd600, rc 0) 00000100:00100000:2.0:1784191893.325389:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+89:123690:x1870858812430080:12345-192.168.204.16@tcp:101:cp.0 Request processed in 4530us (4964us total) trans 34359738757 rc 0/0 00000100:00100000:2.0:1784191893.325406:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 673 00000100:00100000:0.0:1784191893.329577:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.329761:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812430208 00000100:00100000:3.0:1784191893.329772:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812430208 00000100:00100000:3.0:1784191893.329830:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 356 00000100:00100000:3.0:1784191893.329841:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+30:69110:x1870858812430208:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.329863:0:161232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.329886:0:161232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4c6ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c017 expref: -99 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191893.329915:0:161232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784191893.329938:0:161232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1dc:0x0].0x0 since=5513s v=(0 0) 00010000:00010000:3.0:1784191893.329942:0:161232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.329951:0:161232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4c6ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c017 expref: 31 pid: 161232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.329968:0:161232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4c6ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c017 expref: 31 pid: 161232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.329980:0:161232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd68600, rc 0) 00000100:00100000:3.0:1784191893.330038:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:69110:x1870858812430208:12345-192.168.204.16@tcp:101:cp.0 Request processed in 198us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191893.330062:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 356 00000100:00100000:1.0:1784191893.339808:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.340364:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812430336 00000100:00100000:2.0:1784191893.340375:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812430336 00000100:00100000:2.0:1784191893.340484:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 357 00000100:00100000:2.0:1784191893.340495:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:123690:x1870858812430336:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.340517:0:162389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.340548:0:162389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a68f315/0xfeec3c2dc5a4c6b4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c01e expref: -99 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.340592:0:162389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4c6ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c017 expref: 32 pid: 161232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.340601:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.340606:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.340611:0:162389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a68f315/0xfeec3c2dc5a4c6b4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c01e expref: 32 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.340667:0:162389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4c6ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c017 expref: 32 pid: 161232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.340684:0:162389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4c6ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c017 expref: 32 pid: 161232 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.340726:0:162389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:162389:1870858827969664:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191893.340814:0:162389:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cd2fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784191893.347143:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.347234:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812430464 00000100:00100000:2.0:1784191893.347239:0:162389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:162389:1870858827969664:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191893.347244:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812430464 00010000:00010000:2.0:1784191893.347283:0:162389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a68f315/0xfeec3c2dc5a4c6b4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c01e expref: 33 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.347288:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4c6ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c017 expref: 33 pid: 161232 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.347316:0:162389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2ccc00, rc 0) 00000100:00100000:3.0:1784191893.347344:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 182 00000100:00100000:3.0:1784191893.347356:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:69112:x1870858812430464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191893.347373:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191893.347397:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4c6ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c017 expref: 33 pid: 161232 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.347414:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4c6ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c017 expref: 33 pid: 161232 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.347428:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:123690:x1870858812430336:12345-192.168.204.16@tcp:101:cp.0 Request processed in 6933us (7628us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.347439:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 357 00010000:00010000:3.0:1784191893.347444:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b11e744/0xfeec3c2dc5a4c6ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c017 expref: 33 pid: 161232 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.347471:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.347477:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.347488:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a68f315/0xfeec3c2dc5a4c6b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c01e expref: 31 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.347500:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a68f315/0xfeec3c2dc5a4c6b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c01e expref: 31 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.347573:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007a68f315/0xfeec3c2dc5a4c6b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c01e expref: 31 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191893.347587:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec87b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827969792:192.168.204.16@tcp:105: 00000100:00100000:3.0:1784191893.347645:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af205de4540 going to sleep for 11 seconds 00000100:00100000:1.0:1784191893.357659:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.357974:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812430720 00000100:00100000:0.0:1784191893.357985:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812430720 00000100:00100000:0.0:1784191893.358051:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 189 00000100:00100000:0.0:1784191893.358060:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+89:123690:x1870858812430720:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:0.0:1784191893.358567:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+90:123690:x1870858812430720:12345-192.168.204.16@tcp:35:cp.0 Request processed in 496us (909us total) trans 34359738758 rc 0/0 00000100:00100000:0.0:1784191893.358578:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 189 00000100:00100000:3.0:1784191893.358852:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec87b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827969792:192.168.204.16@tcp:105: 00010000:00010000:3.0:1784191893.358881:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191893.359805:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:69112:x1870858812430464:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 12445us (12668us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.359817:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 182 00000100:00100000:1.0:1784191893.363432:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.363601:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812430848 00000100:00100000:2.0:1784191893.363612:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812430848 00000100:00100000:2.0:1784191893.363890:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 674 00000100:00100000:2.0:1784191893.363903:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+90:123690:x1870858812430848:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.363961:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.363990:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c6bb lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c025 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364086:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c6c2 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364113:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c6c2 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364128:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c6c2 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364145:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4c6c9 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364152:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4c6c9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364159:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4c6c9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364209:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c6c2 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364216:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c6c2 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364222:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c6c2 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364229:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c6c2 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364243:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ec00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.364247:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c6c2 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364255:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c6c2 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364267:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.364270:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.364275:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c6c2 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364281:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c6c2 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364295:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4c6c9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364301:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4c6c9 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364307:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4c6c9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364313:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7fc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.364315:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4c6c9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364321:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4c6c9 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364341:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xbf580d0c (ffff8af2047f9600) 00010000:00010000:2.0:1784191893.364344:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.364347:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4c6c9 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364353:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4c6c9 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364388:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c6bb lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c025 expref: 91 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364406:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.364408:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.364411:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c6bb lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c025 expref: 91 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.364423:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cde00, rc 0) 00000100:00100000:2.0:1784191893.364502:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+90:123690:x1870858812430848:12345-192.168.204.16@tcp:101:cp.0 Request processed in 602us (1079us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191893.364510:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 674 00000100:00100000:1.0:1784191893.367627:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.367967:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812430976 00000100:00100000:2.0:1784191893.367978:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812430976 00000100:00100000:2.0:1784191893.368088:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 675 00000100:00100000:2.0:1784191893.368164:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+90:123690:x1870858812430976:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.368192:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.368219:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c6d0 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c02c expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368326:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c6d7 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368344:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c6d7 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368356:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c6d7 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368372:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c6de lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368378:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c6de lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368385:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c6de lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368435:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c6d7 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368444:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c6d7 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368463:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c6d7 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368469:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c6d7 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368476:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ea00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.368488:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c6d7 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368496:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c6d7 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368509:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.368512:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.368517:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c6d7 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368534:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c6d7 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368550:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c6de lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368555:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c6de lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368561:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c6de lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368566:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.368569:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c6de lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368574:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c6de lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368580:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xbf580d0c (ffff8af2047f9b00) 00010000:00010000:2.0:1784191893.368582:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.368592:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c6de lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368597:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c6de lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368633:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c6d0 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c02c expref: 91 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368643:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.368645:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.368649:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c6d0 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c02c expref: 91 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.368657:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f400, rc 0) 00000100:00100000:2.0:1784191893.368905:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+90:123690:x1870858812430976:12345-192.168.204.16@tcp:101:cp.0 Request processed in 744us (1290us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191893.368913:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 675 00000100:00100000:0.0:1784191893.373152:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.373250:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812431232 00000100:00100000:2.0:1784191893.373261:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812431232 00000100:00100000:2.0:1784191893.373355:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 676 00000100:00100000:2.0:1784191893.373365:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+90:123690:x1870858812431232:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.373388:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.373410:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4c6e5 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c033 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.373547:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4c6ec lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.373584:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4c6ec lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.373596:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4c6ec lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.373613:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4c6f3 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.373620:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4c6f3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.373627:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4c6f3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191893.374003:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x260:0x0], index 0: 0 00080000:00000400:2.0:1784191893.374016:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.374019:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.374021:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.374023:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.374025:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.374027:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191893.374043:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.374045:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.374047:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.374049:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.374051:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.374052:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191893.374081:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.374084:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.374085:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.374109:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.374111:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.374112:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191893.374215:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c6fa lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.374224:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c6fa lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.374231:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c6fa lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.374267:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4c6ec lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.374273:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4c6ec lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.374278:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4c6ec lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.374285:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4c6ec lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.374290:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.374295:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4c6ec lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.374303:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4c6ec lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.374315:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.374319:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.374331:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4c6ec lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.374338:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4c6ec lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191893.374351:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000084529346 reply state 00000000400bed16 transno 34359738759 ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4c6f3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.374363:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4c6f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.374370:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xbf580d0c (ffff8af2047f9100) 00010000:00010000:2.0:1784191893.374372:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191893.374375:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191893.374402:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8a00/0xfeec3c2dc5a4c6e5 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c033 expref: 93 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.374416:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c6fa lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c033 expref: 92 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.374423:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x36:0x0].0x0 (ffff8af2047f9600) 00010000:00010000:2.0:1784191893.374425:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191893.374428:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10f2cde00, rc 0) 00000100:00100000:2.0:1784191893.374497:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+93:123690:x1870858812431232:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1133us (1420us total) trans 34359738759 rc 0/0 00000100:00100000:2.0:1784191893.374504:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 676 00000100:00100000:3.0:1784191893.378027:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.378131:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812431360 00000100:00100000:0.0:1784191893.378141:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812431360 00000100:00100000:0.0:1784191893.378215:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 358 00000100:00100000:0.0:1784191893.378227:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:69111:x1870858812431360:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.378248:0:162396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.378272:0:162396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009163203/0xfeec3c2dc5a4c708 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c03a expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191893.378299:0:162396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x260:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191893.378321:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x260:0x0].0x0 since=5513s v=(0 0) 00010000:00010000:0.0:1784191893.378325:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x260:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.378335:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009163203/0xfeec3c2dc5a4c708 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c03a expref: 32 pid: 162396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.378351:0:162396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000009163203/0xfeec3c2dc5a4c708 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c03a expref: 32 pid: 162396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.378364:0:162396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874b200, rc 0) 00000100:00100000:0.0:1784191893.378426:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:69111:x1870858812431360:12345-192.168.204.16@tcp:101:cp.0 Request processed in 202us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191893.378433:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 358 00000100:00100000:1.0:1784191893.381481:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.381579:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812431488 00000100:00100000:0.0:1784191893.381591:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812431488 00000100:00100000:0.0:1784191893.381660:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 359 00000100:00100000:0.0:1784191893.381670:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:123690:x1870858812431488:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.381740:0:162395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.381762:0:162395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058b59712/0xfeec3c2dc5a4c70f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x260:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c041 expref: -99 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.381800:0:162395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000009163203/0xfeec3c2dc5a4c708 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x260:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c03a expref: 33 pid: 162396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.381808:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x260:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.381814:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x260:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.381819:0:162395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058b59712/0xfeec3c2dc5a4c70f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x260:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c041 expref: 33 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.381855:0:162395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000009163203/0xfeec3c2dc5a4c708 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x260:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c03a expref: 33 pid: 162396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.381870:0:162395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000009163203/0xfeec3c2dc5a4c708 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x260:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c03a expref: 33 pid: 162396 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.381885:0:162395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:162395:1870858827969920:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191893.381975:0:162395:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9e180 going to sleep for 11 seconds 00000100:00100000:1.0:1784191893.384929:0:162395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:162395:1870858827969920:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191893.384967:0:162395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000058b59712/0xfeec3c2dc5a4c70f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x260:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c041 expref: 33 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.384987:0:162395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874a200, rc 0) 00000100:00100000:1.0:1784191893.385055:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:123690:x1870858812431488:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3386us (3584us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191893.385065:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 359 00000100:00100000:3.0:1784191893.387019:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.387108:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812431616 00000100:00100000:0.0:1784191893.387119:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812431616 00010000:00010000:0.0:1784191893.387165:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000009163203/0xfeec3c2dc5a4c708 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x260:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c03a expref: 33 pid: 162396 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.387209:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 183 00000100:00100000:0.0:1784191893.387237:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:69109:x1870858812431616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191893.387254:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191893.387278:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000009163203/0xfeec3c2dc5a4c708 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x260:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c03a expref: 33 pid: 162396 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.387292:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000009163203/0xfeec3c2dc5a4c708 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x260:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c03a expref: 33 pid: 162396 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.387318:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009163203/0xfeec3c2dc5a4c708 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x260:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c03a expref: 33 pid: 162396 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.387333:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x260:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.387338:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x260:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.387347:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058b59712/0xfeec3c2dc5a4c70f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x260:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c041 expref: 32 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.387357:0:158650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058b59712/0xfeec3c2dc5a4c70f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x260:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c041 expref: 32 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.387395:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000058b59712/0xfeec3c2dc5a4c70f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x260:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c041 expref: 32 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.387410:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc65500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:158650:1870858827970048:192.168.204.16@tcp:105: 00000100:00100000:0.0:1784191893.387634:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9e780 going to sleep for 11 seconds 00000100:00100000:0.0:1784191893.397363:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc65500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:158650:1870858827970048:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191893.397411:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191893.397485:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:69109:x1870858812431616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 10249us (10475us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191893.397497:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 183 00000100:00100000:3.0:1784191893.398875:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.399007:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812431872 00000100:00100000:0.0:1784191893.399017:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812431872 00000100:00100000:0.0:1784191893.399074:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 190 00000100:00100000:0.0:1784191893.399085:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+93:123690:x1870858812431872:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:0.0:1784191893.399463:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+94:123690:x1870858812431872:12345-192.168.204.16@tcp:35:cp.0 Request processed in 380us (593us total) trans 34359738760 rc 0/0 00000100:00100000:0.0:1784191893.399472:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 190 00000100:00100000:3.0:1784191893.403082:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.403380:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812432000 00000100:00100000:2.0:1784191893.403390:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812432000 00000100:00100000:2.0:1784191893.403556:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 677 00000100:00100000:2.0:1784191893.403567:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+94:123690:x1870858812432000:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.403602:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.403622:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c716 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c048 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403682:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c71d lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403748:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c71d lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403761:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c71d lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403776:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c724 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403783:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c724 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403789:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c724 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403830:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c71d lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403837:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c71d lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403843:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c71d lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403850:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c71d lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403862:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ea00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.403867:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c71d lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403874:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c71d lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403886:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.403888:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.403892:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c71d lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403899:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c71d lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403912:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c724 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403918:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c724 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403924:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c724 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403929:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ec00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.403931:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c724 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403937:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c724 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403951:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe3541c1d (ffff8af2047f9b00) 00010000:00010000:2.0:1784191893.403954:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.403956:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c724 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403962:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c724 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.403991:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c716 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c048 expref: 95 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.404000:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.404001:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.404005:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c716 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c048 expref: 95 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.404013:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f400, rc 0) 00000100:00100000:2.0:1784191893.404074:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+94:123690:x1870858812432000:12345-192.168.204.16@tcp:101:cp.0 Request processed in 510us (1002us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191893.404082:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 677 00000100:00100000:1.0:1784191893.406839:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.407440:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812432128 00000100:00100000:0.0:1784191893.407510:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812432128 00000100:00100000:0.0:1784191893.407598:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 678 00000100:00100000:0.0:1784191893.407608:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+94:123690:x1870858812432128:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.407630:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.407654:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4c72b lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c04f expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.407821:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4c732 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.407837:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4c732 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.407847:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4c732 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.407886:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127200/0xfeec3c2dc5a4c739 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.407892:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127200/0xfeec3c2dc5a4c739 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.407899:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127200/0xfeec3c2dc5a4c739 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.407945:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4c732 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.407951:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4c732 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.407957:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4c732 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.407963:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4c732 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.407968:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191893.407972:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4c732 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.407979:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4c732 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.407991:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191893.407993:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.407997:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4c732 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.408010:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4c732 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.408025:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127200/0xfeec3c2dc5a4c739 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.408031:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127200/0xfeec3c2dc5a4c739 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.408036:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127200/0xfeec3c2dc5a4c739 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.408040:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191893.408043:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127200/0xfeec3c2dc5a4c739 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.408048:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127200/0xfeec3c2dc5a4c739 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.408055:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe3541c1d (ffff8af216687800) 00010000:00010000:0.0:1784191893.408057:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.408060:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127200/0xfeec3c2dc5a4c739 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.408064:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127200/0xfeec3c2dc5a4c739 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.408432:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4c72b lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c04f expref: 95 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.408532:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191893.408535:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.408540:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4c72b lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c04f expref: 95 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.408550:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10874b200, rc 0) 00000100:00100000:0.0:1784191893.408660:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+94:123690:x1870858812432128:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1052us (1832us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191893.408668:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 678 00000100:00100000:0.0:1784191893.412398:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.412554:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812432384 00000100:00100000:2.0:1784191893.412567:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812432384 00000100:00100000:2.0:1784191893.412678:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 679 00000100:00100000:2.0:1784191893.412913:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+94:123690:x1870858812432384:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.412937:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.412959:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c740 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c056 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.413187:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c747 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.413204:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c747 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.413216:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c747 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.413232:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c74e lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.413239:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c74e lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.413245:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c74e lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191893.413645:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1dd:0x0], index 1: 0 00080000:00000400:2.0:1784191893.413658:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.413662:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.413664:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.413667:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.413669:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.413672:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191893.413918:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.413922:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.413924:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.413926:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.413928:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.413939:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191893.413980:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.413983:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.413985:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.413987:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.413989:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.413991:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191893.414236:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4c755 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.414251:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4c755 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.414260:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4c755 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.414299:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c747 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.414306:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c747 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.414313:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c747 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.414319:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c747 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.414326:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ec00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.414330:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c747 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.414338:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c747 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.414359:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.414361:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.414366:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c747 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.414373:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c747 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191893.414387:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bcbe4b3d reply state 00000000ebfe6554 transno 34359738761 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c74e lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.414397:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c74e lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.414403:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe3541c1d (ffff8af2047f9b00) 00010000:00010000:2.0:1784191893.414406:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191893.414409:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191893.414535:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c740 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c056 expref: 97 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.414555:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4c755 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c056 expref: 96 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.414563:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x37:0x0].0x0 (ffff8af2047f9200) 00010000:00010000:2.0:1784191893.414565:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191893.414567:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7fc00, rc 0) 00000100:00100000:2.0:1784191893.414886:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+97:123690:x1870858812432384:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2196us (2496us total) trans 34359738761 rc 0/0 00000100:00100000:2.0:1784191893.414895:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 679 00000100:00100000:0.0:1784191893.418618:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.418903:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812432512 00000100:00100000:1.0:1784191893.418932:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812432512 00000100:00100000:1.0:1784191893.418996:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 360 00000100:00100000:1.0:1784191893.419008:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+31:69110:x1870858812432512:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191893.419029:0:162386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191893.419054:0:162386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c763 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c05d expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784191893.419081:0:162386:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191893.419115:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1dd:0x0].0x0 since=5513s v=(0 0) 00010000:00010000:1.0:1784191893.419120:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191893.419130:0:162386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c763 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c05d expref: 32 pid: 162386 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.419147:0:162386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c763 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c05d expref: 32 pid: 162386 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.419162:0:162386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200030200, rc 0) 00000100:00100000:1.0:1784191893.419222:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:69110:x1870858812432512:12345-192.168.204.16@tcp:101:cp.0 Request processed in 217us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191893.419230:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 360 00000100:00100000:1.0:1784191893.422629:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.422741:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812432640 00000100:00100000:2.0:1784191893.422752:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812432640 00000100:00100000:2.0:1784191893.422802:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 361 00000100:00100000:2.0:1784191893.422811:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:123690:x1870858812432640:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.422832:0:162394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.422852:0:162394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c6d270f/0xfeec3c2dc5a4c76a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c064 expref: -99 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.422880:0:162394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c763 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c05d expref: 33 pid: 162386 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.422890:0:162394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.422894:0:162394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.422899:0:162394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c6d270f/0xfeec3c2dc5a4c76a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c064 expref: 33 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.422930:0:162394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c763 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c05d expref: 33 pid: 162386 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.422944:0:162394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c763 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c05d expref: 33 pid: 162386 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.422958:0:162394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:162394:1870858827970176:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191893.423029:0:162394:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cd2fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191893.426047:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.426147:0:162394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:162394:1870858827970176:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191893.426183:0:162394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c6d270f/0xfeec3c2dc5a4c76a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c064 expref: 33 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.426222:0:162394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8a00, rc 0) 00000100:00100000:2.0:1784191893.426291:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:123690:x1870858812432640:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3479us (3772us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.426301:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 361 00000100:00100000:1.0:1784191893.426747:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812432768 00000100:00100000:1.0:1784191893.426757:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812432768 00010000:00010000:1.0:1784191893.426794:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c763 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c05d expref: 33 pid: 162386 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191893.426826:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 184 00000100:00100000:1.0:1784191893.426843:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:69111:x1870858812432768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191893.426857:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191893.426879:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c763 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c05d expref: 33 pid: 162386 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.426892:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c763 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c05d expref: 33 pid: 162386 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.426914:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085c69adb/0xfeec3c2dc5a4c763 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c05d expref: 33 pid: 162386 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.426927:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191893.426931:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191893.426940:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c6d270f/0xfeec3c2dc5a4c76a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c064 expref: 32 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.426950:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c6d270f/0xfeec3c2dc5a4c76a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c064 expref: 32 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.426985:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002c6d270f/0xfeec3c2dc5a4c76a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c064 expref: 32 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191893.426999:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c7bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827970304:192.168.204.16@tcp:105: 00000100:00100000:1.0:1784191893.427067:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e69e300 going to sleep for 11 seconds 00000100:00100000:1.0:1784191893.431958:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c7bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827970304:192.168.204.16@tcp:105: 00010000:00010000:1.0:1784191893.432006:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191893.432068:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:69111:x1870858812432768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5225us (6029us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191893.432079:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 184 00000100:00100000:0.0:1784191893.436782:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.436914:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812433024 00000100:00100000:3.0:1784191893.436924:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812433024 00000100:00100000:3.0:1784191893.436989:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 191 00000100:00100000:3.0:1784191893.437000:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+97:123690:x1870858812433024:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191893.437348:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+98:123690:x1870858812433024:12345-192.168.204.16@tcp:35:cp.0 Request processed in 348us (575us total) trans 34359738762 rc 0/0 00000100:00100000:3.0:1784191893.437355:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 191 00000100:00100000:0.0:1784191893.441003:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.441191:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812433152 00000100:00100000:1.0:1784191893.441201:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812433152 00000100:00100000:1.0:1784191893.441271:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 680 00000100:00100000:1.0:1784191893.441281:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+98:123690:x1870858812433152:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191893.441306:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191893.441328:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c771 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c06b expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441391:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c778 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441405:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c778 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441417:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c778 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441432:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c77f lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441438:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c77f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441445:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c77f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441518:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c778 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441535:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c778 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441541:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c778 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441548:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c778 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441554:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.441559:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c778 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441566:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c778 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441579:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.441582:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.441586:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c778 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441592:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c778 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441606:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c77f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441612:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c77f lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441625:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c77f lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441629:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200031600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.441632:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c77f lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441637:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c77f lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441645:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x89d48c8d (ffff8af20dabc700) 00010000:00010000:1.0:1784191893.441647:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.441649:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c77f lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.441654:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c77f lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.442011:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c771 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c06b expref: 99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.442025:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.442027:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.442032:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c771 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c06b expref: 99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.442041:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200030200, rc 0) 00000100:00100000:1.0:1784191893.442104:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+98:123690:x1870858812433152:12345-192.168.204.16@tcp:101:cp.0 Request processed in 824us (1111us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191893.442122:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 680 00000100:00100000:0.0:1784191893.444965:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.445145:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812433280 00000100:00100000:1.0:1784191893.445156:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812433280 00000100:00100000:1.0:1784191893.445221:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 681 00000100:00100000:1.0:1784191893.445232:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+98:123690:x1870858812433280:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191893.445256:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191893.445279:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c786 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c072 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445353:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c78d lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445367:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c78d lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445379:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c78d lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445394:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c794 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445401:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c794 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445407:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c794 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445448:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c78d lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445489:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c78d lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445495:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c78d lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445501:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c78d lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445507:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.445512:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c78d lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445520:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c78d lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445543:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.445547:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.445552:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c78d lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445561:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c78d lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445574:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c794 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445580:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c794 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445585:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c794 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445597:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200031a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.445600:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c794 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445605:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c794 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445613:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x89d48c8d (ffff8af20dabc300) 00010000:00010000:1.0:1784191893.445616:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.445618:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c794 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445625:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c794 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445665:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c786 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c072 expref: 99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445675:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.445677:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.445680:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c786 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c072 expref: 99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.445723:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200030e00, rc 0) 00000100:00100000:1.0:1784191893.445783:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+98:123690:x1870858812433280:12345-192.168.204.16@tcp:101:cp.0 Request processed in 553us (831us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191893.445789:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 681 00000100:00100000:0.0:1784191893.449146:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.449258:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812433536 00000100:00100000:3.0:1784191893.449271:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812433536 00000100:00100000:3.0:1784191893.449342:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 682 00000100:00100000:3.0:1784191893.449353:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+98:123690:x1870858812433536:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.449376:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.449404:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c79b lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c079 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.449583:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7a2 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.449598:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7a2 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.449610:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7a2 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.449626:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c7a9 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.449632:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c7a9 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.449637:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c7a9 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191893.450087:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x261:0x0], index 0: 0 00080000:00000400:3.0:1784191893.450117:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191893.450121:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191893.450123:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191893.450125:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191893.450127:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191893.450129:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191893.450148:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191893.450151:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191893.450153:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191893.450155:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191893.450157:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191893.450168:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191893.450207:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191893.450210:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191893.450212:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191893.450213:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191893.450215:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191893.450217:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191893.450334:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68c00/0xfeec3c2dc5a4c7b0 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.450345:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68c00/0xfeec3c2dc5a4c7b0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.450352:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68c00/0xfeec3c2dc5a4c7b0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.450391:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7a2 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.450398:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7a2 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.450403:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7a2 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.450409:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7a2 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.450415:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191893.450419:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7a2 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.450426:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7a2 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.450447:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191893.450450:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.450456:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7a2 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.450461:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7a2 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191893.450474:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000083bb3a90 reply state 00000000ba4c2bd1 transno 34359738763 ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c7a9 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.450483:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c7a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.450488:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x89d48c8d (ffff8af215ff6600) 00010000:00010000:3.0:1784191893.450490:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191893.450493:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784191893.450536:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c79b lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c079 expref: 101 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.450553:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68c00/0xfeec3c2dc5a4c7b0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c079 expref: 100 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.450560:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x38:0x0].0x0 (ffff8af215ff6800) 00010000:00010000:3.0:1784191893.450562:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784191893.450564:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd68c00, rc 0) 00000100:00100000:3.0:1784191893.450631:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+101:123690:x1870858812433536:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1280us (1499us total) trans 34359738763 rc 0/0 00000100:00100000:3.0:1784191893.450639:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 682 00000100:00100000:0.0:1784191893.454930:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.455038:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812433664 00000100:00100000:3.0:1784191893.455048:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812433664 00000100:00100000:3.0:1784191893.455339:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 362 00000100:00100000:3.0:1784191893.455352:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:69111:x1870858812433664:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.455373:0:162398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.455396:0:162398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca579565/0xfeec3c2dc5a4c7be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c080 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191893.455423:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x261:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784191893.455442:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x261:0x0].0x0 since=5513s v=(0 0) 00010000:00010000:3.0:1784191893.455559:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x261:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.455570:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca579565/0xfeec3c2dc5a4c7be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c080 expref: 33 pid: 162398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.455589:0:162398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ca579565/0xfeec3c2dc5a4c7be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c080 expref: 33 pid: 162398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.455603:0:162398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd68e00, rc 0) 00000100:00100000:3.0:1784191893.455844:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:69111:x1870858812433664:12345-192.168.204.16@tcp:101:cp.0 Request processed in 495us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191893.455852:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 362 00000100:00100000:0.0:1784191893.466327:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.466409:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812433792 00000100:00100000:3.0:1784191893.466420:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812433792 00000100:00100000:3.0:1784191893.466487:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 363 00000100:00100000:3.0:1784191893.466499:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:123690:x1870858812433792:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.466518:0:160165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.466564:0:160165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4c7c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x261:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c087 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.466598:0:160165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca579565/0xfeec3c2dc5a4c7be lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x261:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c080 expref: 34 pid: 162398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.466608:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x261:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.466613:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x261:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.466619:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4c7c5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x261:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c087 expref: 34 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.466657:0:160165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca579565/0xfeec3c2dc5a4c7be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x261:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c080 expref: 34 pid: 162398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.466673:0:160165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca579565/0xfeec3c2dc5a4c7be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x261:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c080 expref: 34 pid: 162398 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191893.466779:0:160165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:160165:1870858827970432:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191893.466897:0:160165:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af21704e900 going to sleep for 11 seconds 00000100:00100000:3.0:1784191893.471517:0:160165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:160165:1870858827970432:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191893.471577:0:160165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4c7c5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x261:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c087 expref: 34 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.471601:0:160165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd68000, rc 0) 00000100:00100000:0.0:1784191893.472058:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.472350:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812433920 00000100:00100000:3.0:1784191893.472359:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812433920 00010000:00010000:3.0:1784191893.472418:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca579565/0xfeec3c2dc5a4c7be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x261:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c080 expref: 35 pid: 162398 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191893.472458:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 185 00000100:00100000:3.0:1784191893.472469:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:69110:x1870858812433920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191893.472485:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191893.472510:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca579565/0xfeec3c2dc5a4c7be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x261:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c080 expref: 35 pid: 162398 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.472536:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca579565/0xfeec3c2dc5a4c7be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x261:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c080 expref: 35 pid: 162398 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.472562:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca579565/0xfeec3c2dc5a4c7be lrc: 0/0,0 mode: --/PR res: [0x280000401:0x261:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c080 expref: 35 pid: 162398 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.472577:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x261:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.472583:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x261:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.472592:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4c7c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x261:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c087 expref: 34 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.472602:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4c7c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x261:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c087 expref: 34 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.472641:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4c7c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x261:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c087 expref: 34 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191893.472670:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827970560:192.168.204.16@tcp:105: 00000100:00100000:3.0:1784191893.472794:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af21704e900 going to sleep for 11 seconds 00000100:00100000:0.0:1784191893.473641:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+34:123690:x1870858812433792:12345-192.168.204.16@tcp:101:cp.0 Request processed in 7139us (7320us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191893.473651:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 363 00000100:00100000:0.0:1784191893.477605:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.478028:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812434176 00000100:00100000:1.0:1784191893.478054:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812434176 00000100:00100000:1.0:1784191893.478120:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 192 00000100:00100000:1.0:1784191893.478131:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105325c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+101:123690:x1870858812434176:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:1.0:1784191893.478460:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105325c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+102:123690:x1870858812434176:12345-192.168.204.16@tcp:35:cp.0 Request processed in 329us (865us total) trans 34359738764 rc 0/0 00000100:00100000:1.0:1784191893.478468:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 192 00000100:00100000:3.0:1784191893.481913:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827970560:192.168.204.16@tcp:105: 00010000:00010000:3.0:1784191893.481947:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191893.482203:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:69110:x1870858812433920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 9733us (10144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.482215:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 185 00000100:00100000:0.0:1784191893.482369:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.483406:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812434304 00000100:00100000:3.0:1784191893.483415:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812434304 00000100:00100000:3.0:1784191893.483653:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 683 00000100:00100000:3.0:1784191893.483663:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+102:123690:x1870858812434304:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.483887:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.483953:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4c7cc lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c08e expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484021:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c7d3 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484038:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c7d3 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484051:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c7d3 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484067:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c7da lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484074:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c7da lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484081:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c7da lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484154:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c7d3 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484161:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c7d3 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484168:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c7d3 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484175:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c7d3 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484182:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.484187:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c7d3 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484194:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c7d3 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484206:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.484209:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.484213:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c7d3 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484219:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4c7d3 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484231:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c7da lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484237:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c7da lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484250:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c7da lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484256:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.484259:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c7da lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484265:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c7da lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484273:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xa38d6329 (ffff8af2047f9300) 00010000:00010000:2.0:1784191893.484276:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.484279:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c7da lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484284:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4c7da lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484320:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4c7cc lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c08e expref: 103 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484331:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.484333:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.484336:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4c7cc lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c08e expref: 103 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.484346:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9000, rc 0) 00000100:00100000:2.0:1784191893.484470:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+102:123690:x1870858812434304:12345-192.168.204.16@tcp:101:cp.0 Request processed in 808us (2102us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191893.484485:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 683 00000100:00100000:0.0:1784191893.488054:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.488341:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812434432 00000100:00100000:3.0:1784191893.488353:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812434432 00000100:00100000:3.0:1784191893.488457:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 684 00000100:00100000:3.0:1784191893.488467:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+102:123690:x1870858812434432:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.488494:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.488517:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c7e1 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c095 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488605:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c7e8 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488620:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c7e8 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488632:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c7e8 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488658:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7ef lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488666:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7ef lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488673:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7ef lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488755:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c7e8 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488763:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c7e8 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488770:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c7e8 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488776:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c7e8 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488781:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191893.488785:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c7e8 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488791:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c7e8 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488801:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191893.488805:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.488810:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c7e8 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488824:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c7e8 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488837:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7ef lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488843:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7ef lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488849:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7ef lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488854:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191893.488857:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7ef lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488864:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7ef lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488872:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xa38d6329 (ffff8af233110200) 00010000:00010000:3.0:1784191893.488874:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.488877:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7ef lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488882:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c7ef lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488918:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c7e1 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c095 expref: 103 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488940:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191893.488942:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.488946:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68e00/0xfeec3c2dc5a4c7e1 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c095 expref: 103 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.488955:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd68e00, rc 0) 00000100:00100000:3.0:1784191893.489037:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+102:123690:x1870858812434432:12345-192.168.204.16@tcp:101:cp.0 Request processed in 571us (997us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191893.489045:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 684 00000100:00100000:1.0:1784191893.493010:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.493232:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812434688 00000100:00100000:2.0:1784191893.493244:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812434688 00000100:00100000:2.0:1784191893.493357:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 685 00000100:00100000:2.0:1784191893.493368:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+102:123690:x1870858812434688:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.493397:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.493422:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c7f6 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c09c expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.493566:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4c7fd lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.493583:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4c7fd lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.493595:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4c7fd lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.493610:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d800/0xfeec3c2dc5a4c804 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.493617:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d800/0xfeec3c2dc5a4c804 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.493625:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d800/0xfeec3c2dc5a4c804 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191893.494365:0:164531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1de:0x0], index 1: 0 00080000:00000400:2.0:1784191893.494380:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.494393:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.494396:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.494397:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.494399:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.494401:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191893.494421:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.494425:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.494426:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.494428:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.494430:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.494432:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191893.494961:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191893.494966:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191893.494968:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191893.494969:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191893.494971:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191893.494973:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191893.495118:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c80b lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.495133:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c80b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.495143:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c80b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.495177:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4c7fd lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.495184:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4c7fd lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.495190:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4c7fd lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.495211:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4c7fd lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.495216:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7ca00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.495221:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4c7fd lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.495229:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4c7fd lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.495243:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.495247:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.495252:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4c7fd lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.495259:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4c7fd lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191893.495276:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049d65773 reply state 000000005b4cf440 transno 34359738765 ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d800/0xfeec3c2dc5a4c804 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.495286:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d800/0xfeec3c2dc5a4c804 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.495291:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xa38d6329 (ffff8af2047f9700) 00010000:00010000:1.0:1784191893.495294:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191893.495296:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191893.495334:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4c7f6 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c09c expref: 105 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.495364:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c80b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c09c expref: 104 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.495371:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x39:0x0].0x0 (ffff8af20dabc300) 00010000:00010000:1.0:1784191893.495373:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191893.495375:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200031600, rc 0) 00000100:00100000:1.0:1784191893.495968:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+105:123690:x1870858812434688:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2598us (2967us total) trans 34359738765 rc 0/0 00000100:00100000:1.0:1784191893.495977:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 685 00000100:00100000:1.0:1784191893.501205:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.501328:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812434816 00000100:00100000:3.0:1784191893.501341:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812434816 00000100:00100000:3.0:1784191893.501403:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 364 00000100:00100000:3.0:1784191893.501414:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+32:69110:x1870858812434816:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.501437:0:161232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.501471:0:161232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c819 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c0a3 expref: -99 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191893.501498:0:161232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784191893.501532:0:161232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1de:0x0].0x0 since=5513s v=(0 0) 00010000:00010000:3.0:1784191893.501538:0:161232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.501550:0:161232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c819 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0a3 expref: 33 pid: 161232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.501570:0:161232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c819 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0a3 expref: 33 pid: 161232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.501614:0:161232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd68800, rc 0) 00000100:00100000:3.0:1784191893.501738:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:69110:x1870858812434816:12345-192.168.204.16@tcp:101:cp.0 Request processed in 325us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191893.501744:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 364 00000100:00100000:0.0:1784191893.506609:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.507254:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812434944 00000100:00100000:2.0:1784191893.507267:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812434944 00000100:00100000:0.0:1784191893.507510:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 365 00000100:00100000:0.0:1784191893.507533:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:123690:x1870858812434944:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.507554:0:160163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.507576:0:160163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a09c1cad/0xfeec3c2dc5a4c820 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c0aa expref: -99 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.507610:0:160163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c819 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0a3 expref: 34 pid: 161232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.507619:0:160163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.507624:0:160163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.507629:0:160163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a09c1cad/0xfeec3c2dc5a4c820 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->118783] (req 0->118783) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0aa expref: 34 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.507665:0:160163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c819 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0a3 expref: 34 pid: 161232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.507682:0:160163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c819 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0a3 expref: 34 pid: 161232 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.510051:0:160163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:160163:1870858827970688:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191893.514040:0:160163:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9e780 going to sleep for 11 seconds 00000100:00100000:1.0:1784191893.514937:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.515042:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812435072 00000100:00100000:2.0:1784191893.515053:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812435072 00010000:00010000:2.0:1784191893.515113:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c819 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0a3 expref: 35 pid: 161232 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.515159:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 186 00000100:00100000:2.0:1784191893.515169:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:69111:x1870858812435072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191893.515188:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191893.515216:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c819 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0a3 expref: 35 pid: 161232 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.515232:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c819 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0a3 expref: 35 pid: 161232 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.515260:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.515264:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.515294:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a09c1cad/0xfeec3c2dc5a4c820 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0aa expref: 35 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.515306:0:158650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a09c1cad/0xfeec3c2dc5a4c820 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0aa expref: 35 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.515348:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a09c1cad/0xfeec3c2dc5a4c820 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0aa expref: 35 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.515363:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:158650:1870858827970816:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191893.515455:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cd2f540 going to sleep for 11 seconds 00000100:00100000:3.0:1784191893.516976:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827970944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784191893.517042:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191893.517157:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827970944 00000100:00100000:1.0:1784191893.517165:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827970944 00000100:00100000:1.0:1784191893.517226:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1784191893.517237:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827970944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784191893.517280:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42676224 avail 36544512 00000100:00100000:1.0:1784191893.517336:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858827970944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191893.517344:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1784191893.517395:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827970944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784191893.522987:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:158650:1870858827970816:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191893.523019:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191893.523097:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:69111:x1870858812435072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7921us (8159us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.523110:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 186 00010000:00010000:0.0:1784191893.524903:0:160163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e62f0f59/0xfeec3c2dc5a4c819 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0a3 expref: 34 pid: 161232 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.524963:0:160163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:160163:1870858827970688:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191893.525004:0:160163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a09c1cad/0xfeec3c2dc5a4c820 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0aa expref: 33 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.525021:0:160163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233127e00, rc 0) 00000100:00100000:0.0:1784191893.525102:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:123690:x1870858812434944:12345-192.168.204.16@tcp:101:cp.0 Request processed in 17574us (18496us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191893.525110:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 365 00000100:00100000:2.0:1784191893.525600:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827971072:0@lo:400:kworker.0 00000100:00100000:2.0:1784191893.525661:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191893.525736:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858827971584:0@lo:400:kworker.0 00000100:00100000:2.0:1784191893.525766:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191893.525793:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784191893.525798:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858827971456:0@lo:400:kworker.0 00000100:00100000:2.0:1784191893.525819:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191893.525835:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858827971968:0@lo:400:kworker.0 00000100:00100000:2.0:1784191893.525854:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191893.525895:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827971584 00000100:00100000:2.0:1784191893.525902:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827971584 00000100:00100000:2.0:1784191893.525953:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827971456 00000100:00100000:2.0:1784191893.525956:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827971456 00000100:00100000:2.0:1784191893.525975:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827971968 00000100:00100000:2.0:1784191893.525977:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827971968 00000100:00100000:2.0:1784191893.525992:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1784191893.526001:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858827971584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191893.526056:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858827971584:12345-0@lo:400:kworker.0 Request processed in 55us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.526062:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1784191893.526076:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1784191893.526083:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858827971456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191893.526132:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858827971456:12345-0@lo:400:kworker.0 Request processed in 49us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.526139:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1784191893.526150:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1784191893.526156:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858827971968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191893.526182:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858827971968:12345-0@lo:400:kworker.0 Request processed in 26us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.526187:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1784191893.526223:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858827971456:0@lo:400:kworker.0 00000100:00100000:2.0:1784191893.526233:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858827971968:0@lo:400:kworker.0 00000100:00100000:2.0:1784191893.526241:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858827971584:0@lo:400:kworker.0 00000100:00100000:3.0:1784191893.526861:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827971072 00000100:00100000:3.0:1784191893.526870:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827971072 00000100:00100000:3.0:1784191893.526915:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1784191893.526921:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106500:x1870858827971072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191893.526982:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106500:x1870858827971072:12345-0@lo:400:kworker.0 Request processed in 61us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191893.526989:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1784191893.527030:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827971072:0@lo:400:kworker.0 00000100:00100000:0.0:1784191893.530480:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858827971328:0@lo:400:kworker.0 00000100:00100000:0.0:1784191893.530590:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191893.530650:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858827971840:0@lo:400:kworker.0 00000100:00100000:0.0:1784191893.530677:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191893.530739:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784191893.530747:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827971200:0@lo:400:kworker.0 00000100:00100000:0.0:1784191893.530777:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191893.530798:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858827971712:0@lo:400:kworker.0 00000100:00100000:0.0:1784191893.530821:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191893.530862:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827971200 00000100:00100000:0.0:1784191893.530870:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827971200 00000100:00100000:0.0:1784191893.530933:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1784191893.530943:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827971200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191893.531001:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858827971200:12345-0@lo:400:kworker.0 Request processed in 59us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191893.531028:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1784191893.531068:0:106502:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836548 gen 2 00000100:00100000:0.0:1784191893.531089:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827971200:0@lo:400:kworker.0 00000100:00100000:2.0:1784191893.531744:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827971328 00000100:00100000:2.0:1784191893.531752:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827971328 00000100:00100000:2.0:1784191893.531807:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827971840 00000100:00100000:2.0:1784191893.531811:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827971840 00000100:00100000:2.0:1784191893.531829:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827971712 00000100:00100000:2.0:1784191893.531831:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827971712 00000100:00100000:2.0:1784191893.531847:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1784191893.531853:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858827971328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191893.531910:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858827971328:12345-0@lo:400:kworker.0 Request processed in 57us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.531917:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1784191893.531932:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1784191893.531938:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858827971840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191893.531966:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858827971840:12345-0@lo:400:kworker.0 Request processed in 28us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.531971:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1784191893.531982:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1784191893.531987:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858827971712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191893.532013:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858827971712:12345-0@lo:400:kworker.0 Request processed in 26us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.532018:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1784191893.532429:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858827971712:0@lo:400:kworker.0 00000100:00100000:0.0:1784191893.532442:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858827971328:0@lo:400:kworker.0 00000100:00100000:0.0:1784191893.532467:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858827971840:0@lo:400:kworker.0 00000100:00080000:1.0:1784191893.532681:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784191893.532973:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784191893.532977:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784191893.533365:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.533534:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812435328 00000100:00100000:3.0:1784191893.533543:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812435328 00000100:00100000:3.0:1784191893.533633:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 193 00000100:00100000:3.0:1784191893.533652:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+105:123690:x1870858812435328:12345-192.168.204.16@tcp:35:cp.0 00000001:00080000:3.0:1784191893.534167:0:158669:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 34359738766 00000100:00100000:3.0:1784191893.534284:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+107:123690:x1870858812435328:12345-192.168.204.16@tcp:35:cp.0 Request processed in 631us (920us total) trans 34359738767 rc 0/0 00000100:00100000:3.0:1784191893.534292:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 193 00000020:00080000:3.0:1784191893.534296:0:158669:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784191893.538210:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.538341:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812435456 00000100:00100000:2.0:1784191893.538353:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812435456 00000100:00100000:2.0:1784191893.538461:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 686 00000100:00100000:2.0:1784191893.538472:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+107:123690:x1870858812435456:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.538501:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.538532:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4c827 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c0b1 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538619:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c82e lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538632:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c82e lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538644:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c82e lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538657:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c835 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538662:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c835 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538668:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c835 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538751:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c82e lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538759:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c82e lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538766:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c82e lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538773:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c82e lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538779:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7d000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.538791:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c82e lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538799:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c82e lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538816:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.538820:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.538824:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c82e lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538831:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c82e lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538848:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c835 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538854:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c835 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538859:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c835 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538864:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7da00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.538867:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c835 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538873:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c835 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538880:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xbb599949 (ffff8af2047f9300) 00010000:00010000:2.0:1784191893.538882:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.538893:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c835 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538899:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c835 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538936:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4c827 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0b1 expref: 108 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538946:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.538949:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.538953:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4c827 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0b1 expref: 108 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.538967:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7c600, rc 0) 00000100:00100000:2.0:1784191893.539035:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+107:123690:x1870858812435456:12345-192.168.204.16@tcp:101:cp.0 Request processed in 564us (835us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191893.539042:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 686 00000100:00100000:1.0:1784191893.541849:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.542580:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812435584 00000100:00100000:0.0:1784191893.542592:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812435584 00000100:00100000:0.0:1784191893.542715:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 687 00000100:00100000:0.0:1784191893.542726:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+107:123690:x1870858812435584:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.542747:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.542772:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127a00/0xfeec3c2dc5a4c83c lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c0b8 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.542845:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c843 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.542861:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c843 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.542872:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c843 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.542889:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c84a lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.542918:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c84a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.542924:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c84a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.542969:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c843 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.542976:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c843 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.542982:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c843 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.542990:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c843 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.542996:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233126400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191893.543000:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c843 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.543006:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c843 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.543018:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191893.543021:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.543025:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c843 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.543030:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c843 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.543050:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c84a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.543057:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c84a lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.543063:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c84a lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.543068:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191893.543070:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c84a lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.543075:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c84a lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.543082:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xbb599949 (ffff8af216687800) 00010000:00010000:0.0:1784191893.543084:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.543086:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c84a lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.543102:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c84a lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.543139:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127a00/0xfeec3c2dc5a4c83c lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0b8 expref: 108 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.543149:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191893.543152:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.543164:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127a00/0xfeec3c2dc5a4c83c lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0b8 expref: 108 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.543173:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233127a00, rc 0) 00000100:00100000:0.0:1784191893.543239:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+107:123690:x1870858812435584:12345-192.168.204.16@tcp:101:cp.0 Request processed in 515us (1401us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191893.543248:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 687 00000100:00100000:1.0:1784191893.547913:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.548262:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812435840 00000100:00100000:2.0:1784191893.548274:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812435840 00000100:00100000:2.0:1784191893.548323:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 688 00000100:00100000:2.0:1784191893.548333:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+107:123690:x1870858812435840:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.548354:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.548376:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4c851 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c0bf expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.548635:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c858 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.548680:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c858 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.548792:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c858 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.548809:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c85f lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.548816:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c85f lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.548821:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c85f lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191893.549214:0:164531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x262:0x0], index 0: 0 00080000:00000400:2.0:1784191893.549231:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.549235:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.549237:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.549238:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.549240:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.549242:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191893.549260:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.549262:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.549264:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.549266:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.549268:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.549270:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191893.549301:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.549304:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.549306:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.549315:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.549317:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.549318:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191893.549427:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4c866 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.549437:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4c866 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.549621:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4c866 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.549666:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c858 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.549673:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c858 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.549680:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c858 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.549790:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c858 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.549799:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7da00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.549804:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c858 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.549813:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c858 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.549825:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.549828:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.549842:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c858 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.549850:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c858 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191893.549869:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb997003 reply state 0000000092188744 transno 34359738768 ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c85f lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.549882:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c85f lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.549889:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xbb599949 (ffff8af2047f9300) 00010000:00010000:2.0:1784191893.549890:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191893.549894:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191893.549938:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4c851 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0bf expref: 110 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.549957:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4c866 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0bf expref: 109 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.549964:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x3a:0x0].0x0 (ffff8af2047f9a00) 00010000:00010000:2.0:1784191893.549966:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191893.549969:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7c200, rc 0) 00000100:00100000:2.0:1784191893.550115:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+110:123690:x1870858812435840:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1782us (2213us total) trans 34359738768 rc 0/0 00000100:00100000:2.0:1784191893.550124:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 688 00000100:00100000:1.0:1784191893.554390:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.554558:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812435968 00000100:00100000:2.0:1784191893.554572:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812435968 00000100:00100000:2.0:1784191893.554670:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 366 00000100:00100000:2.0:1784191893.554682:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:69111:x1870858812435968:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.554758:0:160166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.554782:0:160166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f1c3cec/0xfeec3c2dc5a4c874 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c0c6 expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191893.554808:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x262:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191893.554828:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x262:0x0].0x0 since=5513s v=(0 0) 00010000:00010000:2.0:1784191893.554832:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x262:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.554842:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f1c3cec/0xfeec3c2dc5a4c874 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0c6 expref: 34 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.554860:0:160166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f1c3cec/0xfeec3c2dc5a4c874 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0c6 expref: 34 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.554874:0:160166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7c400, rc 0) 00000100:00100000:2.0:1784191893.554934:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+34:69111:x1870858812435968:12345-192.168.204.16@tcp:101:cp.0 Request processed in 255us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.554941:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 366 00000100:00100000:1.0:1784191893.566323:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.566437:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812436096 00000100:00100000:0.0:1784191893.566458:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812436096 00000100:00100000:0.0:1784191893.566539:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 367 00000100:00100000:0.0:1784191893.566550:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+34:123690:x1870858812436096:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.566574:0:162386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.566601:0:162386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034cd9df9/0xfeec3c2dc5a4c87b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x262:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c0cd expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.566645:0:162386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f1c3cec/0xfeec3c2dc5a4c874 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0c6 expref: 35 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.566655:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x262:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.566660:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x262:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.566667:0:162386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034cd9df9/0xfeec3c2dc5a4c87b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x262:0x0].0x0 rrc: 3 type: EXT [0->147455] (req 0->147455) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0cd expref: 35 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.566755:0:162386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f1c3cec/0xfeec3c2dc5a4c874 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0c6 expref: 35 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.566771:0:162386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f1c3cec/0xfeec3c2dc5a4c874 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0c6 expref: 35 pid: 160166 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.566805:0:162386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:162386:1870858827972096:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191893.566883:0:162386:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9e780 going to sleep for 11 seconds 00000100:00100000:0.0:1784191893.570314:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.570400:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812436224 00000100:00100000:2.0:1784191893.570410:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812436224 00010000:00010000:2.0:1784191893.570461:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f1c3cec/0xfeec3c2dc5a4c874 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0c6 expref: 36 pid: 160166 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.570511:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 187 00000100:00100000:2.0:1784191893.570530:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:69110:x1870858812436224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191893.570549:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191893.570588:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f1c3cec/0xfeec3c2dc5a4c874 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x262:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0c6 expref: 36 pid: 160166 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.570603:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f1c3cec/0xfeec3c2dc5a4c874 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x262:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0c6 expref: 36 pid: 160166 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.570629:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x262:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.570634:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x262:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.570643:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000034cd9df9/0xfeec3c2dc5a4c87b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x262:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0cd expref: 36 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.570654:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034cd9df9/0xfeec3c2dc5a4c87b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x262:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0cd expref: 36 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.570729:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000034cd9df9/0xfeec3c2dc5a4c87b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x262:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0cd expref: 36 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.570744:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b84000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827972224:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191893.570817:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cd2fb40 going to sleep for 11 seconds 00010000:00010000:1.0:1784191893.571640:0:162386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f1c3cec/0xfeec3c2dc5a4c874 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x262:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0c6 expref: 36 pid: 160166 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191893.571662:0:162386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:162386:1870858827972096:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191893.571746:0:162386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000034cd9df9/0xfeec3c2dc5a4c87b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0cd expref: 35 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.571759:0:162386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233127a00, rc 0) 00000100:00100000:1.0:1784191893.571929:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:123690:x1870858812436096:12345-192.168.204.16@tcp:101:cp.0 Request processed in 5380us (5619us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191893.571937:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 367 00000100:00100000:2.0:1784191893.574114:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b84000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827972224:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191893.574148:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191893.574205:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+34:69110:x1870858812436224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3685us (3901us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.574219:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 187 00010000:00010000:1.0:1784191893.581187:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191893.585357:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.585456:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812436480 00000100:00100000:2.0:1784191893.585468:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812436480 00000100:00100000:2.0:1784191893.585548:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 194 00000100:00100000:2.0:1784191893.585559:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+110:123690:x1870858812436480:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191893.586035:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+111:123690:x1870858812436480:12345-192.168.204.16@tcp:35:cp.0 Request processed in 476us (686us total) trans 34359738769 rc 0/0 00000100:00100000:2.0:1784191893.586044:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 194 00000100:00100000:0.0:1784191893.589664:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.590006:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812436608 00000100:00100000:2.0:1784191893.590016:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812436608 00000100:00100000:2.0:1784191893.590081:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 689 00000100:00100000:2.0:1784191893.590101:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+111:123690:x1870858812436608:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.590127:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.590150:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4c882 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c0d4 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590225:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c889 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590242:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c889 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590254:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c889 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590271:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4c890 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590277:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4c890 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590283:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4c890 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590355:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c889 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590363:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c889 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590368:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c889 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590374:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c889 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590380:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7da00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.590384:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c889 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590390:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c889 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590404:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.590407:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.590411:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c889 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590417:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c889 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590440:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4c890 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590533:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4c890 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590547:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4c890 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590552:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7cc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.590555:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4c890 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590562:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4c890 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590571:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x1a616f3f (ffff8af219b92600) 00010000:00010000:2.0:1784191893.590573:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.590576:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4c890 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590582:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7cc00/0xfeec3c2dc5a4c890 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590619:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4c882 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0d4 expref: 112 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590630:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.590632:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.590635:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4c882 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0d4 expref: 112 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.590643:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7c600, rc 0) 00000100:00100000:2.0:1784191893.590914:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+111:123690:x1870858812436608:12345-192.168.204.16@tcp:101:cp.0 Request processed in 823us (1261us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191893.590933:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 689 00000100:00100000:0.0:1784191893.593666:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.593833:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812436736 00000100:00100000:1.0:1784191893.593845:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812436736 00000100:00100000:1.0:1784191893.593923:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 690 00000100:00100000:1.0:1784191893.593933:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+111:123690:x1870858812436736:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191893.593959:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191893.593983:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c897 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c0db expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594069:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c89e lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594123:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c89e lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594136:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c89e lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594155:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c8a5 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594162:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c8a5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594169:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c8a5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594216:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c89e lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594223:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c89e lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594229:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c89e lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594236:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c89e lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594242:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.594246:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c89e lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594253:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c89e lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594273:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.594276:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.594281:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c89e lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594288:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c89e lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594303:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c8a5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594309:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c8a5 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594314:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c8a5 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594319:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.594322:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c8a5 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594327:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c8a5 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594334:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x1a616f3f (ffff8af20dabc700) 00010000:00010000:1.0:1784191893.594336:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.594339:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c8a5 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594345:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c8a5 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594395:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c897 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0db expref: 112 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594404:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.594407:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.594410:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c897 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0db expref: 112 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.594418:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200030c00, rc 0) 00000100:00100000:1.0:1784191893.594752:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+111:123690:x1870858812436736:12345-192.168.204.16@tcp:101:cp.0 Request processed in 818us (1096us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191893.594761:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 690 00000100:00100000:2.0:1784191893.598510:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.598595:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812436992 00000100:00100000:1.0:1784191893.598607:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812436992 00000100:00100000:1.0:1784191893.598675:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 691 00000100:00100000:1.0:1784191893.598715:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+111:123690:x1870858812436992:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191893.598747:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191893.598773:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c8ac lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c0e2 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.598901:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c8b3 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.598917:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c8b3 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.598930:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c8b3 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.598966:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4c8ba lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.598974:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4c8ba lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.598979:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4c8ba lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191893.599353:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1df:0x0], index 1: 0 00080000:00000400:1.0:1784191893.599366:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191893.599369:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191893.599372:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191893.599374:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191893.599376:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191893.599378:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191893.599393:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191893.599395:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191893.599397:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191893.599399:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191893.599401:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191893.599403:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191893.599431:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191893.599434:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191893.599435:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191893.599437:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191893.599439:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191893.599440:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191893.599541:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4c8c1 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.599562:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4c8c1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.599570:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4c8c1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.599607:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c8b3 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.599614:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c8b3 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.599619:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c8b3 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.599625:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c8b3 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.599631:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.599636:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c8b3 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.599642:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c8b3 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.599654:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.599656:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.599661:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c8b3 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.599667:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c8b3 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191893.599711:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009797208f reply state 00000000f7825d79 transno 34359738770 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4c8ba lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.599723:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4c8ba lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.599729:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x1a616f3f (ffff8af20dabc800) 00010000:00010000:1.0:1784191893.599732:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191893.599734:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191893.599763:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c8ac lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0e2 expref: 114 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.599777:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4c8c1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0e2 expref: 113 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.599784:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x3b:0x0].0x0 (ffff8af20dabca00) 00010000:00010000:1.0:1784191893.599787:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191893.599789:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3e800, rc 0) 00000100:00100000:1.0:1784191893.600396:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+114:123690:x1870858812436992:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1707us (1894us total) trans 34359738770 rc 0/0 00000100:00100000:1.0:1784191893.600406:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 691 00000100:00100000:0.0:1784191893.605193:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.605303:0:162390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812437120 00000100:00100000:2.0:1784191893.605317:0:162390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812437120 00000100:00100000:2.0:1784191893.605429:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 368 00000100:00100000:2.0:1784191893.605450:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+33:69110:x1870858812437120:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.605473:0:162390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.605496:0:162390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000794619ed/0xfeec3c2dc5a4c8cf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c0e9 expref: -99 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191893.605538:0:162390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191893.605560:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1df:0x0].0x0 since=5513s v=(0 0) 00010000:00010000:2.0:1784191893.605565:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.605576:0:162390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000794619ed/0xfeec3c2dc5a4c8cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0e9 expref: 34 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.605595:0:162390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000794619ed/0xfeec3c2dc5a4c8cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0e9 expref: 34 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.605609:0:162390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7c600, rc 0) 00000100:00100000:2.0:1784191893.605678:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+34:69110:x1870858812437120:12345-192.168.204.16@tcp:101:cp.0 Request processed in 239us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.605684:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 368 00000100:00100000:0.0:1784191893.618423:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.618623:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812437248 00000100:00100000:2.0:1784191893.618633:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812437248 00000100:00100000:2.0:1784191893.618750:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 369 00000100:00100000:2.0:1784191893.618760:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+34:123690:x1870858812437248:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.618781:0:162391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.618800:0:162391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0245066/0xfeec3c2dc5a4c8d6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c0f0 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.618833:0:162391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000794619ed/0xfeec3c2dc5a4c8cf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0e9 expref: 35 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.618843:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.618848:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.618854:0:162391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0245066/0xfeec3c2dc5a4c8d6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->172031] (req 0->172031) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0f0 expref: 35 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.618889:0:162391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000794619ed/0xfeec3c2dc5a4c8cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0e9 expref: 35 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.618905:0:162391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000794619ed/0xfeec3c2dc5a4c8cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0e9 expref: 35 pid: 162390 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.618921:0:162391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:162391:1870858827972352:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191893.618999:0:162391:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cd2f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191893.622001:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.622132:0:162391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:162391:1870858827972352:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191893.622166:0:162391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d0245066/0xfeec3c2dc5a4c8d6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->172031] (req 0->172031) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0f0 expref: 35 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.622216:0:162391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7cc00, rc 0) 00000100:00100000:2.0:1784191893.622279:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:123690:x1870858812437248:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3520us (3865us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.622288:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 369 00000100:00100000:3.0:1784191893.622660:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812437376 00000100:00100000:3.0:1784191893.622671:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812437376 00010000:00010000:3.0:1784191893.622755:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000794619ed/0xfeec3c2dc5a4c8cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0e9 expref: 35 pid: 162390 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191893.622794:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 188 00000100:00100000:3.0:1784191893.622802:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23b103050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:69112:x1870858812437376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191893.622818:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191893.622843:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000794619ed/0xfeec3c2dc5a4c8cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0e9 expref: 35 pid: 162390 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.622858:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000794619ed/0xfeec3c2dc5a4c8cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0e9 expref: 35 pid: 162390 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.622882:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000794619ed/0xfeec3c2dc5a4c8cf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0e9 expref: 35 pid: 162390 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.622899:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.622903:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.622912:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0245066/0xfeec3c2dc5a4c8d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0f0 expref: 34 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.622922:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0245066/0xfeec3c2dc5a4c8d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0f0 expref: 34 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.622958:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d0245066/0xfeec3c2dc5a4c8d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0f0 expref: 34 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191893.622983:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827972480:192.168.204.16@tcp:105: 00000100:00100000:3.0:1784191893.623042:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1119a9600 going to sleep for 11 seconds 00000100:00100000:3.0:1784191893.627069:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827972480:192.168.204.16@tcp:105: 00010000:00010000:3.0:1784191893.627100:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191893.627173:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23b103050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+34:69112:x1870858812437376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4370us (5182us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191893.627185:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 188 00000100:00100000:0.0:1784191893.632802:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.632965:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812437632 00000100:00100000:2.0:1784191893.632976:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812437632 00000100:00100000:2.0:1784191893.633039:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 195 00000100:00100000:2.0:1784191893.633051:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+114:123690:x1870858812437632:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191893.633387:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+115:123690:x1870858812437632:12345-192.168.204.16@tcp:35:cp.0 Request processed in 338us (593us total) trans 34359738771 rc 0/0 00000100:00100000:2.0:1784191893.633395:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 195 00000100:00100000:0.0:1784191893.636920:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.637008:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812437760 00000100:00100000:2.0:1784191893.637019:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812437760 00000100:00100000:2.0:1784191893.637082:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 692 00000100:00100000:2.0:1784191893.637093:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+115:123690:x1870858812437760:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.637119:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.637140:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c8dd lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c0f7 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637209:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4c8e4 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637224:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4c8e4 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637235:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4c8e4 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637269:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4c8eb lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637277:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4c8eb lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637284:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4c8eb lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637324:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4c8e4 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637332:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4c8e4 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637338:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4c8e4 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637345:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4c8e4 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637351:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7c800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.637356:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4c8e4 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637363:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4c8e4 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637376:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.637380:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.637385:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4c8e4 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637399:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4c8e4 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637418:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4c8eb lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637423:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4c8eb lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637429:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4c8eb lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637433:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7d200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.637435:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4c8eb lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637455:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4c8eb lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637464:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x6d38f012 (ffff8af219b92300) 00010000:00010000:2.0:1784191893.637466:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.637469:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4c8eb lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637475:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4c8eb lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637516:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c8dd lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0f7 expref: 116 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637550:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.637553:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.637557:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4c8dd lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0f7 expref: 116 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.637570:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7da00, rc 0) 00000100:00100000:2.0:1784191893.637652:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+115:123690:x1870858812437760:12345-192.168.204.16@tcp:101:cp.0 Request processed in 560us (742us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191893.637659:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 692 00000100:00100000:0.0:1784191893.641287:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.641384:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812437888 00000100:00100000:1.0:1784191893.641393:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812437888 00000100:00100000:1.0:1784191893.641466:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 693 00000100:00100000:1.0:1784191893.641475:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+115:123690:x1870858812437888:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191893.641495:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191893.641515:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4c8f2 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c0fe expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641613:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c8f9 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641627:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c8f9 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641638:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c8f9 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641652:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c900 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641659:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c900 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641665:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c900 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641760:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c8f9 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641767:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c8f9 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641773:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c8f9 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641779:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c8f9 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641784:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3f000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.641795:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c8f9 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641802:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c8f9 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641813:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.641816:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.641820:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c8f9 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641825:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c8f9 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641839:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c900 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641845:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c900 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641850:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c900 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641854:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200031a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.641857:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c900 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641863:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c900 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641869:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x6d38f012 (ffff8af20dabc700) 00010000:00010000:1.0:1784191893.641871:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.641879:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c900 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641884:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c900 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641920:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4c8f2 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0fe expref: 116 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641929:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.641931:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.641934:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4c8f2 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0fe expref: 116 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.641942:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3ec00, rc 0) 00000100:00100000:1.0:1784191893.641996:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+115:123690:x1870858812437888:12345-192.168.204.16@tcp:101:cp.0 Request processed in 522us (721us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191893.642004:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 693 00000100:00100000:3.0:1784191893.645437:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.645558:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812438144 00000100:00100000:1.0:1784191893.645572:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812438144 00000100:00100000:1.0:1784191893.645647:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 694 00000100:00100000:1.0:1784191893.645658:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+115:123690:x1870858812438144:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191893.645685:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191893.645750:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c907 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c105 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.645870:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c90e lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.645908:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c90e lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.645920:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c90e lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.645937:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c915 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.645945:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c915 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.645951:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c915 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191893.646290:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x263:0x0], index 0: 0 00080000:00000400:1.0:1784191893.646304:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:1.0:1784191893.646308:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191893.646310:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191893.646312:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191893.646314:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191893.646316:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191893.646334:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:1.0:1784191893.646337:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191893.646339:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191893.646341:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191893.646343:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191893.646345:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191893.646375:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:1.0:1784191893.646378:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191893.646380:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191893.646389:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191893.646391:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191893.646393:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191893.646494:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c91c lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.646504:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c91c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.646511:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c91c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.646560:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c90e lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.646567:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c90e lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.646573:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c90e lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.646579:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c90e lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.646585:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.646589:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c90e lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.646595:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c90e lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.646607:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.646610:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.646621:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c90e lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.646628:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c90e lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191893.646643:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009e12b299 reply state 000000001014d6bf transno 34359738772 ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c915 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.646654:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c915 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.646660:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x6d38f012 (ffff8af20dabc100) 00010000:00010000:1.0:1784191893.646661:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191893.646664:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191893.646732:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c907 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c105 expref: 118 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.646747:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c91c lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c105 expref: 117 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.646755:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x3c:0x0].0x0 (ffff8af20dabcc00) 00010000:00010000:1.0:1784191893.646757:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191893.646760:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200030200, rc 0) 00000100:00100000:1.0:1784191893.646825:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+118:123690:x1870858812438144:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1167us (1399us total) trans 34359738772 rc 0/0 00000100:00100000:1.0:1784191893.646833:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 694 00000100:00100000:0.0:1784191893.652176:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.652278:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812438272 00000100:00100000:2.0:1784191893.652289:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812438272 00000100:00100000:2.0:1784191893.652356:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 370 00000100:00100000:2.0:1784191893.652367:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+34:69112:x1870858812438272:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.652388:0:162387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.652415:0:162387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c527c55/0xfeec3c2dc5a4c92a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c10c expref: -99 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191893.652440:0:162387:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x263:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191893.652462:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x263:0x0].0x0 since=5513s v=(0 0) 00010000:00010000:2.0:1784191893.652467:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x263:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.652478:0:162387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c527c55/0xfeec3c2dc5a4c92a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c10c expref: 35 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.652494:0:162387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003c527c55/0xfeec3c2dc5a4c92a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c10c expref: 35 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.652544:0:162387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7da00, rc 0) 00000100:00100000:2.0:1784191893.652613:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:69112:x1870858812438272:12345-192.168.204.16@tcp:101:cp.0 Request processed in 246us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.652620:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 370 00000100:00100000:0.0:1784191893.662433:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.662597:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812438400 00000100:00100000:3.0:1784191893.662610:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812438400 00000100:00100000:3.0:1784191893.662677:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 371 00000100:00100000:3.0:1784191893.662735:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:123690:x1870858812438400:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.662757:0:161232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.662777:0:161232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca579565/0xfeec3c2dc5a4c931 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c113 expref: -99 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.662813:0:161232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003c527c55/0xfeec3c2dc5a4c92a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c10c expref: 36 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.662822:0:161232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x263:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.662826:0:161232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x263:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.662832:0:161232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca579565/0xfeec3c2dc5a4c931 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c113 expref: 36 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.662890:0:161232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003c527c55/0xfeec3c2dc5a4c92a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c10c expref: 36 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.662906:0:161232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003c527c55/0xfeec3c2dc5a4c92a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c10c expref: 36 pid: 162387 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191893.662921:0:161232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109199500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:161232:1870858827972608:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191893.663006:0:161232:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1119a9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191893.665857:0:161232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109199500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:161232:1870858827972608:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191893.665894:0:161232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ca579565/0xfeec3c2dc5a4c931 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c113 expref: 36 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.665917:0:161232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd68e00, rc 0) 00000100:00100000:0.0:1784191893.665976:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:123690:x1870858812438400:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3290us (3555us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191893.665985:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 371 00000100:00100000:1.0:1784191893.667254:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.667335:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812438528 00000100:00100000:2.0:1784191893.667345:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812438528 00010000:00010000:2.0:1784191893.667382:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003c527c55/0xfeec3c2dc5a4c92a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c10c expref: 36 pid: 162387 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.667422:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 189 00000100:00100000:2.0:1784191893.667431:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:69109:x1870858812438528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191893.667569:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191893.667594:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003c527c55/0xfeec3c2dc5a4c92a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x263:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c10c expref: 36 pid: 162387 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.667609:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003c527c55/0xfeec3c2dc5a4c92a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x263:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c10c expref: 36 pid: 162387 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.667632:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c527c55/0xfeec3c2dc5a4c92a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x263:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c10c expref: 36 pid: 162387 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.667651:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x263:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.667655:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x263:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.667663:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca579565/0xfeec3c2dc5a4c931 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c113 expref: 35 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.667778:0:158650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca579565/0xfeec3c2dc5a4c931 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c113 expref: 35 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.667817:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ca579565/0xfeec3c2dc5a4c931 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c113 expref: 35 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.667830:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b84a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:158650:1870858827972736:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191893.667942:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cd2f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191893.676389:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.676506:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b84a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:158650:1870858827972736:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191893.676546:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191893.676634:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:69109:x1870858812438528:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 9201us (9384us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191893.676646:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 189 00000100:00100000:3.0:1784191893.677897:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812438784 00000100:00100000:3.0:1784191893.677908:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812438784 00000100:00100000:3.0:1784191893.677974:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 196 00000100:00100000:3.0:1784191893.677983:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+118:123690:x1870858812438784:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191893.678316:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+119:123690:x1870858812438784:12345-192.168.204.16@tcp:35:cp.0 Request processed in 332us (1939us total) trans 34359738773 rc 0/0 00000100:00100000:3.0:1784191893.678324:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 196 00000100:00100000:1.0:1784191893.682262:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.682381:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812438912 00000100:00100000:0.0:1784191893.682392:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812438912 00000100:00100000:0.0:1784191893.682558:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 695 00000100:00100000:0.0:1784191893.682570:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+119:123690:x1870858812438912:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.682598:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.682623:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4c938 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c11a expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682746:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c93f lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682763:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c93f lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682776:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c93f lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682791:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c946 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682798:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c946 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682805:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c946 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682849:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c93f lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682868:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c93f lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682874:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c93f lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682881:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c93f lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682886:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191893.682891:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c93f lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682899:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c93f lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682912:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191893.682915:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.682920:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c93f lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682927:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4c93f lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682942:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c946 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682947:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c946 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682952:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c946 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682962:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233126400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191893.682965:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c946 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682970:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c946 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682977:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x52815b39 (ffff8af216687800) 00010000:00010000:0.0:1784191893.682979:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.682981:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c946 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.682986:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126400/0xfeec3c2dc5a4c946 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.683019:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4c938 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c11a expref: 120 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.683028:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191893.683030:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.683033:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4c938 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c11a expref: 120 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.683042:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233127000, rc 0) 00000100:00100000:0.0:1784191893.683256:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+119:123690:x1870858812438912:12345-192.168.204.16@tcp:101:cp.0 Request processed in 687us (1004us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191893.683265:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 695 00000100:00100000:3.0:1784191893.686050:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.687028:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812439040 00000100:00100000:1.0:1784191893.687044:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812439040 00000100:00100000:1.0:1784191893.687131:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 696 00000100:00100000:1.0:1784191893.687143:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+119:123690:x1870858812439040:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191893.687165:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191893.687186:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c94d lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c121 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687265:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c954 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687280:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c954 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687293:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c954 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687308:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c95b lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687315:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c95b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687322:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c95b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687369:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c954 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687377:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c954 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687405:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c954 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687412:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c954 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687418:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.687423:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c954 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687432:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c954 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687658:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.687662:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.687667:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c954 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687674:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c954 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687780:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c95b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687788:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c95b lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687794:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c95b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687800:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.687811:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c95b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687817:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c95b lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687825:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x52815b39 (ffff8af20dabc700) 00010000:00010000:1.0:1784191893.687828:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.687831:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c95b lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687836:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c95b lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687874:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c94d lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c121 expref: 120 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687884:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.687886:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.687889:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c94d lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c121 expref: 120 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.687900:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200031a00, rc 0) 00000100:00100000:1.0:1784191893.688018:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+119:123690:x1870858812439040:12345-192.168.204.16@tcp:101:cp.0 Request processed in 876us (1977us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191893.688026:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 696 00000100:00100000:3.0:1784191893.691082:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.691131:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812439296 00000100:00100000:3.0:1784191893.691141:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812439296 00000100:00100000:3.0:1784191893.691195:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 697 00000100:00100000:3.0:1784191893.691204:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+119:123690:x1870858812439296:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.691228:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.691249:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c962 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c128 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.691395:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c969 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.691410:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c969 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.691421:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c969 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.691588:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c970 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.691599:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c970 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.691608:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c970 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191893.692028:0:158666:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1e0:0x0], index 1: 0 00080000:00000400:3.0:1784191893.692041:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191893.692044:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191893.692046:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191893.692048:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191893.692051:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191893.692053:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191893.692069:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191893.692071:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191893.692073:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191893.692075:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191893.692077:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191893.692087:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191893.692131:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191893.692134:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191893.692135:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191893.692137:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191893.692139:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191893.692141:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191893.692230:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c977 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.692239:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c977 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.692246:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c977 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.692279:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c969 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.692286:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c969 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.692292:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c969 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.692298:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c969 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.692304:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191893.692308:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c969 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.692315:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c969 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.692335:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191893.692338:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.692343:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c969 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.692350:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c969 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191893.692362:0:158666:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007ba02f4d reply state 00000000c9849328 transno 34359738774 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c970 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.692371:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c970 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.692377:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x52815b39 (ffff8af2112b6600) 00010000:00010000:3.0:1784191893.692379:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191893.692381:0:158666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784191893.692413:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c962 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c128 expref: 122 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.692430:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c977 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c128 expref: 121 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.692437:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x3d:0x0].0x0 (ffff8af233110200) 00010000:00010000:3.0:1784191893.692974:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784191893.692977:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1010bf600, rc 0) 00000100:00100000:3.0:1784191893.693164:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+122:123690:x1870858812439296:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1958us (2088us total) trans 34359738774 rc 0/0 00000100:00100000:3.0:1784191893.693172:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 697 00000100:00100000:2.0:1784191893.700225:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.700329:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812439424 00000100:00100000:1.0:1784191893.700339:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812439424 00000100:00100000:1.0:1784191893.700419:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 372 00000100:00100000:1.0:1784191893.700429:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1051f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+34:69110:x1870858812439424:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191893.700478:0:162389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191893.700500:0:162389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4c985 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c12f expref: -99 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784191893.700542:0:162389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191893.700566:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e0:0x0].0x0 since=5513s v=(0 0) 00010000:00010000:1.0:1784191893.700571:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191893.700582:0:162389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4c985 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c12f expref: 35 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.700613:0:162389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4c985 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c12f expref: 35 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.700628:0:162389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3f000, rc 0) 00000100:00100000:1.0:1784191893.701059:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1051f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:69110:x1870858812439424:12345-192.168.204.16@tcp:101:cp.0 Request processed in 260us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191893.701070:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 372 00000100:00100000:1.0:1784191893.713175:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.713263:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812439552 00000100:00100000:0.0:1784191893.713288:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812439552 00000100:00100000:0.0:1784191893.713351:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 373 00000100:00100000:0.0:1784191893.713362:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:123690:x1870858812439552:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.713380:0:162396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.713400:0:162396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c94d6048/0xfeec3c2dc5a4c98c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c136 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.713445:0:162396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4c985 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c12f expref: 36 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.713454:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.713458:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.713463:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c94d6048/0xfeec3c2dc5a4c98c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->217087] (req 0->217087) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c136 expref: 36 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.713498:0:162396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4c985 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c12f expref: 36 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.713513:0:162396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4c985 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c12f expref: 36 pid: 162389 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.713539:0:162396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:162396:1870858827972864:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191893.713639:0:162396:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9e240 going to sleep for 11 seconds 00000100:00100000:0.0:1784191893.721363:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.721751:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812439680 00000100:00100000:1.0:1784191893.721763:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812439680 00010000:00010000:1.0:1784191893.721812:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4c985 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c12f expref: 37 pid: 162389 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191893.721864:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 190 00000100:00100000:1.0:1784191893.721875:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+37:69111:x1870858812439680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191893.721919:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191893.721947:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4c985 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c12f expref: 37 pid: 162389 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.721962:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4c985 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c12f expref: 37 pid: 162389 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.721987:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191893.721991:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191893.721999:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c94d6048/0xfeec3c2dc5a4c98c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c136 expref: 37 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.722009:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c94d6048/0xfeec3c2dc5a4c98c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c136 expref: 37 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.722049:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c94d6048/0xfeec3c2dc5a4c98c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c136 expref: 37 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191893.722064:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec87100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827972992:192.168.204.16@tcp:105: 00000100:00100000:1.0:1784191893.722143:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af205de4540 going to sleep for 11 seconds 00010000:00010000:2.0:1784191893.722589:0:162396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a83f569/0xfeec3c2dc5a4c985 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c12f expref: 37 pid: 162389 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.722605:0:162396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:162396:1870858827972864:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191893.722631:0:162396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c94d6048/0xfeec3c2dc5a4c98c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c136 expref: 36 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.722642:0:162396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233126400, rc 0) 00000100:00100000:2.0:1784191893.722674:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:123690:x1870858812439552:12345-192.168.204.16@tcp:101:cp.0 Request processed in 9314us (9511us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.722681:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 373 00000100:00100000:1.0:1784191893.733144:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec87100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827972992:192.168.204.16@tcp:105: 00010000:00010000:1.0:1784191893.733177:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191893.733237:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:69111:x1870858812439680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 11364us (11885us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191893.733248:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 190 00000100:00100000:0.0:1784191893.736206:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.736295:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812439936 00000100:00100000:3.0:1784191893.736307:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812439936 00000100:00100000:3.0:1784191893.736369:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 197 00000100:00100000:3.0:1784191893.736378:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+122:123690:x1870858812439936:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:2.0:1784191893.737131:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+123:123690:x1870858812439936:12345-192.168.204.16@tcp:35:cp.0 Request processed in 749us (933us total) trans 34359738775 rc 0/0 00000100:00100000:2.0:1784191893.737140:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 197 00000100:00100000:0.0:1784191893.740611:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.740722:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812440064 00000100:00100000:1.0:1784191893.740734:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812440064 00000100:00100000:1.0:1784191893.740803:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 698 00000100:00100000:1.0:1784191893.740813:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+123:123690:x1870858812440064:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191893.740840:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191893.740861:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4c993 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c13d expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.740937:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c99a lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.740951:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c99a lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.740963:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c99a lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.740977:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9a1 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.740984:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9a1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.740989:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9a1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.741036:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c99a lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.741043:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c99a lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.741060:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c99a lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.741066:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c99a lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.741072:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3f000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.741077:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c99a lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.741085:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c99a lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.741099:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.741101:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.741106:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c99a lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.741112:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4c99a lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.741127:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9a1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.741133:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9a1 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.741139:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9a1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.741144:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200031a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.741153:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9a1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.741159:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9a1 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.741168:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9cfce7b5 (ffff8af20dabc900) 00010000:00010000:1.0:1784191893.741170:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.741173:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9a1 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.741179:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9a1 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.741213:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4c993 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c13d expref: 124 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.741224:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.741226:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.741230:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4c993 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c13d expref: 124 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.741240:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3ec00, rc 0) 00000100:00100000:1.0:1784191893.741532:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+123:123690:x1870858812440064:12345-192.168.204.16@tcp:101:cp.0 Request processed in 709us (921us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191893.741539:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 698 00000100:00100000:1.0:1784191893.744930:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.745017:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812440192 00000100:00100000:2.0:1784191893.745026:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812440192 00000100:00100000:2.0:1784191893.745189:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 699 00000100:00100000:2.0:1784191893.745201:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+123:123690:x1870858812440192:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.745224:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.745246:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4c9a8 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c144 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745315:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4c9af lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745329:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4c9af lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745340:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4c9af lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745355:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4c9b6 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745362:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4c9b6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745370:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4c9b6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745410:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4c9af lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745417:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4c9af lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745514:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4c9af lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745529:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4c9af lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745535:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7c000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.745538:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4c9af lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745546:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4c9af lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745559:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.745562:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.745567:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4c9af lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745573:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4c9af lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745588:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4c9b6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745594:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4c9b6 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745599:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4c9b6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745606:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7d400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.745616:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4c9b6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745621:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4c9b6 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745629:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9cfce7b5 (ffff8af2382d2700) 00010000:00010000:2.0:1784191893.745631:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.745633:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4c9b6 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745639:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4c9b6 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745678:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4c9a8 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c144 expref: 124 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745912:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.745915:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.745920:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4c9a8 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c144 expref: 124 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.745931:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7d600, rc 0) 00000100:00100000:2.0:1784191893.746040:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+123:123690:x1870858812440192:12345-192.168.204.16@tcp:101:cp.0 Request processed in 841us (1118us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191893.746048:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 699 00000100:00100000:2.0:1784191893.749428:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.749593:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812440448 00000100:00100000:3.0:1784191893.749607:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812440448 00000100:00100000:3.0:1784191893.749925:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 700 00000100:00100000:3.0:1784191893.749939:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+123:123690:x1870858812440448:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.749965:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.749991:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4c9bd lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c14b expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.750124:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c9c4 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.750140:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c9c4 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.750152:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c9c4 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.750167:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c9cb lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.750175:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c9cb lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.750182:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c9cb lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191893.750581:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x264:0x0], index 0: 0 00080000:00000400:3.0:1784191893.750599:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191893.750603:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191893.750605:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191893.750607:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191893.750609:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191893.750611:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191893.750628:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191893.750630:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191893.750632:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191893.750634:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191893.750636:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191893.750637:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191893.750669:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191893.750672:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191893.750674:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191893.750676:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191893.750678:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191893.750680:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191893.751035:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c9d2 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.751047:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c9d2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.751056:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c9d2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.751092:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c9c4 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.751113:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c9c4 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.751120:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c9c4 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.751126:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c9c4 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.751133:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191893.751137:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c9c4 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.751145:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c9c4 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.751158:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191893.751162:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.751167:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c9c4 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.751173:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68600/0xfeec3c2dc5a4c9c4 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191893.751187:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006f181d84 reply state 00000000f3254081 transno 34359738776 ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c9cb lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.751198:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c9cb lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.751204:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9cfce7b5 (ffff8af210e98900) 00010000:00010000:3.0:1784191893.751213:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191893.751216:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784191893.751252:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4c9bd lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c14b expref: 126 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.751266:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c9d2 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c14b expref: 125 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.751274:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x3e:0x0].0x0 (ffff8af210e98000) 00010000:00010000:3.0:1784191893.751276:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784191893.751278:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd68200, rc 0) 00000100:00100000:3.0:1784191893.751393:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+126:123690:x1870858812440448:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1458us (1976us total) trans 34359738776 rc 0/0 00000100:00100000:3.0:1784191893.751402:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 700 00000100:00100000:1.0:1784191893.755960:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.756109:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812440576 00000100:00100000:2.0:1784191893.756120:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812440576 00000100:00100000:2.0:1784191893.756217:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 374 00000100:00100000:2.0:1784191893.756246:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:69111:x1870858812440576:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.756268:0:162395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.756292:0:162395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020035ead/0xfeec3c2dc5a4c9e0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c152 expref: -99 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191893.756322:0:162395:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x264:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191893.756345:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x264:0x0].0x0 since=5513s v=(0 0) 00010000:00010000:2.0:1784191893.756349:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x264:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.756359:0:162395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020035ead/0xfeec3c2dc5a4c9e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c152 expref: 36 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.756376:0:162395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000020035ead/0xfeec3c2dc5a4c9e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c152 expref: 36 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.756390:0:162395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7de00, rc 0) 00000100:00100000:2.0:1784191893.756460:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:69111:x1870858812440576:12345-192.168.204.16@tcp:101:cp.0 Request processed in 216us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.756467:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 374 00000100:00100000:1.0:1784191893.771879:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.772017:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812440704 00000100:00100000:3.0:1784191893.772028:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812440704 00000100:00100000:3.0:1784191893.772098:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 375 00000100:00100000:3.0:1784191893.772108:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:123690:x1870858812440704:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.772130:0:162339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.772149:0:162339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b11e744/0xfeec3c2dc5a4c9e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x264:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c159 expref: -99 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.772183:0:162339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000020035ead/0xfeec3c2dc5a4c9e0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x264:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c152 expref: 37 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.772192:0:162339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x264:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.772196:0:162339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x264:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.772219:0:162339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b11e744/0xfeec3c2dc5a4c9e7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x264:0x0].0x0 rrc: 3 type: EXT [0->196607] (req 0->196607) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c159 expref: 37 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.772255:0:162339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000020035ead/0xfeec3c2dc5a4c9e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x264:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c152 expref: 37 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.772270:0:162339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000020035ead/0xfeec3c2dc5a4c9e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x264:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c152 expref: 37 pid: 162395 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191893.772285:0:162339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109199880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:162339:1870858827973120:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191893.772380:0:162339:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af104f1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1784191893.775431:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.775594:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812440832 00000100:00100000:2.0:1784191893.775604:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812440832 00010000:00010000:2.0:1784191893.775645:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000020035ead/0xfeec3c2dc5a4c9e0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x264:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c152 expref: 38 pid: 162395 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.775733:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 191 00000100:00100000:2.0:1784191893.775743:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+38:69109:x1870858812440832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191893.775775:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191893.775801:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000020035ead/0xfeec3c2dc5a4c9e0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x264:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c152 expref: 38 pid: 162395 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.775817:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000020035ead/0xfeec3c2dc5a4c9e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x264:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c152 expref: 38 pid: 162395 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.775843:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x264:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.775854:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x264:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.775863:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b11e744/0xfeec3c2dc5a4c9e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x264:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->196607) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c159 expref: 38 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.775874:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b11e744/0xfeec3c2dc5a4c9e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x264:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->196607) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c159 expref: 38 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.775918:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009b11e744/0xfeec3c2dc5a4c9e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x264:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->196607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c159 expref: 38 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.775935:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b84700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827973248:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191893.776018:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cd2f240 going to sleep for 11 seconds 00010000:00010000:3.0:1784191893.776794:0:162339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020035ead/0xfeec3c2dc5a4c9e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x264:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c152 expref: 38 pid: 162395 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191893.776818:0:162339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109199880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:162339:1870858827973120:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191893.776847:0:162339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b11e744/0xfeec3c2dc5a4c9e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x264:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->196607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c159 expref: 37 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.776859:0:162339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af23dd68600, rc 0) 00000100:00100000:3.0:1784191893.776913:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+37:123690:x1870858812440704:12345-192.168.204.16@tcp:101:cp.0 Request processed in 4805us (5043us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191893.776920:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 375 00000100:00100000:0.0:1784191893.782638:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.782739:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812441088 00000100:00100000:3.0:1784191893.782751:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812441088 00000100:00100000:3.0:1784191893.782799:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 198 00000100:00100000:3.0:1784191893.782809:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105324850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+126:123690:x1870858812441088:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191893.783134:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105324850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+127:123690:x1870858812441088:12345-192.168.204.16@tcp:35:cp.0 Request processed in 325us (504us total) trans 34359738777 rc 0/0 00000100:00100000:3.0:1784191893.783142:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 198 00000100:00100000:2.0:1784191893.783875:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b84700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827973248:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191893.783896:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191893.783942:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:69109:x1870858812440832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8199us (8520us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.783951:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 191 00000100:00100000:0.0:1784191893.788633:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.788824:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812441216 00000100:00100000:1.0:1784191893.788853:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812441216 00000100:00100000:1.0:1784191893.788919:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 701 00000100:00100000:1.0:1784191893.788931:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+127:123690:x1870858812441216:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191893.788960:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191893.788982:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c9ee lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c160 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789055:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c9f5 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789069:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c9f5 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789080:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c9f5 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789094:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9fc lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789100:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9fc lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789106:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9fc lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789150:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c9f5 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789158:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c9f5 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789164:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c9f5 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789179:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c9f5 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789186:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.789190:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c9f5 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789197:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c9f5 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789208:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.789211:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.789216:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c9f5 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789223:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4c9f5 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789236:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9fc lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789241:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9fc lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789246:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9fc lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789251:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200031a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.789254:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9fc lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789270:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9fc lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789279:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe708c894 (ffff8af20dabc900) 00010000:00010000:1.0:1784191893.789282:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.789285:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9fc lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789290:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4c9fc lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789325:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c9ee lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c160 expref: 128 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789336:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.789339:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.789343:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4c9ee lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c160 expref: 128 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.789353:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200030e00, rc 0) 00000100:00100000:1.0:1784191893.789594:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+127:123690:x1870858812441216:12345-192.168.204.16@tcp:101:cp.0 Request processed in 662us (968us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191893.789602:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 701 00000100:00100000:0.0:1784191893.793328:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.793432:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812441344 00000100:00100000:2.0:1784191893.793443:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812441344 00000100:00100000:2.0:1784191893.793539:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 702 00000100:00100000:2.0:1784191893.793549:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+127:123690:x1870858812441344:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.793570:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.793593:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4ca03 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c167 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793659:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4ca0a lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793673:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4ca0a lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793684:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4ca0a lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793731:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4ca11 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793739:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4ca11 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793745:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4ca11 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793786:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4ca0a lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793793:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4ca0a lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793821:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4ca0a lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793828:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4ca0a lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793833:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7d400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.793838:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4ca0a lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793845:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4ca0a lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793857:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.793859:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.793864:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4ca0a lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793870:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4ca0a lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793887:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4ca11 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793893:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4ca11 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793898:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4ca11 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793904:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7c000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.793910:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4ca11 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793917:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4ca11 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793924:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe708c894 (ffff8af2382d2700) 00010000:00010000:2.0:1784191893.793926:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.793928:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4ca11 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793934:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4ca11 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793963:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4ca03 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c167 expref: 128 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793972:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.793974:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.793977:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4ca03 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c167 expref: 128 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.793986:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7d600, rc 0) 00000100:00100000:2.0:1784191893.794041:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+127:123690:x1870858812441344:12345-192.168.204.16@tcp:101:cp.0 Request processed in 494us (723us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191893.794048:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 702 00000100:00100000:1.0:1784191893.797010:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.797108:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812441600 00000100:00100000:3.0:1784191893.797119:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812441600 00000100:00100000:3.0:1784191893.797183:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 703 00000100:00100000:3.0:1784191893.797194:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+127:123690:x1870858812441600:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.797216:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.797236:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ca18 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c16e expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.797344:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4ca1f lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.797359:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4ca1f lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.797370:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4ca1f lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.797384:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ca26 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.797392:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ca26 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.797398:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ca26 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191893.797850:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1e1:0x0], index 1: 0 00080000:00000400:3.0:1784191893.797882:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191893.797886:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191893.797889:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191893.797891:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191893.797893:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191893.797895:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191893.797914:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191893.797917:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191893.797918:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191893.797920:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191893.797922:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191893.797924:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191893.797953:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191893.797956:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191893.797957:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191893.797959:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191893.797961:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191893.797963:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191893.798063:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4ca2d lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.798076:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4ca2d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.798087:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4ca2d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.798145:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4ca1f lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.798153:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4ca1f lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.798170:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4ca1f lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.798178:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4ca1f lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.798184:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191893.798189:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4ca1f lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.798196:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4ca1f lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.798209:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191893.798212:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.798217:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4ca1f lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.798225:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7000/0xfeec3c2dc5a4ca1f lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191893.798239:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006fd8e609 reply state 00000000d4c3c9ab transno 34359738778 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ca26 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.798250:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ca26 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.798256:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe708c894 (ffff8af207499600) 00010000:00010000:3.0:1784191893.798259:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191893.798262:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784191893.798303:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ca18 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c16e expref: 130 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.798318:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4ca2d lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c16e expref: 129 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.798325:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x3f:0x0].0x0 (ffff8af207499a00) 00010000:00010000:3.0:1784191893.798327:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784191893.798330:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7a00, rc 0) 00000100:00100000:3.0:1784191893.798401:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+130:123690:x1870858812441600:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1208us (1400us total) trans 34359738778 rc 0/0 00000100:00100000:3.0:1784191893.798409:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 703 00000100:00100000:1.0:1784191893.802860:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.802971:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812441728 00000100:00100000:2.0:1784191893.802979:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812441728 00000100:00100000:2.0:1784191893.803032:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 376 00000100:00100000:2.0:1784191893.803041:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+35:69110:x1870858812441728:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.803069:0:162394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.803103:0:162394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4ca3b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c175 expref: -99 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191893.803127:0:162394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191893.803147:0:162394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e1:0x0].0x0 since=5513s v=(0 0) 00010000:00010000:2.0:1784191893.803151:0:162394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.803162:0:162394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4ca3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c175 expref: 36 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.803179:0:162394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4ca3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c175 expref: 36 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.803192:0:162394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7dc00, rc 0) 00000100:00100000:2.0:1784191893.803249:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:69110:x1870858812441728:12345-192.168.204.16@tcp:101:cp.0 Request processed in 209us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.803256:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 376 00000100:00100000:1.0:1784191893.806438:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.806533:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812441856 00000100:00100000:3.0:1784191893.806544:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812441856 00000100:00100000:3.0:1784191893.806609:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 377 00000100:00100000:3.0:1784191893.806621:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:123690:x1870858812441856:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.806641:0:162398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.806663:0:162398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c46a14a/0xfeec3c2dc5a4ca42 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c17c expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.806743:0:162398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4ca3b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c175 expref: 37 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.806751:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.806756:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.806761:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c46a14a/0xfeec3c2dc5a4ca42 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c17c expref: 37 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.806823:0:162398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4ca3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c175 expref: 37 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.806837:0:162398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4ca3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c175 expref: 37 pid: 162394 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191893.806850:0:162398:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109199880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:162398:1870858827973376:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191893.807050:0:162398:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fd480 going to sleep for 11 seconds 00000100:00100000:2.0:1784191893.812289:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.812500:0:162398:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109199880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:162398:1870858827973376:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191893.812549:0:162398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c46a14a/0xfeec3c2dc5a4ca42 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c17c expref: 37 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.812575:0:162398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7000, rc 0) 00000100:00100000:3.0:1784191893.812647:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+37:123690:x1870858812441856:12345-192.168.204.16@tcp:101:cp.0 Request processed in 6029us (6220us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191893.812656:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 377 00000100:00100000:0.0:1784191893.813949:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812441984 00000100:00100000:0.0:1784191893.813961:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812441984 00010000:00010000:0.0:1784191893.814004:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4ca3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c175 expref: 37 pid: 162394 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.814075:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 192 00000100:00100000:0.0:1784191893.814085:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+37:69112:x1870858812441984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191893.814112:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191893.814136:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4ca3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c175 expref: 37 pid: 162394 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.814152:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4ca3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c175 expref: 37 pid: 162394 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.814179:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4ca3b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c175 expref: 37 pid: 162394 timeout: 5613 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.814200:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.814204:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.814214:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c46a14a/0xfeec3c2dc5a4ca42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c17c expref: 36 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.814250:0:158650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c46a14a/0xfeec3c2dc5a4ca42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c17c expref: 36 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.814290:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009c46a14a/0xfeec3c2dc5a4ca42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c17c expref: 36 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.814305:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfaaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:158650:1870858827973504:192.168.204.16@tcp:105: 00000100:00100000:0.0:1784191893.814392:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9e240 going to sleep for 11 seconds 00000100:00100000:2.0:1784191893.818320:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.818414:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfaaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:158650:1870858827973504:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191893.818455:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191893.818540:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:69112:x1870858812441984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4456us (6262us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191893.818552:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 192 00000100:00100000:3.0:1784191893.819733:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812442240 00000100:00100000:3.0:1784191893.819746:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812442240 00000100:00100000:3.0:1784191893.819804:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 199 00000100:00100000:3.0:1784191893.819815:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+130:123690:x1870858812442240:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191893.820169:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+131:123690:x1870858812442240:12345-192.168.204.16@tcp:35:cp.0 Request processed in 355us (1859us total) trans 34359738779 rc 0/0 00000100:00100000:3.0:1784191893.820177:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 199 00000100:00100000:2.0:1784191893.824027:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.824124:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812442368 00000100:00100000:1.0:1784191893.824135:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812442368 00000100:00100000:1.0:1784191893.824223:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 704 00000100:00100000:1.0:1784191893.824234:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+131:123690:x1870858812442368:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191893.824263:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191893.824289:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ca49 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c183 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824367:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4ca50 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824384:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4ca50 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824399:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4ca50 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824417:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4ca57 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824423:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4ca57 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824430:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4ca57 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824487:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4ca50 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824495:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4ca50 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824501:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4ca50 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824530:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4ca50 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824536:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3f000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.824540:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4ca50 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824548:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4ca50 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824561:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.824565:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.824570:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4ca50 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824577:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4ca50 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824595:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4ca57 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824601:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4ca57 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824607:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4ca57 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824611:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.824614:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4ca57 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824630:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4ca57 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824638:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xd13f1037 (ffff8af20dabc900) 00010000:00010000:1.0:1784191893.824640:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.824643:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4ca57 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824649:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4ca57 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824685:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ca49 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c183 expref: 132 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824858:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.824861:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.824865:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ca49 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c183 expref: 132 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.824875:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3ec00, rc 0) 00000100:00100000:1.0:1784191893.824936:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+131:123690:x1870858812442368:12345-192.168.204.16@tcp:101:cp.0 Request processed in 705us (920us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191893.824943:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 704 00000100:00100000:2.0:1784191893.827620:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.827743:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812442496 00000100:00100000:3.0:1784191893.827755:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812442496 00000100:00100000:3.0:1784191893.827813:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 705 00000100:00100000:3.0:1784191893.827825:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+131:123690:x1870858812442496:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.827849:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.827878:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4ca5e lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c18a expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.827951:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ca65 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.827965:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ca65 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.827975:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ca65 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.827990:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ca6c lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.827997:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ca6c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.828003:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ca6c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.828049:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ca65 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.828057:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ca65 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.828087:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ca65 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.828094:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ca65 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.828100:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191893.828105:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ca65 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.828113:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ca65 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.828127:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191893.828130:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.828135:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ca65 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.828143:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ca65 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.828159:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ca6c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.828165:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ca6c lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.828171:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ca6c lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.828177:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010be000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191893.828187:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ca6c lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.828194:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ca6c lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.828202:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xd13f1037 (ffff8af207499f00) 00010000:00010000:3.0:1784191893.828204:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.828207:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ca6c lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.828213:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ca6c lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.828249:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4ca5e lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c18a expref: 132 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.828260:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191893.828263:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.828266:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4ca5e lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c18a expref: 132 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.828275:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6600, rc 0) 00000100:00100000:3.0:1784191893.828347:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+131:123690:x1870858812442496:12345-192.168.204.16@tcp:101:cp.0 Request processed in 525us (737us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191893.828355:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 705 00000100:00100000:2.0:1784191893.832244:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.832337:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812442752 00000100:00100000:3.0:1784191893.832351:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812442752 00000100:00100000:3.0:1784191893.832421:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 706 00000100:00100000:3.0:1784191893.832432:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+131:123690:x1870858812442752:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.832479:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.832504:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4ca73 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c191 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.832647:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4ca7a lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.832663:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4ca7a lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.832675:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4ca7a lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.832735:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4ca81 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.832742:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4ca81 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.832749:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4ca81 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191893.833109:0:158667:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x265:0x0], index 0: 0 00080000:00000400:3.0:1784191893.833124:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191893.833128:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191893.833130:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191893.833133:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191893.833135:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191893.833137:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191893.833156:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191893.833159:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191893.833170:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191893.833172:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191893.833174:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191893.833176:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191893.833212:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191893.833215:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191893.833217:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191893.833219:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191893.833221:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191893.833223:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191893.833323:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4ca88 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.833333:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4ca88 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.833341:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4ca88 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.833377:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4ca7a lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.833384:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4ca7a lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.833390:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4ca7a lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.833397:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4ca7a lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.833403:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191893.833407:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4ca7a lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.833422:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4ca7a lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.833435:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191893.833437:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.833443:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4ca7a lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.833449:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4ca7a lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191893.833463:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e2b1f4cf reply state 000000003f96ffd5 transno 34359738780 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4ca81 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.833474:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4ca81 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.833480:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xd13f1037 (ffff8af110071c00) 00010000:00010000:3.0:1784191893.833483:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191893.833485:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784191893.833533:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5800/0xfeec3c2dc5a4ca73 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c191 expref: 134 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.833550:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4ca88 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c191 expref: 133 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.833558:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x40:0x0].0x0 (ffff8af110071f00) 00010000:00010000:3.0:1784191893.833560:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784191893.833562:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4800, rc 0) 00000100:00100000:3.0:1784191893.833657:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+134:123690:x1870858812442752:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1225us (1423us total) trans 34359738780 rc 0/0 00000100:00100000:3.0:1784191893.833665:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 706 00000100:00100000:2.0:1784191893.839212:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.839305:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812442880 00000100:00100000:0.0:1784191893.839315:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812442880 00000100:00100000:0.0:1784191893.839372:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 378 00000100:00100000:0.0:1784191893.839382:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:69112:x1870858812442880:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.839401:0:162387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.839422:0:162387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4ca96 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c198 expref: -99 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191893.839457:0:162387:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x265:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191893.839476:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x265:0x0].0x0 since=5514s v=(0 0) 00010000:00010000:0.0:1784191893.839480:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x265:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.839503:0:162387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4ca96 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c198 expref: 37 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.839534:0:162387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4ca96 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c198 expref: 37 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.839547:0:162387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233127000, rc 0) 00000100:00100000:0.0:1784191893.839610:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+37:69112:x1870858812442880:12345-192.168.204.16@tcp:101:cp.0 Request processed in 228us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191893.839617:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 378 00000100:00100000:2.0:1784191893.862932:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.863027:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812443008 00000100:00100000:0.0:1784191893.863038:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812443008 00000100:00100000:0.0:1784191893.863103:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 379 00000100:00100000:0.0:1784191893.863113:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+37:123690:x1870858812443008:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.863132:0:162392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.863153:0:162392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3c6a7cd/0xfeec3c2dc5a4ca9d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x265:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c19f expref: -99 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.863191:0:162392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4ca96 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x265:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c198 expref: 38 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.863200:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x265:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.863205:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x265:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191893.863210:0:162392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3c6a7cd/0xfeec3c2dc5a4ca9d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x265:0x0].0x0 rrc: 3 type: EXT [0->229375] (req 0->229375) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c19f expref: 38 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.863273:0:162392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4ca96 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x265:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c198 expref: 38 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.863287:0:162392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4ca96 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x265:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c198 expref: 38 pid: 162387 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191893.863301:0:162392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfaaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:162392:1870858827973632:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191893.863449:0:162392:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9e240 going to sleep for 11 seconds 00000100:00100000:1.0:1784191893.866202:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.866412:0:162392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfaaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:162392:1870858827973632:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191893.866459:0:162392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d3c6a7cd/0xfeec3c2dc5a4ca9d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x265:0x0].0x0 rrc: 3 type: EXT [0->229375] (req 0->229375) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c19f expref: 38 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.866483:0:162392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233126a00, rc 0) 00000100:00100000:0.0:1784191893.866560:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+38:123690:x1870858812443008:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3447us (3638us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191893.866569:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 379 00000100:00100000:2.0:1784191893.867122:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812443136 00000100:00100000:2.0:1784191893.867132:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812443136 00010000:00010000:2.0:1784191893.867194:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4ca96 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x265:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c198 expref: 38 pid: 162387 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.867242:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 193 00000100:00100000:2.0:1784191893.867253:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+38:69110:x1870858812443136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191893.867269:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191893.867294:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4ca96 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x265:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c198 expref: 38 pid: 162387 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.867308:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4ca96 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x265:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c198 expref: 38 pid: 162387 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.867334:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024c384c2/0xfeec3c2dc5a4ca96 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x265:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c198 expref: 38 pid: 162387 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.867351:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x265:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.867356:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x265:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.867364:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3c6a7cd/0xfeec3c2dc5a4ca9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x265:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c19f expref: 37 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.867375:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3c6a7cd/0xfeec3c2dc5a4ca9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x265:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c19f expref: 37 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.867409:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d3c6a7cd/0xfeec3c2dc5a4ca9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x265:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c19f expref: 37 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.867437:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827973760:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191893.867878:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cd2f240 going to sleep for 11 seconds 00000100:00100000:2.0:1784191893.873814:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:160189:1870858827973760:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191893.873845:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191893.873915:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+37:69110:x1870858812443136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6662us (7723us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.873931:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 193 00000100:00100000:1.0:1784191893.877770:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.877932:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812443392 00000100:00100000:3.0:1784191893.877944:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812443392 00000100:00100000:3.0:1784191893.878015:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 200 00000100:00100000:3.0:1784191893.878028:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+134:123690:x1870858812443392:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191893.878358:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+135:123690:x1870858812443392:12345-192.168.204.16@tcp:35:cp.0 Request processed in 332us (599us total) trans 34359738781 rc 0/0 00000100:00100000:3.0:1784191893.878367:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 200 00000100:00100000:1.0:1784191893.882542:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.882642:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812443520 00000100:00100000:0.0:1784191893.882652:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812443520 00000100:00100000:0.0:1784191893.882753:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 707 00000100:00100000:0.0:1784191893.882765:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+135:123690:x1870858812443520:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.882792:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.882816:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4caa4 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c1a6 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.882903:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4caab lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.882916:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4caab lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.882928:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4caab lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.882942:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cab2 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.882949:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cab2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.882954:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cab2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.882998:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4caab lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.883005:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4caab lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.883010:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4caab lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.883016:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4caab lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.883021:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191893.883033:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4caab lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.883041:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4caab lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.883052:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191893.883055:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.883060:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4caab lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.883066:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4caab lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.883078:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cab2 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.883083:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cab2 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.883089:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cab2 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.883108:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191893.883111:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cab2 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.883116:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cab2 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.883123:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xc701cb36 (ffff8af216687a00) 00010000:00010000:0.0:1784191893.883125:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.883134:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cab2 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.883140:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cab2 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.883175:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4caa4 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1a6 expref: 136 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.883184:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191893.883186:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.883189:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4caa4 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1a6 expref: 136 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.883197:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233127800, rc 0) 00000100:00100000:0.0:1784191893.883253:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+135:123690:x1870858812443520:12345-192.168.204.16@tcp:101:cp.0 Request processed in 492us (723us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191893.883260:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 707 00000100:00100000:1.0:1784191893.886562:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.886643:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812443648 00000100:00100000:0.0:1784191893.886655:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812443648 00000100:00100000:0.0:1784191893.886756:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 708 00000100:00100000:0.0:1784191893.886767:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+135:123690:x1870858812443648:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.886793:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.886816:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127200/0xfeec3c2dc5a4cab9 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c1ad expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.886889:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cac0 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.886925:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cac0 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.886938:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cac0 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.886956:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cac7 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.886963:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cac7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.886969:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cac7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.887021:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cac0 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.887029:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cac0 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.887035:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cac0 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.887041:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cac0 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.887048:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233126600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191893.887053:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cac0 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.887061:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cac0 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.887082:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191893.887085:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.887215:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cac0 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.887224:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cac0 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.887239:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cac7 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.887244:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cac7 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.887250:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cac7 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.887254:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233126800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191893.887257:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cac7 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.887262:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cac7 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.887271:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xc701cb36 (ffff8af214e83c00) 00010000:00010000:0.0:1784191893.887273:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.887275:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cac7 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.887280:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cac7 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.887324:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127200/0xfeec3c2dc5a4cab9 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1ad expref: 136 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.887335:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191893.887337:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.887341:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127200/0xfeec3c2dc5a4cab9 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1ad expref: 136 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.887353:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233127200, rc 0) 00000100:00100000:0.0:1784191893.887409:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+135:123690:x1870858812443648:12345-192.168.204.16@tcp:101:cp.0 Request processed in 645us (858us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191893.887417:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 708 00000100:00100000:1.0:1784191893.890969:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.891086:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812443904 00000100:00100000:2.0:1784191893.891107:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812443904 00000100:00100000:2.0:1784191893.891171:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 709 00000100:00100000:2.0:1784191893.891181:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+135:123690:x1870858812443904:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.891203:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.891224:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cace lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c1b4 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.891336:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cad5 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.891350:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cad5 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.891362:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cad5 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.891376:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4cadc lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.891396:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4cadc lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.891403:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4cadc lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191893.891824:0:158665:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1e2:0x0], index 1: 0 00080000:00000400:2.0:1784191893.891837:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.891841:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.891843:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.891845:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.891847:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.891849:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191893.891866:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.891869:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.891870:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.891872:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.891874:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.891877:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191893.891906:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.891910:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.891911:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.891913:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.891914:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.891916:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191893.892007:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4cae3 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.892017:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4cae3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.892035:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4cae3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.892072:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cad5 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.892079:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cad5 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.892085:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cad5 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.892090:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cad5 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.892096:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7de00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.892100:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cad5 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.892107:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cad5 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.892117:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.892120:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.892124:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cad5 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.892130:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cad5 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191893.892149:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b9c37f36 reply state 000000000f308ddd transno 34359738782 ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4cadc lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.892168:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4cadc lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.892174:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xc701cb36 (ffff8af2382d2700) 00010000:00010000:2.0:1784191893.892177:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191893.892180:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191893.892211:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cace lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1b4 expref: 138 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.892226:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4cae3 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1b4 expref: 137 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.892234:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x41:0x0].0x0 (ffff8af2382d2d00) 00010000:00010000:2.0:1784191893.892236:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191893.892239:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7d200, rc 0) 00000100:00100000:2.0:1784191893.892299:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+138:123690:x1870858812443904:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1119us (1344us total) trans 34359738782 rc 0/0 00000100:00100000:2.0:1784191893.892307:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 709 00000100:00100000:1.0:1784191893.896967:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.897044:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812444032 00000100:00100000:2.0:1784191893.897055:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812444032 00000100:00100000:2.0:1784191893.897134:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 380 00000100:00100000:2.0:1784191893.897146:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+36:69110:x1870858812444032:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.897166:0:162389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.897193:0:162389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4caf1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c1bb expref: -99 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191893.897220:0:162389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191893.897258:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e2:0x0].0x0 since=5514s v=(0 0) 00010000:00010000:2.0:1784191893.897263:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.897273:0:162389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4caf1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1bb expref: 37 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.897292:0:162389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4caf1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1bb expref: 37 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.897305:0:162389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7da00, rc 0) 00000100:00100000:2.0:1784191893.897365:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+37:69110:x1870858812444032:12345-192.168.204.16@tcp:101:cp.0 Request processed in 221us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.897372:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 380 00000100:00100000:1.0:1784191893.908625:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.908837:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812444160 00000100:00100000:3.0:1784191893.908848:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812444160 00000100:00100000:3.0:1784191893.908974:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 381 00000100:00100000:3.0:1784191893.908986:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+37:123690:x1870858812444160:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.909007:0:162385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.909030:0:162385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4caf8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c1c2 expref: -99 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.909069:0:162385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4caf1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1bb expref: 38 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.909077:0:162385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.909083:0:162385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.909089:0:162385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4caf8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1c2 expref: 38 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.909152:0:162385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4caf1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1bb expref: 38 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.909167:0:162385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4caf1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1bb expref: 38 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191893.909182:0:162385:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109199880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:162385:1870858827973888:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191893.909312:0:162385:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fde40 going to sleep for 11 seconds 00000100:00100000:3.0:1784191893.912791:0:162385:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109199880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:162385:1870858827973888:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191893.912832:0:162385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4caf8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1c2 expref: 38 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.912854:0:162385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d5800, rc 0) 00000100:00100000:2.0:1784191893.913554:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+38:123690:x1870858812444160:12345-192.168.204.16@tcp:101:cp.0 Request processed in 4565us (4934us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.913566:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 381 00000100:00100000:1.0:1784191893.914842:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.914956:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812444288 00000100:00100000:2.0:1784191893.914966:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812444288 00010000:00010000:2.0:1784191893.915007:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4caf1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1bb expref: 38 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.915100:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 194 00000100:00100000:2.0:1784191893.915112:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+38:69112:x1870858812444288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191893.915132:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191893.915156:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4caf1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1bb expref: 38 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.915196:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4caf1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1bb expref: 38 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.915221:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4caf1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1bb expref: 38 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.915241:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.915245:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.915253:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4caf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1c2 expref: 37 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.915263:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4caf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1c2 expref: 37 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.915301:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4caf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1c2 expref: 37 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.915315:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827974016:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191893.915395:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cd2ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1784191893.921614:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.921758:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827974016:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191893.921784:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191893.921846:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+37:69112:x1870858812444288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6735us (7012us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.921857:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 194 00000100:00100000:3.0:1784191893.922105:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812444544 00000100:00100000:3.0:1784191893.922113:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812444544 00000100:00100000:3.0:1784191893.922196:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 201 00000100:00100000:3.0:1784191893.922206:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+138:123690:x1870858812444544:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191893.922590:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+139:123690:x1870858812444544:12345-192.168.204.16@tcp:35:cp.0 Request processed in 384us (986us total) trans 34359738783 rc 0/0 00000100:00100000:3.0:1784191893.922598:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 201 00000100:00100000:1.0:1784191893.926624:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.926861:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812444672 00000100:00100000:3.0:1784191893.926873:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812444672 00000100:00100000:3.0:1784191893.926990:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 710 00000100:00100000:3.0:1784191893.927001:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+139:123690:x1870858812444672:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.927045:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.927070:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4caff lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c1c9 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927172:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cb06 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927188:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cb06 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927200:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cb06 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927218:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cb0d lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927225:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cb0d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927232:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cb0d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927275:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cb06 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927282:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cb06 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927289:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cb06 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927295:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cb06 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927308:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191893.927313:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cb06 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927321:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cb06 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927334:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191893.927338:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.927342:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cb06 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927349:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cb06 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927363:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cb0d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927368:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cb0d lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927374:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cb0d lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927379:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010be000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191893.927382:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cb0d lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927387:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cb0d lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927407:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x322afea2 (ffff8af207499f00) 00010000:00010000:3.0:1784191893.927409:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.927412:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cb0d lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927418:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cb0d lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927532:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4caff lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1c9 expref: 140 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927544:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191893.927547:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.927551:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4caff lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1c9 expref: 140 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.927561:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4600, rc 0) 00000100:00100000:3.0:1784191893.927733:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+139:123690:x1870858812444672:12345-192.168.204.16@tcp:101:cp.0 Request processed in 684us (1071us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191893.927742:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 710 00000100:00100000:1.0:1784191893.931989:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.932233:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812444800 00000100:00100000:3.0:1784191893.932243:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812444800 00000100:00100000:3.0:1784191893.932311:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 711 00000100:00100000:3.0:1784191893.932321:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+139:123690:x1870858812444800:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.932344:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.932369:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4cb14 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c1d0 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932605:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cb1b lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932620:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cb1b lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932633:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cb1b lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932648:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cb22 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932654:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cb22 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932661:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cb22 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932811:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cb1b lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932819:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cb1b lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932825:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cb1b lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932831:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cb1b lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932837:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191893.932849:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cb1b lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932857:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cb1b lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932871:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191893.932874:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.932878:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cb1b lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932885:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cb1b lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932896:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cb22 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932903:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cb22 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932908:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cb22 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932913:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191893.932915:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cb22 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932921:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cb22 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932928:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x322afea2 (ffff8af203904900) 00010000:00010000:3.0:1784191893.932931:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.932940:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cb22 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.932945:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cb22 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.933055:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4cb14 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1d0 expref: 140 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.933066:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191893.933068:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191893.933072:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4cb14 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1d0 expref: 140 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.933081:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6600, rc 0) 00000100:00100000:3.0:1784191893.933301:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+139:123690:x1870858812444800:12345-192.168.204.16@tcp:101:cp.0 Request processed in 981us (1332us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191893.933310:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 711 00000100:00100000:1.0:1784191893.936845:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.936937:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812445056 00000100:00100000:0.0:1784191893.936947:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812445056 00000100:00100000:0.0:1784191893.937180:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 712 00000100:00100000:0.0:1784191893.937193:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+139:123690:x1870858812445056:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191893.937217:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191893.937240:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127200/0xfeec3c2dc5a4cb29 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c1d7 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.937355:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cb30 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.937369:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cb30 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.937380:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cb30 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.937415:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cb37 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.937423:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cb37 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.937429:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cb37 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191893.937815:0:164531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x266:0x0], index 0: 0 00080000:00000400:0.0:1784191893.937831:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191893.937835:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191893.937838:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191893.937840:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191893.937842:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191893.937844:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191893.937862:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191893.937865:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191893.937867:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191893.937869:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191893.937871:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191893.937873:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191893.937904:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:0.0:1784191893.937907:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191893.937909:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191893.937910:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191893.937912:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191893.937914:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191893.938031:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4cb3e lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.938057:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4cb3e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.938066:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4cb3e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.938371:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cb30 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.938379:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cb30 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.938386:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cb30 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.938393:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cb30 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.938398:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233126800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191893.938403:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cb30 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.938410:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cb30 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.938422:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191893.938425:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191893.938429:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cb30 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.938494:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cb30 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191893.938525:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fe18dd7c reply state 0000000031ce843e transno 34359738784 ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cb37 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.938538:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cb37 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.938544:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x322afea2 (ffff8af214e83c00) 00010000:00010000:0.0:1784191893.938546:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191893.938549:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191893.938585:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127200/0xfeec3c2dc5a4cb29 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1d7 expref: 142 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.938601:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4cb3e lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1d7 expref: 141 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191893.938608:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x42:0x0].0x0 (ffff8af214e83600) 00010000:00010000:0.0:1784191893.938610:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191893.938612:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233127800, rc 0) 00000100:00100000:0.0:1784191893.938750:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+142:123690:x1870858812445056:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1500us (2006us total) trans 34359738784 rc 0/0 00000100:00100000:0.0:1784191893.938760:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 712 00000100:00100000:1.0:1784191893.943241:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.943326:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812445184 00000100:00100000:3.0:1784191893.943337:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812445184 00000100:00100000:3.0:1784191893.943398:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 382 00000100:00100000:3.0:1784191893.943409:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+37:69112:x1870858812445184:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.943428:0:160166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.943462:0:160166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4cb4c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c1de expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191893.943490:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x266:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784191893.943524:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x266:0x0].0x0 since=5514s v=(0 0) 00010000:00010000:3.0:1784191893.943549:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x266:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.943561:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4cb4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1de expref: 38 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.943582:0:160166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4cb4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1de expref: 38 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.943598:0:160166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d533200, rc 0) 00000100:00100000:3.0:1784191893.943662:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+38:69112:x1870858812445184:12345-192.168.204.16@tcp:101:cp.0 Request processed in 255us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191893.943670:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 382 00000100:00100000:1.0:1784191893.947367:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.947743:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812445312 00000100:00100000:3.0:1784191893.947755:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812445312 00000100:00100000:3.0:1784191893.947811:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 383 00000100:00100000:3.0:1784191893.947821:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+38:123690:x1870858812445312:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191893.947838:0:162386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191893.947858:0:162386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c5c492b/0xfeec3c2dc5a4cb53 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x266:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c1e5 expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.947891:0:162386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4cb4c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1de expref: 39 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.947901:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x266:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.947905:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x266:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191893.947911:0:162386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c5c492b/0xfeec3c2dc5a4cb53 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x266:0x0].0x0 rrc: 3 type: EXT [0->90111] (req 0->90111) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1e5 expref: 39 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.947980:0:162386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4cb4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1de expref: 39 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.947995:0:162386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4cb4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1de expref: 39 pid: 160166 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191893.948011:0:162386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109199880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:162386:1870858827974144:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191893.948088:0:162386:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fde40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191893.950612:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.950738:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812445440 00000100:00100000:2.0:1784191893.950748:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812445440 00010000:00010000:2.0:1784191893.950789:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4cb4c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1de expref: 40 pid: 160166 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.950821:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 195 00000100:00100000:2.0:1784191893.950831:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23b102050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:69110:x1870858812445440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191893.950846:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191893.950869:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4cb4c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x266:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1de expref: 40 pid: 160166 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.950887:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4cb4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x266:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1de expref: 40 pid: 160166 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.950911:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x266:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.950916:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x266:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.950925:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c5c492b/0xfeec3c2dc5a4cb53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x266:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1e5 expref: 40 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.950936:0:158650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c5c492b/0xfeec3c2dc5a4cb53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x266:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1e5 expref: 40 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.950985:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005c5c492b/0xfeec3c2dc5a4cb53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x266:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1e5 expref: 40 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191893.951000:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:158650:1870858827974272:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191893.951106:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cd2ff00 going to sleep for 11 seconds 00010000:00010000:3.0:1784191893.952193:0:162386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4cb4c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x266:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1de expref: 40 pid: 160166 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191893.952215:0:162386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109199880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:162386:1870858827974144:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191893.952248:0:162386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c5c492b/0xfeec3c2dc5a4cb53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1e5 expref: 39 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191893.952261:0:162386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d532200, rc 0) 00000100:00100000:3.0:1784191893.952321:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+39:123690:x1870858812445312:12345-192.168.204.16@tcp:101:cp.0 Request processed in 4501us (4963us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191893.952329:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 383 00000100:00100000:1.0:1784191893.958593:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191893.958977:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812445696 00000100:00100000:3.0:1784191893.958986:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812445696 00000100:00100000:3.0:1784191893.959035:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 202 00000100:00100000:3.0:1784191893.959044:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+142:123690:x1870858812445696:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191893.959393:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+143:123690:x1870858812445696:12345-192.168.204.16@tcp:35:cp.0 Request processed in 349us (811us total) trans 34359738785 rc 0/0 00000100:00100000:3.0:1784191893.959402:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 202 00000100:00100000:1.0:1784191893.963038:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191893.963471:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:158650:1870858827974272:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191893.963501:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191893.963579:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23b102050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+38:69110:x1870858812445440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 12749us (12977us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191893.963591:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 195 00000100:00100000:3.0:1784191893.965001:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812445824 00000100:00100000:3.0:1784191893.965015:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812445824 00000100:00100000:2.0:1784191893.965401:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 713 00000100:00100000:2.0:1784191893.965414:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+143:123690:x1870858812445824:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.965453:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.965480:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4cb5a lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c1ec expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965569:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cb61 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965584:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cb61 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965597:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cb61 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965618:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cb68 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965625:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cb68 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965632:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cb68 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965683:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cb61 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965730:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cb61 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965760:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cb61 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965766:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cb61 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965772:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7d600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.965776:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cb61 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965783:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cb61 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965795:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.965798:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.965802:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cb61 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965808:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cb61 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965824:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cb68 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965829:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cb68 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965834:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cb68 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965838:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7de00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.965846:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cb68 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965852:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cb68 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965860:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xaa0c2c16 (ffff8af216603100) 00010000:00010000:2.0:1784191893.965863:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.965865:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cb68 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965870:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cb68 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965908:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4cb5a lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1ec expref: 144 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965919:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.965921:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.965924:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4cb5a lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1ec expref: 144 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.965932:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7da00, rc 0) 00000100:00100000:2.0:1784191893.966002:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+143:123690:x1870858812445824:12345-192.168.204.16@tcp:101:cp.0 Request processed in 591us (2974us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191893.966010:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 713 00000100:00100000:3.0:1784191893.968985:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191893.973379:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812445952 00000100:00100000:1.0:1784191893.973395:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812445952 00000100:00100000:1.0:1784191893.973482:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 714 00000100:00100000:1.0:1784191893.973493:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+143:123690:x1870858812445952:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191893.973523:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191893.973545:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cb6f lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c1f3 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.973621:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cb76 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.973636:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cb76 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.973648:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cb76 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.973900:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cb7d lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.973911:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cb7d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.973918:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cb7d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.973961:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cb76 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.973968:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cb76 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.973974:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cb76 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.973981:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cb76 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.973987:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200031a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.973992:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cb76 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.973999:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cb76 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.974013:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.974016:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.974020:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cb76 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.974035:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cb76 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.974052:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cb7d lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.974057:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cb7d lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.974063:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cb7d lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.974067:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191893.974070:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cb7d lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.974075:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cb7d lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.974083:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xaa0c2c16 (ffff8af20dabc900) 00010000:00010000:1.0:1784191893.974086:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.974089:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cb7d lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.974181:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cb7d lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.974218:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cb6f lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1f3 expref: 144 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.974241:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191893.974243:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191893.974247:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cb6f lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1f3 expref: 144 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191893.974257:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200030e00, rc 0) 00000100:00100000:1.0:1784191893.974366:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+143:123690:x1870858812445952:12345-192.168.204.16@tcp:101:cp.0 Request processed in 874us (5390us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191893.974374:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 714 00000100:00100000:3.0:1784191893.977875:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.978589:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812446208 00000100:00100000:2.0:1784191893.978602:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812446208 00000100:00100000:2.0:1784191893.978673:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 715 00000100:00100000:2.0:1784191893.978713:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+143:123690:x1870858812446208:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.978752:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.978778:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4cb84 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c1fa expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.978889:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cb8b lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.978904:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cb8b lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.978915:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cb8b lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.978929:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4cb92 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.978936:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4cb92 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.978942:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4cb92 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191893.979300:0:164531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1e3:0x0], index 1: 0 00080000:00000400:2.0:1784191893.979313:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.979317:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.979319:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.979322:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.979324:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.979326:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191893.979343:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.979346:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.979354:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.979356:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.979358:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.979360:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191893.979397:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191893.979400:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191893.979402:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191893.979404:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191893.979406:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191893.979407:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191893.979905:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4cb99 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.979917:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4cb99 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.979925:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4cb99 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.979959:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cb8b lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.979965:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cb8b lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.979970:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cb8b lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.979977:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cb8b lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.979983:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7c400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191893.979986:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cb8b lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.980002:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cb8b lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.980015:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191893.980018:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191893.980023:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cb8b lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.980030:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cb8b lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191893.980050:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000263a01fd reply state 00000000d5557a1d transno 34359738786 ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4cb92 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.980061:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4cb92 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.980067:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xaa0c2c16 (ffff8af216603d00) 00010000:00010000:2.0:1784191893.980069:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191893.980072:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191893.980375:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c600/0xfeec3c2dc5a4cb84 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1fa expref: 146 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.980393:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4cb99 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1fa expref: 145 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.980401:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x43:0x0].0x0 (ffff8af216603200) 00010000:00010000:2.0:1784191893.980403:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191893.980406:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7c000, rc 0) 00000100:00100000:2.0:1784191893.980722:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+146:123690:x1870858812446208:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2037us (2854us total) trans 34359738786 rc 0/0 00000100:00100000:2.0:1784191893.980731:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 715 00000100:00100000:1.0:1784191893.985070:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191893.985145:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812446336 00000100:00100000:2.0:1784191893.985155:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812446336 00000100:00100000:2.0:1784191893.985221:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 384 00000100:00100000:2.0:1784191893.985233:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+37:69109:x1870858812446336:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191893.985255:0:162394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191893.985278:0:162394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4cba7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c201 expref: -99 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191893.985308:0:162394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191893.985330:0:162394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e3:0x0].0x0 since=5514s v=(0 0) 00010000:00010000:2.0:1784191893.985336:0:162394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191893.985346:0:162394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4cba7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c201 expref: 38 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.985366:0:162394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4cba7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c201 expref: 38 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191893.985380:0:162394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7da00, rc 0) 00000100:00100000:2.0:1784191893.985453:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+38:69109:x1870858812446336:12345-192.168.204.16@tcp:101:cp.0 Request processed in 222us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191893.985461:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 384 00000100:00100000:1.0:1784191894.001912:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.002376:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812446464 00000100:00100000:2.0:1784191894.002387:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812446464 00000100:00100000:2.0:1784191894.002578:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 385 00000100:00100000:2.0:1784191894.002590:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+38:123690:x1870858812446464:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191894.002613:0:162391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191894.002634:0:162391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000794619ed/0xfeec3c2dc5a4cbae lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c208 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.002669:0:162391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4cba7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c201 expref: 39 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.002679:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191894.002739:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191894.002746:0:162391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000794619ed/0xfeec3c2dc5a4cbae lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->258047] (req 0->258047) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c208 expref: 39 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.002788:0:162391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4cba7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c201 expref: 39 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.002803:0:162391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4cba7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c201 expref: 39 pid: 162394 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191894.002818:0:162391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:162391:1870858827974400:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191894.002913:0:162391:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cd2ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1784191894.006428:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.006528:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812446592 00000100:00100000:3.0:1784191894.006538:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812446592 00010000:00010000:3.0:1784191894.006581:0:160189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4cba7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c201 expref: 40 pid: 162394 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191894.006627:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 196 00000100:00100000:3.0:1784191894.006637:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:69112:x1870858812446592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191894.006654:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191894.006677:0:160189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4cba7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c201 expref: 40 pid: 162394 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.006732:0:160189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4cba7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c201 expref: 40 pid: 162394 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.006761:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191894.006765:0:160189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191894.006773:0:160189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000794619ed/0xfeec3c2dc5a4cbae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c208 expref: 40 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.006804:0:160189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000794619ed/0xfeec3c2dc5a4cbae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c208 expref: 40 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.006846:0:160189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000794619ed/0xfeec3c2dc5a4cbae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c208 expref: 40 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191894.006860:0:160189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827974528:192.168.204.16@tcp:105: 00000100:00100000:3.0:1784191894.006944:0:160189:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fde40 going to sleep for 11 seconds 00000100:00100000:3.0:1784191894.009290:0:160189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:160189:1870858827974528:192.168.204.16@tcp:105: 00010000:00010000:3.0:1784191894.009323:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191894.009397:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:69112:x1870858812446592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2760us (2977us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191894.009409:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 196 00010000:00010000:2.0:1784191894.012577:0:162391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c527c55/0xfeec3c2dc5a4cba7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c201 expref: 39 pid: 162394 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191894.012610:0:162391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:162391:1870858827974400:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191894.012666:0:162391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000794619ed/0xfeec3c2dc5a4cbae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c208 expref: 38 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.012894:0:162391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7c600, rc 0) 00000100:00100000:2.0:1784191894.012975:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+38:123690:x1870858812446464:12345-192.168.204.16@tcp:101:cp.0 Request processed in 10386us (11074us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191894.012985:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 385 00000100:00100000:1.0:1784191894.021341:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.021426:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812446848 00000100:00100000:3.0:1784191894.021447:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812446848 00000100:00100000:3.0:1784191894.021521:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 203 00000100:00100000:3.0:1784191894.021533:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+146:123690:x1870858812446848:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191894.022097:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+147:123690:x1870858812446848:12345-192.168.204.16@tcp:35:cp.0 Request processed in 564us (764us total) trans 34359738787 rc 0/0 00000100:00100000:3.0:1784191894.022106:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 203 00000100:00100000:0.0:1784191894.025420:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.025605:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812446976 00000100:00100000:1.0:1784191894.025617:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812446976 00000100:00100000:1.0:1784191894.025818:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 716 00000100:00100000:1.0:1784191894.025830:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+147:123690:x1870858812446976:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191894.025857:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191894.025881:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cbb5 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c20f expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.025956:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cbbc lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.025971:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cbbc lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.025998:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cbbc lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026014:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cbc3 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026021:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cbc3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026027:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cbc3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026069:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cbbc lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026076:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cbbc lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026082:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cbbc lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026088:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cbbc lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026108:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.026113:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cbbc lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026120:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cbbc lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026131:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.026141:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.026147:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cbbc lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026154:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cbbc lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026171:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cbc3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026177:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cbc3 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026183:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cbc3 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026189:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200031a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.026191:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cbc3 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026197:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cbc3 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026205:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xd47b514a (ffff8af20dabc900) 00010000:00010000:1.0:1784191894.026207:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.026209:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cbc3 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026214:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cbc3 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026247:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cbb5 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c20f expref: 148 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026265:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.026268:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.026273:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cbb5 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c20f expref: 148 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.026282:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200030c00, rc 0) 00000100:00100000:1.0:1784191894.026355:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+147:123690:x1870858812446976:12345-192.168.204.16@tcp:101:cp.0 Request processed in 528us (945us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191894.026362:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 716 00010000:00010000:0.0:1784191894.031082:0:165481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b2b0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4b2b7 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191894.031114:0:165481:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b2b0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4b2b7 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.031160:0:165481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b2b0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b2b7 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.031167:0:165481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784191894.031207:0:165481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9800/0xfeec3c2dc5a4b2b0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b2b7 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.031232:0:165481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b1f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4b1fa expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191894.031240:0:165481:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b1f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4b1fa expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.031257:0:165481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b1f3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b1fa expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.031263:0:165481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784191894.031279:0:165481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20341b400/0xfeec3c2dc5a4b1f3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b1fa expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.031292:0:165481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4b136 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4b13d expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191894.031299:0:165481:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4b136 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4b13d expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.031326:0:165481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4b136 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b13d expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.031331:0:165481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784191894.031337:0:165481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3e600/0xfeec3c2dc5a4b136 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b13d expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.031351:0:165481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9a00/0xfeec3c2dc5a4b079 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4b080 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191894.031357:0:165481:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9a00/0xfeec3c2dc5a4b079 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4b080 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.031372:0:165481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9a00/0xfeec3c2dc5a4b079 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b080 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.031378:0:165481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784191894.031383:0:165481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b9a00/0xfeec3c2dc5a4b079 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4b080 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.031396:0:165481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4afd1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4afd8 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191894.031403:0:165481:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4afd1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4afd8 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.031418:0:165481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4afd1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4afd8 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191894.031553:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827974656:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191894.031629:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191894.031678:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784191894.031728:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827975040:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191894.031753:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191894.031789:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827974656 00000100:00100000:3.0:1784191894.031797:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827974656 00000100:00100000:3.0:1784191894.031845:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827975040 00000100:00100000:3.0:1784191894.031848:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827975040 00000100:00100000:3.0:1784191894.031878:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784191894.031886:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+16:106500:x1870858827974656:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1784191894.031900:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191894.031922:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341bc00/0xfeec3c2dc5a4b2b7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9feaf7a7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b2b0 expref: 16 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.031937:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9feaf7a7 (ffff8af210dfe700) 00010000:00010000:3.0:1784191894.031946:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191894.031982:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+15:106500:x1870858827974656:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 95us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191894.031988:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784191894.032007:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784191894.032014:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+14:106500:x1870858827975040:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1784191894.032023:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191894.032035:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2a00/0xfeec3c2dc5a4b080 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a253ddb bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b079 expref: 14 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.032044:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a253ddb (ffff8af110071d00) 00010000:00010000:3.0:1784191894.032051:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191894.032076:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+13:106500:x1870858827975040:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 62us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191894.032106:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784191894.032145:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827975040:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191894.032154:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827974656:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1784191894.032587:0:165481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784191894.032602:0:165481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af10de3fc00/0xfeec3c2dc5a4afd1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4afd8 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.032620:0:165481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4af29 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4af30 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191894.032628:0:165481:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4af29 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4af30 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.032651:0:165481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4af29 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4af30 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.032656:0:165481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784191894.032661:0:165481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af110db3400/0xfeec3c2dc5a4af29 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4af30 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.032674:0:165481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e600/0xfeec3c2dc5a4ae81 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4ae88 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191894.032706:0:165481:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e600/0xfeec3c2dc5a4ae81 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4ae88 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.032725:0:165481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e600/0xfeec3c2dc5a4ae81 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ae88 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.032731:0:165481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784191894.032736:0:165481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7e600/0xfeec3c2dc5a4ae81 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ae88 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.032757:0:165481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8400/0xfeec3c2dc5a4add9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4ade0 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191894.032765:0:165481:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8400/0xfeec3c2dc5a4add9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4ade0 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.032780:0:165481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8400/0xfeec3c2dc5a4add9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ade0 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.032786:0:165481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784191894.032792:0:165481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8400/0xfeec3c2dc5a4add9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ade0 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.032803:0:165481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8000/0xfeec3c2dc5a4ad31 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4ad38 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191894.032810:0:165481:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8000/0xfeec3c2dc5a4ad31 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4ad38 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.032824:0:165481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8000/0xfeec3c2dc5a4ad31 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ad38 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.032830:0:165481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784191894.032834:0:165481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af1115b8000/0xfeec3c2dc5a4ad31 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ad38 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.032846:0:165481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4ac89 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4ac90 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191894.032864:0:165481:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4ac89 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4ac90 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.032883:0:165481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4ac89 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ac90 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.032889:0:165481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784191894.032894:0:165481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8af20cd7f600/0xfeec3c2dc5a4ac89 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4ac90 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784191894.032907:0:165481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769803808 is committed 00000020:00080000:0.0:1784191894.032927:0:165481:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af10f82f840 refcount 2 committed 0 result 0 batchid 21474836546 00000020:00080000:0.0:1784191894.032931:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af22de73f00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8af10f82fa80 00000020:00080000:0.0:1784191894.032934:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab4:0x2:0x0].10 00000020:00080000:0.0:1784191894.032936:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af22de73400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af1086bb200 00000020:00080000:0.0:1784191894.032938:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002b10:0x2:0x0].10 00000020:00080000:0.0:1784191894.032949:0:165481:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af2057fe000 refcount 2 committed 0 result 0 batchid 21474836545 00000020:00080000:0.0:1784191894.032952:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af22de73100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8af109911480 00000020:00080000:0.0:1784191894.032954:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab4:0x2:0x0].9 00000020:00080000:0.0:1784191894.032956:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af22de73a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af22df94a00 00000020:00080000:0.0:1784191894.032958:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002b10:0x2:0x0].9 00000020:00080000:0.0:1784191894.032969:0:165481:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af10ef50540 refcount 2 committed 0 result 0 batchid 21474836544 00000020:00080000:0.0:1784191894.032971:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23d3a9f00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8af10ef50900 00000020:00080000:0.0:1784191894.032974:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab4:0x2:0x0].8 00000020:00080000:0.0:1784191894.032976:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23d3a9300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af11177de00 00000020:00080000:0.0:1784191894.032986:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002b10:0x2:0x0].8 00000020:00080000:0.0:1784191894.032994:0:165481:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af107affe40 refcount 2 committed 0 result 0 batchid 21474836543 00000020:00080000:0.0:1784191894.032997:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23d3a9800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8af107aff300 00000020:00080000:0.0:1784191894.033000:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab4:0x2:0x0].7 00000020:00080000:0.0:1784191894.033002:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23d3a9d00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af11177d800 00000020:00080000:0.0:1784191894.033004:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002b10:0x2:0x0].7 00000020:00080000:0.0:1784191894.033012:0:165481:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af10f20fc00 refcount 2 committed 0 result 0 batchid 21474836542 00000020:00080000:0.0:1784191894.033015:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af22de73600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8af10f20f900 00000020:00080000:0.0:1784191894.033017:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab4:0x2:0x0].6 00000020:00080000:0.0:1784191894.033019:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af22de73200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af23d572200 00000020:00080000:0.0:1784191894.033021:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002b10:0x2:0x0].6 00000020:00080000:0.0:1784191894.033030:0:165481:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af23d0e23c0 refcount 2 committed 0 result 0 batchid 21474836541 00000020:00080000:0.0:1784191894.033032:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23d289f00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8af23d0e2c00 00000020:00080000:0.0:1784191894.033034:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab4:0x2:0x0].5 00000020:00080000:0.0:1784191894.033035:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af23d289400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af10c4e7600 00000020:00080000:0.0:1784191894.033038:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002b10:0x2:0x0].5 00000020:00080000:0.0:1784191894.033048:0:165481:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af107affb40 refcount 2 committed 0 result 0 batchid 21474836540 00000020:00080000:0.0:1784191894.033052:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af1075eac00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8af107aff540 00000020:00080000:0.0:1784191894.033054:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab4:0x2:0x0].4 00000020:00080000:0.0:1784191894.033056:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af1075ea000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af23d573400 00000020:00080000:0.0:1784191894.033058:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002b10:0x2:0x0].4 00000020:00080000:0.0:1784191894.033069:0:165481:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af107aff3c0 refcount 2 committed 0 result 0 batchid 21474836539 00000020:00080000:0.0:1784191894.033072:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af1075eab00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8af23e738c00 00000020:00080000:0.0:1784191894.033074:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab4:0x2:0x0].3 00000020:00080000:0.0:1784191894.033081:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af1075ea800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af10ddb4c00 00000020:00080000:0.0:1784191894.033083:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002b10:0x2:0x0].3 00000100:00100000:2.0:1784191894.033221:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827975552:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1784191894.033271:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191894.033299:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784191894.033304:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827975168:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1784191894.033323:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191894.033340:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827975680:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1784191894.033358:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1784191894.033376:0:165502:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179869212 00000100:00100000:2.0:1784191894.033555:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827975552 00000100:00100000:2.0:1784191894.033562:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827975552 00000100:00100000:2.0:1784191894.033594:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827975168 00000100:00100000:2.0:1784191894.033597:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827975168 00000100:00100000:2.0:1784191894.033607:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827975680 00000100:00100000:2.0:1784191894.033610:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827975680 00000100:00100000:2.0:1784191894.033625:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784191894.033632:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+15:106499:x1870858827975552:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1784191894.033644:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191894.033661:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4ade0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x30d22c80 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4add9 expref: 15 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.033711:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x30d22c80 (ffff8af210dfec00) 00010000:00010000:2.0:1784191894.033723:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191894.033761:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+14:106499:x1870858827975552:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 129us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191894.033767:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784191894.033785:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784191894.033791:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+13:106499:x1870858827975168:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1784191894.033798:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191894.033809:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4afd8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x96709776 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4afd1 expref: 13 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.033820:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x96709776 (ffff8af207498300) 00010000:00010000:2.0:1784191894.033827:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191894.033847:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+12:106499:x1870858827975168:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 57us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191894.033853:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784191894.033867:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784191894.033872:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:106499:x1870858827975680:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1784191894.033879:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191894.033890:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4ad38 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdab9809a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ad31 expref: 11 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.033900:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdab9809a (ffff8af210dfe900) 00010000:00010000:2.0:1784191894.033906:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191894.033932:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:106499:x1870858827975680:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 60us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191894.033939:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784191894.033972:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827975168:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1784191894.033981:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827975680:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1784191894.033988:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827975552:0@lo:103:jbd2/dm-1-8.0 00000020:00080000:0.0:1784191894.034309:0:165481:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af10f20f6c0 refcount 2 committed 0 result 0 batchid 21474836538 00000020:00080000:0.0:1784191894.034313:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af22de73c00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8af10f20fd80 00000020:00080000:0.0:1784191894.034316:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab4:0x2:0x0].2 00000020:00080000:0.0:1784191894.034318:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af22de73900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af105a85a00 00000020:00080000:0.0:1784191894.034320:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002b10:0x2:0x0].2 00000020:00080000:0.0:1784191894.034342:0:165481:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8af2012543c0 refcount 2 committed 0 result 0 batchid 21474836537 00000020:00080000:0.0:1784191894.034345:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af1075ea400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8af206bbc540 00000020:00080000:0.0:1784191894.034347:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200003ab4:0x2:0x0].1 00000020:00080000:0.0:1784191894.034349:0:165481:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8af1075ea700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8af23cd15000 00000020:00080000:0.0:1784191894.034352:0:165481:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002b10:0x2:0x0].1 00000100:00100000:0.0:1784191894.034373:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827974784:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1784191894.034413:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1784191894.034480:0:165502:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 21474836546 committed batchid 17179869212 00000020:00080000:2.0:1784191894.034568:0:165502:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179869212 00000100:00100000:0.0:1784191894.034675:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827975296:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1784191894.034735:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191894.036007:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827975808:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1784191894.036058:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191894.036358:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827974784 00000100:00100000:3.0:1784191894.036367:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827974784 00000100:00100000:3.0:1784191894.036421:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827975296 00000100:00100000:3.0:1784191894.036424:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827975296 00000100:00100000:3.0:1784191894.036454:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784191894.036462:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23b100850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:106501:x1870858827974784:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1784191894.036476:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191894.036499:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b200/0xfeec3c2dc5a4b1fa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9d6f79b8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b1f3 expref: 11 pid: 161739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.036532:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9d6f79b8 (ffff8af210dfe500) 00010000:00010000:3.0:1784191894.036543:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191894.036580:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23b100850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:106501:x1870858827974784:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 119us (2166us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191894.036586:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784191894.036632:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784191894.036638:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:106501:x1870858827975296:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1784191894.036644:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191894.036653:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8c00/0xfeec3c2dc5a4af30 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4c99ad bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4af29 expref: 9 pid: 159636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.036664:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4c99ad (ffff8af23d0d5e00) 00000100:00100000:2.0:1784191894.036829:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827974912:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1784191894.036899:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191894.036922:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:106501:x1870858827975296:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 284us (2188us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191894.036929:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784191894.037117:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827974784:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1784191894.037125:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827975296:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191894.037227:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191894.037252:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827975424:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191894.037271:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191894.037294:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827975808 00000100:00100000:3.0:1784191894.037297:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827975808 00000100:00100000:3.0:1784191894.037317:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827974912 00000100:00100000:3.0:1784191894.037319:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827974912 00000100:00100000:3.0:1784191894.037328:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827975424 00000100:00100000:3.0:1784191894.037330:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827975424 00000100:00100000:3.0:1784191894.037341:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784191894.037346:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:106501:x1870858827975808:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1784191894.037354:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191894.037364:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9c00/0xfeec3c2dc5a4ac90 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xed36d805 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ac89 expref: 10 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.037375:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed36d805 (ffff8af23d0d5100) 00010000:00010000:3.0:1784191894.037380:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191894.037401:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:106501:x1870858827975808:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 55us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191894.037407:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784191894.037418:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784191894.037423:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:106502:x1870858827974912:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1784191894.037430:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191894.037450:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4b13d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xcaaa8ec3 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4b136 expref: 8 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.037469:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcaaa8ec3 (ffff8af210dfe100) 00010000:00010000:3.0:1784191894.037475:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191894.037497:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:106502:x1870858827974912:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 74us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191894.037503:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784191894.037527:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784191894.037533:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858827975424:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1784191894.037539:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191894.037549:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ae88 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc86efa78 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4ae81 expref: 6 pid: 158670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.037558:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc86efa78 (ffff8af23d0d5f00) 00010000:00010000:3.0:1784191894.037564:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191894.037582:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827975424:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 50us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191894.037587:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784191894.037607:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827974912:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191894.037614:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827975424:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1784191894.037840:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.037861:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812447104 00000100:00100000:3.0:1784191894.037865:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812447104 00000100:00100000:3.0:1784191894.037894:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 717 00000100:00100000:3.0:1784191894.037900:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+147:123690:x1870858812447104:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191894.037917:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191894.037938:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cbca lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c216 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.037996:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cbd1 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038010:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cbd1 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038020:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cbd1 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038035:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4cbd8 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038042:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4cbd8 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038048:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4cbd8 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038164:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cbd1 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038173:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cbd1 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038179:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cbd1 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038186:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cbd1 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038201:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191894.038206:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cbd1 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038214:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cbd1 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038222:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191894.038225:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.038229:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cbd1 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038236:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cbd1 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038246:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4cbd8 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038251:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4cbd8 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038257:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4cbd8 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038262:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d6600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191894.038265:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4cbd8 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038270:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4cbd8 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038284:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xd47b514a (ffff8af203904900) 00010000:00010000:3.0:1784191894.038287:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.038289:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4cbd8 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038295:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4cbd8 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038321:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cbca lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c216 expref: 148 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038329:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191894.038331:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.038334:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cbca lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c216 expref: 148 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.038342:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d533200, rc 0) 00000100:00100000:3.0:1784191894.038379:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+147:123690:x1870858812447104:12345-192.168.204.16@tcp:101:cp.0 Request processed in 479us (541us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191894.038385:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 717 00000100:00100000:0.0:1784191894.038563:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827975808:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1784191894.041665:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.041876:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812447360 00000100:00100000:3.0:1784191894.041887:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812447360 00000100:00100000:3.0:1784191894.041953:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 718 00000100:00100000:3.0:1784191894.041964:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+147:123690:x1870858812447360:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191894.041986:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191894.042013:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cbdf lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c21d expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.042172:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cbe6 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.042187:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cbe6 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.042200:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cbe6 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.042215:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cbed lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.042222:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cbed lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.042228:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cbed lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191894.042605:0:164531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x267:0x0], index 0: 0 00080000:00000400:3.0:1784191894.042619:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191894.042622:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191894.042624:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191894.042626:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.042628:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.042630:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191894.042645:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191894.042648:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191894.042650:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191894.042651:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.042653:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.042663:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191894.042998:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191894.043002:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191894.043004:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191894.043006:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.043008:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.043010:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191894.043120:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4cbf4 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.043132:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4cbf4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.043141:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4cbf4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.043180:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cbe6 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.043187:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cbe6 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.043192:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cbe6 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.043199:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cbe6 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.043204:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191894.043208:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cbe6 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.043215:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cbe6 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.043237:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191894.043240:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.043245:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cbe6 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.043251:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cbe6 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191894.043265:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000265a1604 reply state 0000000054473da1 transno 34359738788 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cbed lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.043275:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cbed lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.043281:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xd47b514a (ffff8af203904400) 00010000:00010000:3.0:1784191894.043282:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191894.043285:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784191894.043317:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cbdf lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c21d expref: 150 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.043332:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4cbf4 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c21d expref: 149 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.043339:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x44:0x0].0x0 (ffff8af207499f00) 00010000:00010000:3.0:1784191894.043341:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784191894.043343:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e5c00, rc 0) 00000100:00100000:3.0:1784191894.043510:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+150:123690:x1870858812447360:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1545us (1854us total) trans 34359738788 rc 0/0 00000100:00100000:3.0:1784191894.043528:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 718 00000100:00100000:2.0:1784191894.048388:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191894.049242:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812447488 00000100:00100000:0.0:1784191894.049254:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812447488 00000100:00100000:0.0:1784191894.049373:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 386 00000100:00100000:0.0:1784191894.049384:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+38:69112:x1870858812447488:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191894.049405:0:162387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191894.049427:0:162387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fc22617/0xfeec3c2dc5a4cc02 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c224 expref: -99 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191894.049550:0:162387:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x267:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191894.049574:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x267:0x0].0x0 since=5514s v=(0 0) 00010000:00010000:0.0:1784191894.049579:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x267:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191894.049589:0:162387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fc22617/0xfeec3c2dc5a4cc02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c224 expref: 39 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.049609:0:162387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006fc22617/0xfeec3c2dc5a4cc02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c224 expref: 39 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.049624:0:162387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233126800, rc 0) 00000100:00100000:0.0:1784191894.049822:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+39:69112:x1870858812447488:12345-192.168.204.16@tcp:101:cp.0 Request processed in 439us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191894.049830:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 386 00000100:00100000:0.0:1784191894.058994:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.059090:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812447616 00000100:00100000:3.0:1784191894.059102:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812447616 00000100:00100000:3.0:1784191894.059174:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 387 00000100:00100000:3.0:1784191894.059186:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+39:123690:x1870858812447616:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191894.059209:0:161232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191894.059231:0:161232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4cc09 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x267:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c22b expref: -99 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.059266:0:161232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006fc22617/0xfeec3c2dc5a4cc02 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c224 expref: 40 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.059275:0:161232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x267:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191894.059280:0:161232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x267:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191894.059285:0:161232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4cc09 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x267:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c22b expref: 40 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.059327:0:161232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006fc22617/0xfeec3c2dc5a4cc02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c224 expref: 40 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.059342:0:161232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006fc22617/0xfeec3c2dc5a4cc02 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c224 expref: 40 pid: 162387 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191894.059356:0:161232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109199500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:161232:1870858827975936:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191894.059454:0:161232:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191894.067053:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191894.067270:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812447744 00000100:00100000:0.0:1784191894.067282:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812447744 00010000:00010000:0.0:1784191894.067336:0:165501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006fc22617/0xfeec3c2dc5a4cc02 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c224 expref: 41 pid: 162387 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191894.067391:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 197 00000100:00100000:0.0:1784191894.067415:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+41:69109:x1870858812447744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191894.067430:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191894.067462:0:165501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006fc22617/0xfeec3c2dc5a4cc02 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x267:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c224 expref: 41 pid: 162387 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.067479:0:165501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006fc22617/0xfeec3c2dc5a4cc02 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x267:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c224 expref: 41 pid: 162387 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.067506:0:165501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x267:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191894.067520:0:165501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x267:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191894.067531:0:165501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4cc09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x267:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c22b expref: 41 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.067541:0:165501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4cc09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x267:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c22b expref: 41 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.067593:0:165501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4cc09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x267:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c22b expref: 41 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191894.067612:0:165501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:165501:1870858827976064:192.168.204.16@tcp:105: 00000100:00100000:0.0:1784191894.067760:0:165501:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9e180 going to sleep for 11 seconds 00010000:00010000:3.0:1784191894.068060:0:161232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fc22617/0xfeec3c2dc5a4cc02 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x267:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c224 expref: 41 pid: 162387 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191894.068092:0:161232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109199500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:161232:1870858827975936:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191894.068127:0:161232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4cc09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c22b expref: 40 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.068137:0:161232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4400, rc 0) 00000100:00100000:3.0:1784191894.068171:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:123690:x1870858812447616:12345-192.168.204.16@tcp:101:cp.0 Request processed in 8986us (9190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191894.068179:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 387 00000100:00100000:3.0:1784191894.072091:0:165501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:165501:1870858827976064:192.168.204.16@tcp:105: 00010000:00010000:3.0:1784191894.072121:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191894.072187:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+39:69109:x1870858812447744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4773us (5145us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191894.072199:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 197 00000100:00100000:1.0:1784191894.073675:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.073915:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812448000 00000100:00100000:3.0:1784191894.073924:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812448000 00000100:00100000:3.0:1784191894.073982:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 204 00000100:00100000:3.0:1784191894.073991:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105325450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+150:123690:x1870858812448000:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191894.074379:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105325450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+151:123690:x1870858812448000:12345-192.168.204.16@tcp:35:cp.0 Request processed in 386us (711us total) trans 34359738789 rc 0/0 00000100:00100000:3.0:1784191894.074387:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 204 00000100:00100000:1.0:1784191894.088951:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.089065:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812448128 00000100:00100000:2.0:1784191894.089076:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812448128 00000100:00100000:2.0:1784191894.089176:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 719 00000100:00100000:2.0:1784191894.089188:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+151:123690:x1870858812448128:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191894.089217:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191894.089243:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cc10 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c232 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089317:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cc17 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089332:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cc17 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089343:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cc17 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089376:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cc1e lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089383:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cc1e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089389:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cc1e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089454:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cc17 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089462:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cc17 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089468:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cc17 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089474:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cc17 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089480:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7d600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191894.089484:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cc17 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089493:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cc17 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089504:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191894.089507:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.089524:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cc17 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089537:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cc17 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089558:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cc1e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089564:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cc1e lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089569:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cc1e lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089574:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7dc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191894.089577:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cc1e lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089583:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cc1e lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089590:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x7772308b (ffff8af216603b00) 00010000:00010000:2.0:1784191894.089593:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.089595:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cc1e lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089600:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cc1e lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089636:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cc10 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c232 expref: 152 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089657:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191894.089659:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.089662:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cc10 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c232 expref: 152 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.089672:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7de00, rc 0) 00000100:00100000:2.0:1784191894.089775:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+151:123690:x1870858812448128:12345-192.168.204.16@tcp:101:cp.0 Request processed in 589us (835us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191894.089783:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 719 00000100:00100000:2.0:1784191894.093326:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.093406:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812448256 00000100:00100000:3.0:1784191894.093415:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812448256 00000100:00100000:3.0:1784191894.093486:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 720 00000100:00100000:3.0:1784191894.093524:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+151:123690:x1870858812448256:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191894.093547:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191894.093571:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4cc25 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c239 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093654:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cc2c lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093670:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cc2c lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093722:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cc2c lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093744:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cc33 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093751:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cc33 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093756:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cc33 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093804:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cc2c lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093811:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cc2c lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093818:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cc2c lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093836:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cc2c lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093842:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191894.093846:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cc2c lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093854:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cc2c lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093869:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191894.093873:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.093879:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cc2c lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093887:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cc2c lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093905:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cc33 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093911:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cc33 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093916:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cc33 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093921:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010be000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191894.093923:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cc33 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093939:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cc33 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093947:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x7772308b (ffff8af203904900) 00010000:00010000:3.0:1784191894.093949:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.093951:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cc33 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093956:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cc33 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.093999:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4cc25 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c239 expref: 152 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.094010:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191894.094012:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.094015:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4800/0xfeec3c2dc5a4cc25 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c239 expref: 152 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.094024:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4800, rc 0) 00000100:00100000:3.0:1784191894.094109:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+151:123690:x1870858812448256:12345-192.168.204.16@tcp:101:cp.0 Request processed in 597us (792us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191894.094117:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 720 00000100:00100000:1.0:1784191894.097997:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.098172:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812448512 00000100:00100000:3.0:1784191894.098184:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812448512 00000100:00100000:3.0:1784191894.098252:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 721 00000100:00100000:3.0:1784191894.098263:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+151:123690:x1870858812448512:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191894.098308:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191894.098332:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cc3a lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c240 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.098574:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cc41 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.098590:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cc41 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.098603:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cc41 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.098623:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cc48 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.098631:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cc48 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.098637:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cc48 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191894.099187:0:164531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1e4:0x0], index 1: 0 00080000:00000400:3.0:1784191894.099202:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191894.099206:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191894.099208:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191894.099210:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.099212:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.099214:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191894.099232:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191894.099235:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191894.099245:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191894.099248:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.099250:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.099252:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191894.099284:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191894.099288:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191894.099289:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191894.099291:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.099293:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.099294:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191894.099388:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4cc4f lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.099397:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4cc4f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.099405:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4cc4f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.100322:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cc41 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.100333:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cc41 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.100339:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cc41 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.100346:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cc41 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.100351:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191894.100355:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cc41 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.100377:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cc41 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.100391:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191894.100395:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.100399:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cc41 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.100405:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cc41 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191894.100420:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000095df2a16 reply state 0000000058216d63 transno 34359738790 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cc48 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.100442:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cc48 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.100450:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x7772308b (ffff8af2198e6900) 00010000:00010000:3.0:1784191894.100452:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191894.100456:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191894.100641:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cc3a lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c240 expref: 154 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.100660:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4cc4f lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c240 expref: 153 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.100717:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x45:0x0].0x0 (ffff8af2198e6200) 00010000:00010000:0.0:1784191894.100720:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191894.100723:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d6600, rc 0) 00000100:00100000:0.0:1784191894.100802:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+154:123690:x1870858812448512:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2539us (2816us total) trans 34359738790 rc 0/0 00000100:00100000:0.0:1784191894.100811:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 721 00000100:00100000:1.0:1784191894.104924:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.105017:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812448640 00000100:00100000:2.0:1784191894.105028:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812448640 00000100:00100000:2.0:1784191894.105112:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 388 00000100:00100000:2.0:1784191894.105123:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+38:69109:x1870858812448640:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191894.105144:0:162389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191894.105171:0:162389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4cc5d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c247 expref: -99 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191894.105202:0:162389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191894.105225:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e4:0x0].0x0 since=5514s v=(0 0) 00010000:00010000:2.0:1784191894.105230:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191894.105240:0:162389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4cc5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c247 expref: 39 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.105259:0:162389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4cc5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c247 expref: 39 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.105294:0:162389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7dc00, rc 0) 00000100:00100000:2.0:1784191894.105365:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+39:69109:x1870858812448640:12345-192.168.204.16@tcp:101:cp.0 Request processed in 245us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191894.105371:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 388 00000100:00100000:2.0:1784191894.132011:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191894.132099:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812448768 00000100:00100000:0.0:1784191894.132111:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812448768 00000100:00100000:0.0:1784191894.132181:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 389 00000100:00100000:0.0:1784191894.132191:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+39:123690:x1870858812448768:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191894.132211:0:162396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191894.132231:0:162396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064b52797/0xfeec3c2dc5a4cc64 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c24e expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.132264:0:162396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4cc5d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c247 expref: 40 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.132274:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191894.132278:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191894.132283:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064b52797/0xfeec3c2dc5a4cc64 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->430079] (req 0->430079) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c24e expref: 40 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.132318:0:162396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4cc5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c247 expref: 40 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.132355:0:162396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4cc5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c247 expref: 40 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191894.132372:0:162396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:162396:1870858827976192:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191894.132465:0:162396:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9e480 going to sleep for 11 seconds 00000100:00100000:0.0:1784191894.135590:0:162396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:162396:1870858827976192:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191894.135634:0:162396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000064b52797/0xfeec3c2dc5a4cc64 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->430079] (req 0->430079) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c24e expref: 40 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.135657:0:162396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233127200, rc 0) 00000100:00100000:0.0:1784191894.135766:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:123690:x1870858812448768:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3575us (3763us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191894.135775:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 389 00000100:00100000:1.0:1784191894.138241:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191894.138342:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812448896 00000100:00100000:0.0:1784191894.138354:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812448896 00010000:00010000:0.0:1784191894.138400:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4cc5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c247 expref: 40 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191894.138456:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 198 00000100:00100000:0.0:1784191894.138466:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:69111:x1870858812448896:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191894.138482:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191894.138521:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4cc5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c247 expref: 40 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.138563:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4cc5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c247 expref: 40 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.138589:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd3de7bb/0xfeec3c2dc5a4cc5d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c247 expref: 40 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.138611:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191894.138616:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191894.138624:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000064b52797/0xfeec3c2dc5a4cc64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c24e expref: 39 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.138635:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064b52797/0xfeec3c2dc5a4cc64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c24e expref: 39 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.138680:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000064b52797/0xfeec3c2dc5a4cc64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c24e expref: 39 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191894.139408:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827976320:192.168.204.16@tcp:105: 00000100:00100000:0.0:1784191894.139530:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9e480 going to sleep for 11 seconds 00000100:00100000:0.0:1784191894.141922:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827976320:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191894.141952:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191894.142017:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+39:69111:x1870858812448896:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3551us (3785us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191894.142030:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 198 00000100:00100000:3.0:1784191894.151046:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.151165:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812449152 00000100:00100000:1.0:1784191894.151175:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812449152 00000100:00100000:1.0:1784191894.151272:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 205 00000100:00100000:1.0:1784191894.151283:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+154:123690:x1870858812449152:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:1.0:1784191894.151636:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+155:123690:x1870858812449152:12345-192.168.204.16@tcp:35:cp.0 Request processed in 353us (599us total) trans 34359738791 rc 0/0 00000100:00100000:1.0:1784191894.151644:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 205 00000100:00100000:2.0:1784191894.155372:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.155530:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812449280 00000100:00100000:1.0:1784191894.155540:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812449280 00000100:00100000:1.0:1784191894.155606:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 722 00000100:00100000:1.0:1784191894.155634:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+155:123690:x1870858812449280:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191894.155663:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191894.155781:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cc6b lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c255 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.155862:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cc72 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.155878:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cc72 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.155892:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cc72 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.155908:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cc79 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.155915:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cc79 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.155922:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cc79 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.155973:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cc72 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.155980:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cc72 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.155988:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cc72 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.156008:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cc72 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.156014:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.156018:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cc72 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.156026:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cc72 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.156037:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.156040:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.156044:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cc72 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.156051:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030e00/0xfeec3c2dc5a4cc72 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.156067:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cc79 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.156073:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cc79 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.156079:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cc79 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.156084:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.156087:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cc79 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.156117:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cc79 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.156125:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe087ee79 (ffff8af20dabc900) 00010000:00010000:1.0:1784191894.156127:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.156130:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cc79 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.156135:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cc79 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.156174:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cc6b lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c255 expref: 156 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.156184:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.156187:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.156189:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cc6b lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c255 expref: 156 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.156200:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200031a00, rc 0) 00000100:00100000:1.0:1784191894.156275:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+155:123690:x1870858812449280:12345-192.168.204.16@tcp:101:cp.0 Request processed in 644us (913us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191894.156282:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 722 00000100:00100000:2.0:1784191894.161168:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191894.161280:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812449408 00000100:00100000:0.0:1784191894.161291:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812449408 00000100:00100000:0.0:1784191894.161396:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 723 00000100:00100000:0.0:1784191894.161408:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+155:123690:x1870858812449408:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191894.161497:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191894.161533:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cc80 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c25c expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.161611:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cc87 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.161626:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cc87 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.161638:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cc87 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.161652:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cc8e lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.161658:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cc8e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.161664:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cc8e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.161900:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cc87 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.161909:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cc87 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.161938:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cc87 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.161945:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cc87 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.161951:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233126800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191894.161955:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cc87 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.161963:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cc87 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.161977:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191894.161979:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191894.161985:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cc87 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.161991:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cc87 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.162010:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cc8e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.162015:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cc8e lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.162020:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cc8e lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.162025:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191894.162035:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cc8e lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.162041:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cc8e lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.162050:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe087ee79 (ffff8af22de8be00) 00010000:00010000:0.0:1784191894.162053:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191894.162055:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cc8e lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.162061:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cc8e lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.162282:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cc80 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c25c expref: 156 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.162294:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191894.162295:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191894.162299:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cc80 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c25c expref: 156 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.162308:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233127c00, rc 0) 00000100:00100000:0.0:1784191894.162374:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+155:123690:x1870858812449408:12345-192.168.204.16@tcp:101:cp.0 Request processed in 968us (1288us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191894.162382:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 723 00000100:00100000:0.0:1784191894.165918:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.166007:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812449664 00000100:00100000:2.0:1784191894.166017:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812449664 00000100:00100000:2.0:1784191894.166276:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 724 00000100:00100000:2.0:1784191894.166290:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+155:123690:x1870858812449664:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191894.166312:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191894.166336:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cc95 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c263 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.166466:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cc9c lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.166482:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cc9c lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.166494:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cc9c lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.166508:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cca3 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.166550:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cca3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.166558:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cca3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191894.166936:0:164531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x268:0x0], index 0: 0 00080000:00000400:2.0:1784191894.166950:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191894.166954:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191894.166956:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191894.166959:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191894.166961:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191894.166963:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191894.166983:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191894.166986:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191894.166987:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191894.166989:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191894.166991:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191894.166993:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191894.167024:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191894.167026:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191894.167028:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191894.167029:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191894.167031:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191894.167033:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191894.167144:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4ccaa lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.167154:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4ccaa lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.167174:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4ccaa lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.167215:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cc9c lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.167223:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cc9c lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.167229:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cc9c lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.167236:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cc9c lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.167242:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7de00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191894.167246:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cc9c lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.167254:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cc9c lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.167267:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191894.167271:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.167276:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cc9c lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.167282:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4cc9c lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191894.167302:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002ab30ac4 reply state 00000000dc8119e5 transno 34359738792 ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cca3 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.167323:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cca3 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.167329:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe087ee79 (ffff8af216603e00) 00010000:00010000:2.0:1784191894.167331:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191894.167334:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191894.167367:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d600/0xfeec3c2dc5a4cc95 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c263 expref: 158 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.167383:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4ccaa lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c263 expref: 157 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.167390:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x46:0x0].0x0 (ffff8af216603a00) 00010000:00010000:2.0:1784191894.167392:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191894.167394:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7da00, rc 0) 00000100:00100000:2.0:1784191894.167470:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+158:123690:x1870858812449664:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1184us (1563us total) trans 34359738792 rc 0/0 00000100:00100000:2.0:1784191894.170930:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 724 00000100:00100000:2.0:1784191894.172306:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.172380:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812449792 00000100:00100000:3.0:1784191894.172391:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812449792 00000100:00100000:3.0:1784191894.172460:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 390 00000100:00100000:3.0:1784191894.172471:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+39:69111:x1870858812449792:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191894.172493:0:160166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191894.172530:0:160166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011bd6024/0xfeec3c2dc5a4ccb8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c26a expref: -99 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191894.172591:0:160166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x268:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784191894.172614:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x268:0x0].0x0 since=5514s v=(0 0) 00010000:00010000:3.0:1784191894.172619:0:160166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x268:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191894.172629:0:160166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bd6024/0xfeec3c2dc5a4ccb8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c26a expref: 40 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.172648:0:160166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000011bd6024/0xfeec3c2dc5a4ccb8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c26a expref: 40 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.172661:0:160166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7c00, rc 0) 00000100:00100000:3.0:1784191894.172939:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:69111:x1870858812449792:12345-192.168.204.16@tcp:101:cp.0 Request processed in 468us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191894.172946:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 390 00000100:00100000:0.0:1784191894.178477:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.178581:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812449920 00000100:00100000:2.0:1784191894.178592:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812449920 00000100:00100000:2.0:1784191894.178653:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 391 00000100:00100000:2.0:1784191894.178665:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:123690:x1870858812449920:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191894.178724:0:162339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191894.178745:0:162339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cba9fe15/0xfeec3c2dc5a4ccbf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x268:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c271 expref: -99 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.178800:0:162339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000011bd6024/0xfeec3c2dc5a4ccb8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x268:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c26a expref: 41 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.178810:0:162339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x268:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191894.178814:0:162339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x268:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191894.178820:0:162339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cba9fe15/0xfeec3c2dc5a4ccbf lrc: 4/0,0 mode: --/PW res: [0x280000401:0x268:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c271 expref: 41 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.178857:0:162339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000011bd6024/0xfeec3c2dc5a4ccb8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x268:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c26a expref: 41 pid: 160166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.178873:0:162339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000011bd6024/0xfeec3c2dc5a4ccb8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x268:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c26a expref: 41 pid: 160166 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191894.178888:0:162339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:162339:1870858827976448:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191894.178980:0:162339:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cd2f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191894.181667:0:162339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:162339:1870858827976448:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191894.181751:0:162339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cba9fe15/0xfeec3c2dc5a4ccbf lrc: 3/0,0 mode: --/PW res: [0x280000401:0x268:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c271 expref: 41 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.181773:0:162339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7d600, rc 0) 00000100:00100000:2.0:1784191894.181825:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+41:123690:x1870858812449920:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3163us (3358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191894.181855:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 391 00000100:00100000:1.0:1784191894.184082:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.184403:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812450048 00000100:00100000:2.0:1784191894.184413:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812450048 00010000:00010000:2.0:1784191894.184524:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000011bd6024/0xfeec3c2dc5a4ccb8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x268:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c26a expref: 41 pid: 160166 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191894.184569:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 199 00000100:00100000:2.0:1784191894.184579:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23b100450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+41:69109:x1870858812450048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191894.184596:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191894.184620:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000011bd6024/0xfeec3c2dc5a4ccb8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x268:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c26a expref: 41 pid: 160166 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.184638:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000011bd6024/0xfeec3c2dc5a4ccb8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x268:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c26a expref: 41 pid: 160166 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.184667:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011bd6024/0xfeec3c2dc5a4ccb8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x268:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c26a expref: 41 pid: 160166 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.184866:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x268:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191894.184872:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x268:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191894.184883:0:158652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cba9fe15/0xfeec3c2dc5a4ccbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x268:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c271 expref: 40 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.184896:0:158652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cba9fe15/0xfeec3c2dc5a4ccbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x268:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c271 expref: 40 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.184962:0:158652:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cba9fe15/0xfeec3c2dc5a4ccbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x268:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c271 expref: 40 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191894.184977:0:158652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:158652:1870858827976576:192.168.204.16@tcp:105: 00000100:00100000:2.0:1784191894.185065:0:158652:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cd2f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191894.189962:0:158652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:158652:1870858827976576:192.168.204.16@tcp:105: 00010000:00010000:2.0:1784191894.190001:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191894.190067:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23b100450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:69109:x1870858812450048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5488us (5997us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191894.190077:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 199 00000100:00100000:0.0:1784191894.192353:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.192780:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812450304 00000100:00100000:3.0:1784191894.192791:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812450304 00000100:00100000:3.0:1784191894.192912:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 206 00000100:00100000:3.0:1784191894.192924:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+158:123690:x1870858812450304:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191894.193304:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+159:123690:x1870858812450304:12345-192.168.204.16@tcp:35:cp.0 Request processed in 381us (963us total) trans 34359738793 rc 0/0 00000100:00100000:3.0:1784191894.193313:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 206 00000100:00100000:1.0:1784191894.199048:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.199291:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812450432 00000100:00100000:3.0:1784191894.199301:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812450432 00000100:00100000:3.0:1784191894.199425:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 725 00000100:00100000:3.0:1784191894.199448:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+159:123690:x1870858812450432:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191894.199498:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191894.199534:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ccc6 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c278 expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199614:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cccd lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199629:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cccd lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199639:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cccd lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199654:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ccd4 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199660:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ccd4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199666:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ccd4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199742:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cccd lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199750:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cccd lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199757:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cccd lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199763:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cccd lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199777:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191894.199782:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cccd lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199789:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cccd lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199803:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191894.199805:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.199810:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cccd lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199816:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cccd lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199831:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ccd4 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199837:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ccd4 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199842:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ccd4 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199847:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010be000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191894.199849:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ccd4 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199855:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ccd4 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199879:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x4d2290fc (ffff8af20290e500) 00010000:00010000:3.0:1784191894.199882:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.199885:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ccd4 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199891:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4ccd4 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199929:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ccc6 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c278 expref: 160 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199940:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191894.199942:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.199944:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ccc6 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c278 expref: 160 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.199953:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b6d7c00, rc 0) 00000100:00100000:3.0:1784191894.200025:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+159:123690:x1870858812450432:12345-192.168.204.16@tcp:101:cp.0 Request processed in 590us (988us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191894.200033:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 725 00000100:00100000:0.0:1784191894.203961:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.204205:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812450560 00000100:00100000:2.0:1784191894.204219:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812450560 00000100:00100000:2.0:1784191894.204295:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 726 00000100:00100000:2.0:1784191894.204306:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+159:123690:x1870858812450560:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191894.204330:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191894.204355:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4ccdb lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c27f expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204519:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cce2 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204538:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cce2 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204553:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cce2 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204598:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4cce9 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204607:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4cce9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204614:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4cce9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204669:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cce2 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204677:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cce2 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204865:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cce2 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204872:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cce2 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204878:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7dc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191894.204882:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cce2 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204889:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cce2 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204902:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191894.204905:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.204910:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cce2 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204924:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4cce2 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204943:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4cce9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204948:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4cce9 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204953:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4cce9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204958:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7d400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191894.204960:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4cce9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204966:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4cce9 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204972:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x4d2290fc (ffff8af10994dd00) 00010000:00010000:2.0:1784191894.204974:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.204977:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4cce9 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.204982:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4cce9 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.205017:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4ccdb lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c27f expref: 160 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.205040:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191894.205042:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.205046:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4ccdb lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c27f expref: 160 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.205057:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7de00, rc 0) 00000100:00100000:2.0:1784191894.205360:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+159:123690:x1870858812450560:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1054us (1412us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191894.205369:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 726 00000100:00100000:0.0:1784191894.208921:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.208995:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812450816 00000100:00100000:2.0:1784191894.209007:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812450816 00000100:00100000:2.0:1784191894.209101:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 727 00000100:00100000:2.0:1784191894.209113:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+159:123690:x1870858812450816:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191894.209139:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191894.209165:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4ccf0 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c286 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.209313:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4ccf7 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.209329:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4ccf7 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.209340:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4ccf7 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.209355:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4ccfe lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.209370:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4ccfe lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.209377:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4ccfe lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191894.209831:0:164531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1e5:0x0], index 1: 0 00080000:00000400:2.0:1784191894.209848:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191894.209853:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191894.209855:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191894.209857:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191894.209859:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191894.209861:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191894.209879:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191894.209882:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191894.209884:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191894.209886:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191894.209888:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191894.209890:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191894.209922:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:2.0:1784191894.209925:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191894.209926:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:2.0:1784191894.209928:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191894.209930:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191894.209932:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191894.210038:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4cd05 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.210049:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4cd05 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.210069:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4cd05 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.210113:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4ccf7 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.210121:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4ccf7 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.210127:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4ccf7 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.210134:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4ccf7 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.210141:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191894.210146:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4ccf7 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.210154:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4ccf7 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.210167:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191894.210170:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.210176:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4ccf7 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.210182:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4ccf7 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191894.210203:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005d4f7f29 reply state 0000000053313a48 transno 34359738794 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4ccfe lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.210223:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4ccfe lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.210229:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x4d2290fc (ffff8af10994dc00) 00010000:00010000:2.0:1784191894.210231:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191894.210234:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191894.210267:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4ccf0 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c286 expref: 162 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.210283:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4cd05 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c286 expref: 161 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.210289:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x47:0x0].0x0 (ffff8af10994d800) 00010000:00010000:2.0:1784191894.210291:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191894.210293:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7ec00, rc 0) 00000100:00100000:2.0:1784191894.210356:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+162:123690:x1870858812450816:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1245us (1447us total) trans 34359738794 rc 0/0 00000100:00100000:2.0:1784191894.210364:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 727 00000100:00100000:0.0:1784191894.216972:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.217062:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812450944 00000100:00100000:2.0:1784191894.217143:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812450944 00000100:00100000:2.0:1784191894.217241:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 392 00000100:00100000:2.0:1784191894.217251:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+39:69109:x1870858812450944:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191894.217272:0:162394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191894.217295:0:162394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cd13 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c28d expref: -99 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191894.217324:0:162394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191894.217358:0:162394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e5:0x0].0x0 since=5514s v=(0 0) 00010000:00010000:2.0:1784191894.217363:0:162394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191894.217374:0:162394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cd13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c28d expref: 40 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.217392:0:162394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cd13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c28d expref: 40 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.217406:0:162394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f400, rc 0) 00000100:00100000:2.0:1784191894.217484:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:69109:x1870858812450944:12345-192.168.204.16@tcp:101:cp.0 Request processed in 234us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191894.217492:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 392 00000100:00100000:0.0:1784191894.297285:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.297483:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812451072 00000100:00100000:3.0:1784191894.297494:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812451072 00000100:00100000:3.0:1784191894.297574:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 393 00000100:00100000:3.0:1784191894.297586:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:123690:x1870858812451072:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191894.297606:0:162398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191894.297630:0:162398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4cd1a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c294 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.297739:0:162398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cd13 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c28d expref: 41 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.297750:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191894.297755:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191894.297761:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4cd1a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->1175551] (req 0->1175551) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c294 expref: 41 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.297807:0:162398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cd13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c28d expref: 41 pid: 162394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.297824:0:162398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cd13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c28d expref: 41 pid: 162394 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191894.297839:0:162398:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:162398:1870858827976704:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191894.297915:0:162398:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2127fda80 going to sleep for 11 seconds 00000100:00100000:3.0:1784191894.302357:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.302589:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812451200 00000100:00100000:1.0:1784191894.302601:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812451200 00010000:00010000:1.0:1784191894.302649:0:165501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cd13 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c28d expref: 42 pid: 162394 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191894.302760:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 200 00000100:00100000:1.0:1784191894.302770:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+42:69111:x1870858812451200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191894.302790:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191894.302816:0:165501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cd13 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c28d expref: 42 pid: 162394 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.302830:0:165501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cd13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c28d expref: 42 pid: 162394 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.302859:0:165501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191894.302864:0:165501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191894.302874:0:165501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4cd1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1175551) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c294 expref: 42 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.302885:0:165501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4cd1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1175551) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c294 expref: 42 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.302928:0:165501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4cd1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1175551) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c294 expref: 42 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191894.302942:0:165501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:165501:1870858827976832:192.168.204.16@tcp:105: 00000100:00100000:1.0:1784191894.303035:0:165501:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af205de4540 going to sleep for 11 seconds 00010000:00010000:0.0:1784191894.304379:0:162398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cd13 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c28d expref: 42 pid: 162394 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191894.304401:0:162398:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:162398:1870858827976704:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191894.304441:0:162398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4cd1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c294 expref: 41 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.304455:0:162398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10b5e4800, rc 0) 00000100:00100000:0.0:1784191894.304535:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+41:123690:x1870858812451072:12345-192.168.204.16@tcp:101:cp.0 Request processed in 6951us (7264us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191894.304544:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 393 00000100:00100000:1.0:1784191894.308034:0:165501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:165501:1870858827976832:192.168.204.16@tcp:105: 00010000:00010000:1.0:1784191894.308108:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191894.308224:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:69111:x1870858812451200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5454us (5882us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191894.308235:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 200 00000100:00100000:2.0:1784191894.334114:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.334282:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812451456 00000100:00100000:1.0:1784191894.334294:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812451456 00000100:00100000:1.0:1784191894.334366:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 207 00000100:00100000:1.0:1784191894.334378:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+162:123690:x1870858812451456:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:1.0:1784191894.335056:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+163:123690:x1870858812451456:12345-192.168.204.16@tcp:35:cp.0 Request processed in 676us (950us total) trans 34359738795 rc 0/0 00000100:00100000:1.0:1784191894.335066:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 207 00000100:00100000:3.0:1784191894.339200:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191894.339551:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812451584 00000100:00100000:0.0:1784191894.339562:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812451584 00000100:00100000:0.0:1784191894.339629:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 728 00000100:00100000:0.0:1784191894.339639:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+163:123690:x1870858812451584:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191894.339665:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191894.339734:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cd21 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c29b expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.339805:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cd28 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.339818:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cd28 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.339850:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cd28 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.339866:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cd2f lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.339874:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cd2f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.339881:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cd2f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.339931:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cd28 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.339937:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cd28 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.339942:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cd28 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.339947:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cd28 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.339953:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191894.339957:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cd28 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.339964:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cd28 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.339975:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191894.339984:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191894.339990:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cd28 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.339997:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cd28 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.340018:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cd2f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.340024:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cd2f lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.340029:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cd2f lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.340033:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191894.340035:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cd2f lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.340041:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cd2f lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.340049:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x489b8eb2 (ffff8af22de8be00) 00010000:00010000:0.0:1784191894.340052:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191894.340054:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cd2f lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.340059:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cd2f lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.340108:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cd21 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c29b expref: 164 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.340125:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191894.340128:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191894.340132:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cd21 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c29b expref: 164 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.340143:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4600, rc 0) 00000100:00100000:0.0:1784191894.340216:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+163:123690:x1870858812451584:12345-192.168.204.16@tcp:101:cp.0 Request processed in 577us (1027us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191894.340223:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 728 00000100:00100000:0.0:1784191894.343472:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.343589:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812451712 00000100:00100000:2.0:1784191894.343602:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812451712 00000100:00100000:2.0:1784191894.343678:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 729 00000100:00100000:2.0:1784191894.343736:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+163:123690:x1870858812451712:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191894.343761:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191894.343784:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4cd36 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c2a2 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.343858:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4cd3d lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.343876:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4cd3d lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.343888:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4cd3d lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.343923:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd44 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.343930:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd44 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.343935:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd44 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.343986:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4cd3d lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.343993:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4cd3d lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.343998:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4cd3d lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.344004:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4cd3d lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.344010:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191894.344015:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4cd3d lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.344022:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4cd3d lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.344037:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191894.344040:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.344045:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4cd3d lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.344060:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4cd3d lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.344076:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd44 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.344081:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd44 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.344086:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd44 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.344106:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191894.344108:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd44 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.344114:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd44 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.344122:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x489b8eb2 (ffff8af10994dd00) 00010000:00010000:2.0:1784191894.344124:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.344127:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd44 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.344133:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd44 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.344172:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4cd36 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2a2 expref: 164 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.344194:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191894.344196:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.344199:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4cd36 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2a2 expref: 164 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.344208:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f600, rc 0) 00000100:00100000:2.0:1784191894.344289:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+163:123690:x1870858812451712:12345-192.168.204.16@tcp:101:cp.0 Request processed in 602us (835us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191894.344297:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 729 00000100:00100000:2.0:1784191894.348444:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.348579:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812451968 00000100:00100000:3.0:1784191894.348591:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812451968 00000100:00100000:3.0:1784191894.348670:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 730 00000100:00100000:3.0:1784191894.348681:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+163:123690:x1870858812451968:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191894.348754:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191894.348786:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cd4b lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c2a9 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.348959:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cd52 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.348976:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cd52 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.348989:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cd52 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.349005:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cd59 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.349011:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cd59 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.349017:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cd59 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191894.349408:0:158665:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x269:0x0], index 0: 0 00080000:00000400:3.0:1784191894.349422:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191894.349425:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191894.349827:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191894.349829:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.349831:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.349833:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191894.349862:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191894.349864:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191894.349866:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191894.349868:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.349870:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.349884:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191894.349928:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:3.0:1784191894.349931:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191894.349932:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191894.349934:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.349935:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.349937:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191894.350064:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b200/0xfeec3c2dc5a4cd60 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.350076:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b200/0xfeec3c2dc5a4cd60 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.350085:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b200/0xfeec3c2dc5a4cd60 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.350128:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cd52 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.350137:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cd52 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.350143:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cd52 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.350151:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cd52 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.350157:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010be000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191894.350161:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cd52 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.350168:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cd52 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.350187:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191894.350190:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.350195:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cd52 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.350202:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cd52 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191894.350217:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fcb62444 reply state 00000000aa6c990d transno 34359738796 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cd59 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.350227:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cd59 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.350233:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x489b8eb2 (ffff8af20290e500) 00010000:00010000:3.0:1784191894.350235:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191894.350238:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784191894.350274:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cd4b lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2a9 expref: 166 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.350291:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b200/0xfeec3c2dc5a4cd60 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2a9 expref: 165 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.350298:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x48:0x0].0x0 (ffff8af20290e600) 00010000:00010000:3.0:1784191894.350301:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784191894.350303:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341b200, rc 0) 00000100:00100000:3.0:1784191894.350591:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+166:123690:x1870858812451968:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1909us (2166us total) trans 34359738796 rc 0/0 00000100:00100000:3.0:1784191894.350601:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 730 00000100:00100000:0.0:1784191894.356841:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191894.356893:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191894.356924:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.357010:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812452096 00000100:00100000:2.0:1784191894.357021:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812452096 00000100:00100000:2.0:1784191894.357099:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 394 00000100:00100000:2.0:1784191894.357112:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:69112:x1870858812452096:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191894.357133:0:160165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191894.357156:0:160165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9be9514/0xfeec3c2dc5a4cd6e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c2b0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191894.357185:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x269:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191894.357205:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x269:0x0].0x0 since=5514s v=(0 0) 00010000:00010000:2.0:1784191894.357210:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x269:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191894.357220:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9be9514/0xfeec3c2dc5a4cd6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2b0 expref: 41 pid: 160165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.357238:0:160165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9be9514/0xfeec3c2dc5a4cd6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2b0 expref: 41 pid: 160165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.357270:0:160165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f600, rc 0) 00000100:00100000:2.0:1784191894.357331:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+41:69112:x1870858812452096:12345-192.168.204.16@tcp:101:cp.0 Request processed in 222us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191894.357338:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 394 00000100:00100000:1.0:1784191894.357455:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812452352 00000100:00100000:1.0:1784191894.357460:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812452352 00000100:00100000:1.0:1784191894.357515:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 359 00000100:00100000:1.0:1784191894.357524:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812452352:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191894.357560:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812452352:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 38us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191894.357567:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 359 00000100:00080000:1.0:1784191894.357587:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191894.358265:0:158660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812452224 00000100:00100000:3.0:1784191894.358272:0:158660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812452224 00000100:00100000:3.0:1784191894.358329:0:158660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 292 00000100:00100000:3.0:1784191894.358338:0:158660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812452224:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191894.358372:0:158660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812452224:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 36us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191894.358378:0:158660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 292 00000100:00100000:2.0:1784191894.363571:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.363888:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812452480 00000100:00100000:1.0:1784191894.363897:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812452480 00000100:00100000:1.0:1784191894.363955:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 395 00000100:00100000:1.0:1784191894.363967:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+41:123690:x1870858812452480:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191894.363989:0:162392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191894.364013:0:162392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fface28/0xfeec3c2dc5a4cd75 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x269:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c2b7 expref: -99 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.364200:0:162392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9be9514/0xfeec3c2dc5a4cd6e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x269:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2b0 expref: 42 pid: 160165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.364211:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x269:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191894.364217:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x269:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191894.364223:0:162392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fface28/0xfeec3c2dc5a4cd75 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x269:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2b7 expref: 42 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.364261:0:162392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9be9514/0xfeec3c2dc5a4cd6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x269:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2b0 expref: 42 pid: 160165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.364277:0:162392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9be9514/0xfeec3c2dc5a4cd6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x269:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2b0 expref: 42 pid: 160165 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191894.364292:0:162392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:162392:1870858827976960:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191894.364492:0:162392:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23b0039c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191894.368200:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191894.368283:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812452608 00000100:00100000:0.0:1784191894.368295:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812452608 00010000:00010000:0.0:1784191894.368338:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9be9514/0xfeec3c2dc5a4cd6e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x269:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2b0 expref: 43 pid: 160165 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191894.368424:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 201 00000100:00100000:0.0:1784191894.368443:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69112:x1870858812452608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784191894.368460:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191894.368486:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9be9514/0xfeec3c2dc5a4cd6e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x269:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2b0 expref: 43 pid: 160165 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.368502:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9be9514/0xfeec3c2dc5a4cd6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x269:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2b0 expref: 43 pid: 160165 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.368559:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x269:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191894.368564:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x269:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191894.368572:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002fface28/0xfeec3c2dc5a4cd75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x269:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2b7 expref: 43 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.368583:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fface28/0xfeec3c2dc5a4cd75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x269:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2b7 expref: 43 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.368622:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002fface28/0xfeec3c2dc5a4cd75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x269:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2b7 expref: 43 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191894.368638:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827977088:192.168.204.16@tcp:105: 00000100:00100000:0.0:1784191894.368759:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9e480 going to sleep for 11 seconds 00010000:00010000:1.0:1784191894.369391:0:162392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9be9514/0xfeec3c2dc5a4cd6e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x269:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2b0 expref: 43 pid: 160165 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191894.369409:0:162392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:162392:1870858827976960:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191894.369447:0:162392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002fface28/0xfeec3c2dc5a4cd75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x269:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2b7 expref: 42 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.369473:0:162392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200030e00, rc 0) 00000100:00100000:1.0:1784191894.369522:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+42:123690:x1870858812452480:12345-192.168.204.16@tcp:101:cp.0 Request processed in 5558us (5970us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191894.369530:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 395 00000100:00100000:2.0:1784191894.377411:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.377573:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812452864 00000100:00100000:3.0:1784191894.377587:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812452864 00000100:00100000:3.0:1784191894.377659:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 208 00000100:00100000:3.0:1784191894.377671:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+166:123690:x1870858812452864:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191894.379257:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+167:123690:x1870858812452864:12345-192.168.204.16@tcp:35:cp.0 Request processed in 400us (673us total) trans 34359738797 rc 0/0 00000100:00100000:3.0:1784191894.379270:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 208 00000100:00100000:0.0:1784191894.379479:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827977088:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191894.379521:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191894.379582:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+41:69112:x1870858812452608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 11140us (11392us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191894.379591:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 201 00000100:00100000:3.0:1784191894.381896:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.382121:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812452992 00000100:00100000:1.0:1784191894.382134:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812452992 00000100:00100000:1.0:1784191894.382210:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 731 00000100:00100000:1.0:1784191894.382223:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+167:123690:x1870858812452992:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191894.382251:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191894.382274:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cd7c lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c2be expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382349:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cd83 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382365:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cd83 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382379:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cd83 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382397:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4cd8a lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382404:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4cd8a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382410:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4cd8a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382492:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cd83 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382500:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cd83 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382515:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cd83 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382522:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cd83 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382529:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200031a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.382533:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cd83 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382541:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cd83 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382555:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.382558:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.382563:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cd83 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382569:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cd83 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382586:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4cd8a lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382593:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4cd8a lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382606:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4cd8a lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382611:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.382614:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4cd8a lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382619:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4cd8a lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382627:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xf2ca543e (ffff8af20dabc900) 00010000:00010000:1.0:1784191894.382630:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.382633:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4cd8a lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382638:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4cd8a lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382678:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cd7c lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2be expref: 168 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382736:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.382739:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.382743:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cd7c lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2be expref: 168 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.382753:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200030c00, rc 0) 00000100:00100000:1.0:1784191894.384281:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+167:123690:x1870858812452992:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2049us (2388us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191894.384318:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 731 00000100:00100000:3.0:1784191894.389247:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.389334:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812453120 00000100:00100000:2.0:1784191894.389346:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812453120 00000100:00100000:2.0:1784191894.389410:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 732 00000100:00100000:2.0:1784191894.389420:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+167:123690:x1870858812453120:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191894.389449:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191894.389474:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4cd91 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c2c5 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389569:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd98 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389585:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd98 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389599:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd98 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389616:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4cd9f lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389648:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4cd9f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389656:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4cd9f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389749:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd98 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389758:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd98 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389764:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd98 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389772:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd98 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389778:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191894.389783:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd98 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389791:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd98 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389805:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191894.389808:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.389813:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd98 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389819:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4cd98 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389845:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4cd9f lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389850:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4cd9f lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389854:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4cd9f lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389859:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191894.389867:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4cd9f lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389875:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4cd9f lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389884:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xf2ca543e (ffff8af10994de00) 00010000:00010000:2.0:1784191894.389886:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.389888:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4cd9f lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389893:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f600/0xfeec3c2dc5a4cd9f lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389934:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4cd91 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2c5 expref: 168 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389946:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191894.389948:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.389958:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4cd91 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2c5 expref: 168 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.389968:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f400, rc 0) 00000100:00100000:2.0:1784191894.390034:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+167:123690:x1870858812453120:12345-192.168.204.16@tcp:101:cp.0 Request processed in 616us (799us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191894.390042:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 732 00000100:00100000:2.0:1784191894.395535:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.395625:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812453376 00000100:00100000:1.0:1784191894.395636:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812453376 00000100:00100000:1.0:1784191894.395753:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 733 00000100:00100000:1.0:1784191894.395765:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+167:123690:x1870858812453376:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191894.395793:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191894.395820:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4cda6 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c2cc expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.395978:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdad lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.395994:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdad lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.396009:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdad lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.396026:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4cdb4 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.396033:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4cdb4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.396041:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4cdb4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191894.396421:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1e6:0x0], index 1: 0 00080000:00000400:1.0:1784191894.396435:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191894.396447:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191894.396450:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191894.396452:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.396455:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191894.396457:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191894.396477:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191894.396480:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191894.396482:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191894.396483:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.396485:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191894.396487:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191894.396533:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191894.396537:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191894.396538:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191894.396540:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.396542:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191894.396544:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191894.396646:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4cdbb lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.396656:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4cdbb lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.396664:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4cdbb lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.396760:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdad lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.396767:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdad lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.396773:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdad lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.396786:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdad lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.396792:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.396797:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdad lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.396804:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdad lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.396817:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.396821:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.396825:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdad lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.396832:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdad lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191894.396847:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000081379964 reply state 00000000c13e21ef transno 34359738798 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4cdb4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.396859:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4cdb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.396865:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xf2ca543e (ffff8af20dabc900) 00010000:00010000:1.0:1784191894.396867:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191894.396870:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191894.396907:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4cda6 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2cc expref: 170 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.396935:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4cdbb lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2cc expref: 169 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.396943:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x49:0x0].0x0 (ffff8af20dabcd00) 00010000:00010000:1.0:1784191894.396945:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191894.396948:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3fc00, rc 0) 00000100:00100000:1.0:1784191894.397023:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+170:123690:x1870858812453376:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1260us (1499us total) trans 34359738798 rc 0/0 00000100:00100000:1.0:1784191894.397032:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 733 00000100:00100000:0.0:1784191894.408594:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.408767:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812453504 00000100:00100000:2.0:1784191894.408778:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812453504 00000100:00100000:2.0:1784191894.408846:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 396 00000100:00100000:2.0:1784191894.408868:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+40:69112:x1870858812453504:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191894.408890:0:162389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191894.408918:0:162389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cdc9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c2d3 expref: -99 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191894.408946:0:162389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191894.408966:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e6:0x0].0x0 since=5514s v=(0 0) 00010000:00010000:2.0:1784191894.408971:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191894.408981:0:162389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cdc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2d3 expref: 41 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.409000:0:162389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cdc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2d3 expref: 41 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.409013:0:162389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f400, rc 0) 00000100:00100000:2.0:1784191894.409084:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+41:69112:x1870858812453504:12345-192.168.204.16@tcp:101:cp.0 Request processed in 218us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191894.409120:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 396 00000100:00100000:0.0:1784191894.413097:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.413196:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812453632 00000100:00100000:2.0:1784191894.413207:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812453632 00000100:00100000:2.0:1784191894.413270:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 397 00000100:00100000:2.0:1784191894.413282:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+41:123690:x1870858812453632:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191894.413303:0:162385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191894.413324:0:162385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9be9514/0xfeec3c2dc5a4cdd0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c2da expref: -99 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.413360:0:162385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cdc9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2d3 expref: 42 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.413375:0:162385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191894.413379:0:162385:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191894.413384:0:162385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9be9514/0xfeec3c2dc5a4cdd0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2da expref: 42 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.413636:0:162385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cdc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2d3 expref: 42 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.413654:0:162385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cdc9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2d3 expref: 42 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191894.413669:0:162385:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:162385:1870858827977216:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191894.413968:0:162385:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f82fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1784191894.418707:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.418795:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812453760 00000100:00100000:1.0:1784191894.418808:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812453760 00010000:00010000:1.0:1784191894.418855:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cdc9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2d3 expref: 43 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191894.418908:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 202 00000100:00100000:1.0:1784191894.418918:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69110:x1870858812453760:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191894.418939:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191894.418968:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cdc9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2d3 expref: 43 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.418984:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cdc9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2d3 expref: 43 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.419013:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191894.419038:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191894.419047:0:158652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9be9514/0xfeec3c2dc5a4cdd0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2da expref: 43 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.419060:0:158652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9be9514/0xfeec3c2dc5a4cdd0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2da expref: 43 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.419118:0:158652:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f9be9514/0xfeec3c2dc5a4cdd0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2da expref: 43 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191894.419134:0:158652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:158652:1870858827977344:192.168.204.16@tcp:105: 00000100:00100000:1.0:1784191894.419235:0:158652:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1119a9c00 going to sleep for 11 seconds 00010000:00010000:3.0:1784191894.422295:0:162385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000618513d8/0xfeec3c2dc5a4cdc9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2d3 expref: 43 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191894.422321:0:162385:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:162385:1870858827977216:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191894.422357:0:162385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9be9514/0xfeec3c2dc5a4cdd0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2da expref: 42 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.422371:0:162385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f600, rc 0) 00000100:00100000:1.0:1784191894.422938:0:158652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:158652:1870858827977344:192.168.204.16@tcp:105: 00010000:00010000:1.0:1784191894.422956:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191894.423008:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+42:69110:x1870858812453760:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4091us (4345us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191894.423019:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 202 00000100:00100000:2.0:1784191894.424181:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+41:123690:x1870858812453632:12345-192.168.204.16@tcp:101:cp.0 Request processed in 10893us (11087us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191894.424191:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 397 00000100:00100000:0.0:1784191894.429801:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.429942:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812454016 00000100:00100000:3.0:1784191894.429963:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812454016 00000100:00100000:3.0:1784191894.430050:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 209 00000100:00100000:3.0:1784191894.430061:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+170:123690:x1870858812454016:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191894.430364:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+171:123690:x1870858812454016:12345-192.168.204.16@tcp:35:cp.0 Request processed in 304us (686us total) trans 34359738799 rc 0/0 00000100:00100000:3.0:1784191894.430372:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 209 00000100:00100000:0.0:1784191894.436928:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.437915:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812454144 00000100:00100000:1.0:1784191894.437927:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812454144 00000100:00100000:1.0:1784191894.438012:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 734 00000100:00100000:1.0:1784191894.438024:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+171:123690:x1870858812454144:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191894.438056:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191894.438083:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4cdd7 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c2e1 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438161:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdde lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438190:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdde lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438203:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdde lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438220:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4cde5 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438227:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4cde5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438234:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4cde5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438278:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdde lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438285:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdde lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438291:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdde lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438297:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdde lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438302:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.438306:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdde lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438312:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdde lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438331:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.438334:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.438338:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdde lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438344:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cdde lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438357:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4cde5 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438363:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4cde5 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438367:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4cde5 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438372:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.438374:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4cde5 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438379:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4cde5 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438386:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xd06bcd9f (ffff8af204e31f00) 00010000:00010000:1.0:1784191894.438388:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.438390:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4cde5 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438395:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4cde5 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438454:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4cdd7 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2e1 expref: 172 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438464:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.438466:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.438469:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4cdd7 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2e1 expref: 172 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.438478:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3e000, rc 0) 00000100:00100000:1.0:1784191894.438552:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+171:123690:x1870858812454144:12345-192.168.204.16@tcp:101:cp.0 Request processed in 531us (1635us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191894.438560:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 734 00000100:00100000:0.0:1784191894.441908:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.442027:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812454272 00000100:00100000:1.0:1784191894.442038:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812454272 00000100:00100000:1.0:1784191894.442112:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 735 00000100:00100000:1.0:1784191894.442124:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+171:123690:x1870858812454272:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191894.442149:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191894.442175:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4cdec lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c2e8 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442249:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4cdf3 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442265:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4cdf3 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442277:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4cdf3 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442316:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cdfa lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442323:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cdfa lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442330:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cdfa lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442380:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4cdf3 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442387:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4cdf3 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442394:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4cdf3 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442399:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4cdf3 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442405:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3f000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.442409:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4cdf3 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442418:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4cdf3 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442444:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.442447:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.442453:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4cdf3 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442467:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4cdf3 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442483:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cdfa lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442489:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cdfa lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442495:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cdfa lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442500:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.442513:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cdfa lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442520:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cdfa lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442528:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xd06bcd9f (ffff8af204e31400) 00010000:00010000:1.0:1784191894.442531:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.442533:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cdfa lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442539:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cdfa lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442577:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4cdec lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2e8 expref: 172 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442603:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.442605:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.442609:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4cdec lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2e8 expref: 172 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.442620:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3ec00, rc 0) 00000100:00100000:1.0:1784191894.442737:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+171:123690:x1870858812454272:12345-192.168.204.16@tcp:101:cp.0 Request processed in 556us (781us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191894.442746:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 735 00000100:00100000:0.0:1784191894.447522:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.447629:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812454528 00000100:00100000:3.0:1784191894.447640:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812454528 00000100:00100000:3.0:1784191894.447731:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 736 00000100:00100000:3.0:1784191894.447742:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+171:123690:x1870858812454528:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191894.447766:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191894.447786:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341bc00/0xfeec3c2dc5a4ce01 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c2ef expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.447902:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b400/0xfeec3c2dc5a4ce08 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.447917:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b400/0xfeec3c2dc5a4ce08 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.447928:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b400/0xfeec3c2dc5a4ce08 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.447941:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ce0f lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.447948:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ce0f lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.447954:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ce0f lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191894.448277:0:158667:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x26a:0x0], index 0: 0 00080000:00000400:3.0:1784191894.448291:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191894.448295:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191894.448297:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191894.448299:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.448301:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.448303:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191894.448319:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191894.448322:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191894.448324:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191894.448326:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.448328:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.448329:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191894.448357:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:3.0:1784191894.448359:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191894.448361:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:3.0:1784191894.448362:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.448364:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.448366:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191894.448465:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4ce16 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.448476:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4ce16 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.448484:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4ce16 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.448533:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b400/0xfeec3c2dc5a4ce08 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.448552:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b400/0xfeec3c2dc5a4ce08 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.448557:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b400/0xfeec3c2dc5a4ce08 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.448563:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b400/0xfeec3c2dc5a4ce08 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.448569:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341b400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191894.448573:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b400/0xfeec3c2dc5a4ce08 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.448581:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b400/0xfeec3c2dc5a4ce08 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.448596:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191894.448600:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.448604:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b400/0xfeec3c2dc5a4ce08 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.448610:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b400/0xfeec3c2dc5a4ce08 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191894.448626:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f320cbb1 reply state 00000000ead7acc3 transno 34359738800 ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ce0f lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.448637:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ce0f lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.448643:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xd06bcd9f (ffff8af20290e100) 00010000:00010000:3.0:1784191894.448652:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191894.448656:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784191894.448737:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341bc00/0xfeec3c2dc5a4ce01 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2ef expref: 174 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.448754:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4ce16 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2ef expref: 173 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.448761:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x4a:0x0].0x0 (ffff8af20290e700) 00010000:00010000:3.0:1784191894.448763:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784191894.448766:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341a400, rc 0) 00000100:00100000:3.0:1784191894.448845:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+174:123690:x1870858812454528:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1103us (1341us total) trans 34359738800 rc 0/0 00000100:00100000:3.0:1784191894.448853:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 736 00000100:00100000:0.0:1784191894.455255:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.455357:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812454656 00000100:00100000:1.0:1784191894.455370:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812454656 00000100:00100000:1.0:1784191894.455438:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 398 00000100:00100000:1.0:1784191894.455447:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+41:69110:x1870858812454656:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191894.455466:0:162395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191894.455489:0:162395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007252c09/0xfeec3c2dc5a4ce24 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c2f6 expref: -99 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784191894.455523:0:162395:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191894.455543:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26a:0x0].0x0 since=5514s v=(0 0) 00010000:00010000:1.0:1784191894.455548:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191894.455558:0:162395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007252c09/0xfeec3c2dc5a4ce24 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2f6 expref: 42 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.455575:0:162395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000007252c09/0xfeec3c2dc5a4ce24 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2f6 expref: 42 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.455617:0:162395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200030c00, rc 0) 00000100:00100000:1.0:1784191894.455673:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+42:69110:x1870858812454656:12345-192.168.204.16@tcp:101:cp.0 Request processed in 227us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191894.455717:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 398 00000100:00100000:2.0:1784191894.466763:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.466857:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812454784 00000100:00100000:3.0:1784191894.466868:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812454784 00000100:00100000:3.0:1784191894.466932:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 399 00000100:00100000:3.0:1784191894.466943:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+42:123690:x1870858812454784:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191894.466961:0:162386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191894.466980:0:162386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a57683a/0xfeec3c2dc5a4ce2b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c2fd expref: -99 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.467014:0:162386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007252c09/0xfeec3c2dc5a4ce24 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x26a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2f6 expref: 43 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.467024:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191894.467028:0:162386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191894.467052:0:162386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a57683a/0xfeec3c2dc5a4ce2b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x26a:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2fd expref: 43 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.467090:0:162386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007252c09/0xfeec3c2dc5a4ce24 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x26a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2f6 expref: 43 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.467105:0:162386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007252c09/0xfeec3c2dc5a4ce24 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x26a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2f6 expref: 43 pid: 162395 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191894.467119:0:162386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:162386:1870858827977472:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191894.467194:0:162386:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2387a7900 going to sleep for 11 seconds 00000100:00100000:0.0:1784191894.470312:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.470408:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812454912 00000100:00100000:1.0:1784191894.470418:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812454912 00010000:00010000:1.0:1784191894.470480:0:165501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007252c09/0xfeec3c2dc5a4ce24 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x26a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2f6 expref: 44 pid: 162395 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191894.470645:0:162386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:162386:1870858827977472:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191894.470731:0:162386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a57683a/0xfeec3c2dc5a4ce2b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x26a:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2fd expref: 44 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.470751:0:162386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341bc00, rc 0) 00000100:00100000:3.0:1784191894.470809:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:123690:x1870858812454784:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3867us (4060us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191894.470817:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 399 00000100:00100000:1.0:1784191894.471374:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 203 00000100:00100000:1.0:1784191894.471387:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69111:x1870858812454912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191894.471402:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191894.471424:0:165501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007252c09/0xfeec3c2dc5a4ce24 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x26a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2f6 expref: 43 pid: 162395 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.471439:0:165501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007252c09/0xfeec3c2dc5a4ce24 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x26a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2f6 expref: 43 pid: 162395 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.471462:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007252c09/0xfeec3c2dc5a4ce24 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x26a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2f6 expref: 43 pid: 162395 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.471477:0:165501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191894.471481:0:165501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191894.471489:0:165501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a57683a/0xfeec3c2dc5a4ce2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2fd expref: 42 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.471530:0:165501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a57683a/0xfeec3c2dc5a4ce2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2fd expref: 42 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.471569:0:165501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009a57683a/0xfeec3c2dc5a4ce2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2fd expref: 42 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191894.471583:0:165501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:165501:1870858827977600:192.168.204.16@tcp:105: 00000100:00100000:1.0:1784191894.471658:0:165501:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1119a9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784191894.476044:0:165501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:165501:1870858827977600:192.168.204.16@tcp:105: 00010000:00010000:1.0:1784191894.476081:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191894.476156:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+42:69111:x1870858812454912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4771us (5853us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191894.476169:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 203 00000100:00100000:0.0:1784191894.477743:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.477905:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812455168 00000100:00100000:3.0:1784191894.477914:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812455168 00000100:00100000:3.0:1784191894.477973:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 210 00000100:00100000:3.0:1784191894.477984:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105324c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+174:123690:x1870858812455168:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191894.478312:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105324c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+175:123690:x1870858812455168:12345-192.168.204.16@tcp:35:cp.0 Request processed in 329us (577us total) trans 34359738801 rc 0/0 00000100:00100000:3.0:1784191894.478337:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 210 00000100:00100000:0.0:1784191894.482319:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.482494:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812455296 00000100:00100000:2.0:1784191894.482514:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812455296 00000100:00100000:2.0:1784191894.482610:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 737 00000100:00100000:2.0:1784191894.482621:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+175:123690:x1870858812455296:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191894.482652:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191894.482687:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4ce32 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c304 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.482783:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4ce39 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.482798:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4ce39 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.482810:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4ce39 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.482826:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4ce40 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.482833:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4ce40 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.482840:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4ce40 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.482916:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4ce39 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.482923:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4ce39 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.482929:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4ce39 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.482936:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4ce39 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.482943:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7f400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191894.482948:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4ce39 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.482956:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4ce39 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.482970:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191894.482973:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.482978:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4ce39 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.482984:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f400/0xfeec3c2dc5a4ce39 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.483003:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4ce40 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.483009:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4ce40 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.483023:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4ce40 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.483029:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7de00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191894.483032:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4ce40 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.483039:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4ce40 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.483047:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x22eacdcf (ffff8af10994d400) 00010000:00010000:2.0:1784191894.483049:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.483052:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4ce40 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.483058:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7de00/0xfeec3c2dc5a4ce40 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.483121:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4ce32 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c304 expref: 176 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.483132:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191894.483135:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.483138:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7f200/0xfeec3c2dc5a4ce32 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c304 expref: 176 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.483149:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20cd7f200, rc 0) 00000100:00100000:2.0:1784191894.483278:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+175:123690:x1870858812455296:12345-192.168.204.16@tcp:101:cp.0 Request processed in 657us (970us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191894.483295:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 737 00000100:00100000:0.0:1784191894.487229:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.487404:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812455424 00000100:00100000:2.0:1784191894.487416:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812455424 00000100:00100000:2.0:1784191894.487612:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 738 00000100:00100000:2.0:1784191894.487624:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+175:123690:x1870858812455424:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191894.487648:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191894.487687:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4ce47 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c30b expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.487786:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4ce4e lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.487799:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4ce4e lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.487810:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4ce4e lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.487826:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ce55 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.487832:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ce55 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.487837:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ce55 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.487877:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4ce4e lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.487903:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4ce4e lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.487909:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4ce4e lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.487915:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4ce4e lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.487921:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7dc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191894.487926:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4ce4e lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.487934:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4ce4e lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.487946:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191894.487950:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.487954:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4ce4e lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.487961:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7dc00/0xfeec3c2dc5a4ce4e lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.487979:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ce55 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.487985:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ce55 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.487991:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ce55 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.488002:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191894.488006:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ce55 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.488012:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ce55 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.488021:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x22eacdcf (ffff8af10994d900) 00010000:00010000:2.0:1784191894.488024:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.488026:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ce55 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.488031:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4ce55 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.488070:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4ce47 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c30b expref: 176 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.488081:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191894.488083:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.488087:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d400/0xfeec3c2dc5a4ce47 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c30b expref: 176 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.488239:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af223b7d400, rc 0) 00000100:00100000:2.0:1784191894.488310:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+175:123690:x1870858812455424:12345-192.168.204.16@tcp:101:cp.0 Request processed in 687us (1092us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191894.488318:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 738 00000100:00100000:0.0:1784191894.492615:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.492729:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812455680 00000100:00100000:1.0:1784191894.492741:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812455680 00000100:00100000:1.0:1784191894.492805:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 739 00000100:00100000:1.0:1784191894.492815:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+175:123690:x1870858812455680:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191894.492838:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191894.492860:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4ce5c lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c312 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.492975:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4ce63 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.492988:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4ce63 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.493018:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4ce63 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.493036:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ce6a lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.493043:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ce6a lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.493049:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ce6a lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191894.493390:0:164531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1e7:0x0], index 1: 0 00080000:00000400:1.0:1784191894.493402:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191894.493405:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191894.493408:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191894.493410:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.493412:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191894.493415:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191894.493659:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191894.493662:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191894.493664:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191894.493666:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.493668:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191894.493770:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191894.493806:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191894.493809:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191894.493811:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191894.493813:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.493815:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191894.493826:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191894.493937:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4ce71 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.493950:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4ce71 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.493959:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4ce71 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.493994:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4ce63 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.494002:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4ce63 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.494009:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4ce63 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.494017:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4ce63 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.494024:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200031a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.494028:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4ce63 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.494037:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4ce63 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.494049:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.494052:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.494056:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4ce63 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.494074:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4ce63 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191894.494554:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000615a06f8 reply state 000000000e8d9176 transno 34359738802 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ce6a lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.494571:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ce6a lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.494578:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x22eacdcf (ffff8af204e31200) 00010000:00010000:1.0:1784191894.494580:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191894.494583:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191894.494623:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4ce5c lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c312 expref: 178 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.494640:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4ce71 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c312 expref: 177 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.494649:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x4b:0x0].0x0 (ffff8af204e31e00) 00010000:00010000:1.0:1784191894.494651:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191894.494653:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3f000, rc 0) 00000100:00100000:1.0:1784191894.494988:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+178:123690:x1870858812455680:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2171us (2382us total) trans 34359738802 rc 0/0 00000100:00100000:1.0:1784191894.494997:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 739 00000100:00100000:0.0:1784191894.499354:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.499626:0:162390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812455808 00000100:00100000:2.0:1784191894.499654:0:162390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812455808 00000100:00100000:2.0:1784191894.499950:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 400 00000100:00100000:2.0:1784191894.499962:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+41:69112:x1870858812455808:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191894.499983:0:162390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191894.500005:0:162390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ce7f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c319 expref: -99 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191894.500030:0:162390:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191894.500054:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e7:0x0].0x0 since=5514s v=(0 0) 00010000:00010000:2.0:1784191894.500059:0:162390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191894.500070:0:162390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ce7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c319 expref: 42 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.500088:0:162390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ce7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c319 expref: 42 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.500101:0:162390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9c00, rc 0) 00000100:00100000:2.0:1784191894.500211:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+42:69112:x1870858812455808:12345-192.168.204.16@tcp:101:cp.0 Request processed in 250us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191894.500219:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 400 00000100:00100000:0.0:1784191894.503375:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.503531:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812455936 00000100:00100000:2.0:1784191894.503543:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812455936 00000100:00100000:2.0:1784191894.503680:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 401 00000100:00100000:2.0:1784191894.503728:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+42:123690:x1870858812455936:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191894.503751:0:162391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191894.503771:0:162391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089fd668b/0xfeec3c2dc5a4ce86 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c320 expref: -99 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.503828:0:162391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ce7f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c319 expref: 43 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.503837:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191894.503841:0:162391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191894.503847:0:162391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089fd668b/0xfeec3c2dc5a4ce86 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c320 expref: 43 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.503882:0:162391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ce7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c319 expref: 43 pid: 162390 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.503895:0:162391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ce7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c319 expref: 43 pid: 162390 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191894.503910:0:162391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:162391:1870858827977728:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191894.503994:0:162391:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f82fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784191894.506887:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.506980:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812456064 00000100:00100000:1.0:1784191894.506990:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812456064 00010000:00010000:1.0:1784191894.507044:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ce7f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c319 expref: 44 pid: 162390 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191894.507113:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 204 00000100:00100000:1.0:1784191894.507125:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:69110:x1870858812456064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191894.507141:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191894.507167:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ce7f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c319 expref: 44 pid: 162390 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.507182:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ce7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c319 expref: 44 pid: 162390 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.507209:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191894.507214:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191894.507223:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000089fd668b/0xfeec3c2dc5a4ce86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c320 expref: 44 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.507234:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089fd668b/0xfeec3c2dc5a4ce86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c320 expref: 44 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.507283:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000089fd668b/0xfeec3c2dc5a4ce86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c320 expref: 44 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191894.507299:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827977856:192.168.204.16@tcp:105: 00000100:00100000:1.0:1784191894.507393:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cfe9900 going to sleep for 11 seconds 00010000:00010000:2.0:1784191894.507501:0:162391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ce7f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c319 expref: 44 pid: 162390 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191894.507528:0:162391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:162391:1870858827977728:192.168.204.16@tcp:104: 00010000:00010000:2.0:1784191894.507557:0:162391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000089fd668b/0xfeec3c2dc5a4ce86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c320 expref: 43 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.507583:0:162391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8c00, rc 0) 00000100:00100000:2.0:1784191894.507618:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:123690:x1870858812455936:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3926us (4251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191894.507625:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 401 00000100:00100000:1.0:1784191894.511122:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.511341:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:158651:1870858827977856:192.168.204.16@tcp:105: 00010000:00010000:3.0:1784191894.511374:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191894.511456:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+42:69110:x1870858812456064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4333us (4581us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191894.511468:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 204 00000100:00100000:3.0:1784191894.511527:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812456320 00000100:00100000:3.0:1784191894.511533:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812456320 00000100:00100000:3.0:1784191894.511580:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 211 00000100:00100000:3.0:1784191894.511589:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+178:123690:x1870858812456320:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:3.0:1784191894.511964:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+179:123690:x1870858812456320:12345-192.168.204.16@tcp:35:cp.0 Request processed in 375us (854us total) trans 34359738803 rc 0/0 00000100:00100000:3.0:1784191894.511971:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 211 00000100:00100000:1.0:1784191894.515804:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.515956:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812456448 00000100:00100000:3.0:1784191894.515966:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812456448 00000100:00100000:3.0:1784191894.516034:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 740 00000100:00100000:3.0:1784191894.516044:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+179:123690:x1870858812456448:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191894.516072:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191894.516108:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b400/0xfeec3c2dc5a4ce8d lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c327 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516182:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4ce94 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516198:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4ce94 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516230:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4ce94 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516246:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ce9b lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516254:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ce9b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516260:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ce9b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516307:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4ce94 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516315:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4ce94 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516321:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4ce94 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516328:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4ce94 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516334:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341aa00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191894.516338:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4ce94 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516346:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4ce94 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516358:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191894.516367:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.516372:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4ce94 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516380:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4ce94 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516397:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ce9b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516402:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ce9b lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516407:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ce9b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516412:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191894.516414:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ce9b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516421:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ce9b lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516441:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9ce4d69c (ffff8af20290e900) 00010000:00010000:3.0:1784191894.516444:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.516447:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ce9b lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516452:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4ce9b lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516485:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b400/0xfeec3c2dc5a4ce8d lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c327 expref: 180 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516511:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191894.516514:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.516518:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b400/0xfeec3c2dc5a4ce8d lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c327 expref: 180 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.516528:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341b400, rc 0) 00000100:00100000:3.0:1784191894.516589:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+179:123690:x1870858812456448:12345-192.168.204.16@tcp:101:cp.0 Request processed in 547us (796us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191894.516596:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 740 00000100:00100000:1.0:1784191894.519939:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.520029:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812456576 00000100:00100000:2.0:1784191894.520045:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812456576 00000100:00100000:2.0:1784191894.520158:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 741 00000100:00100000:2.0:1784191894.520171:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+179:123690:x1870858812456576:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191894.520196:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191894.520219:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4cea2 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c32e expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520296:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4cea9 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520311:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4cea9 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520323:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4cea9 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520338:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8400/0xfeec3c2dc5a4ceb0 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520345:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8400/0xfeec3c2dc5a4ceb0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520352:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8400/0xfeec3c2dc5a4ceb0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520439:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4cea9 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520446:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4cea9 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520452:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4cea9 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520459:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4cea9 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520466:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191894.520471:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4cea9 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520479:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4cea9 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520493:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191894.520496:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.520500:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4cea9 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520526:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4cea9 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520542:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8400/0xfeec3c2dc5a4ceb0 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520548:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8400/0xfeec3c2dc5a4ceb0 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520561:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8400/0xfeec3c2dc5a4ceb0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520567:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191894.520570:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8400/0xfeec3c2dc5a4ceb0 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520575:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8400/0xfeec3c2dc5a4ceb0 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520584:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9ce4d69c (ffff8af10994d900) 00010000:00010000:2.0:1784191894.520586:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.520589:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8400/0xfeec3c2dc5a4ceb0 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520595:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8400/0xfeec3c2dc5a4ceb0 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520633:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4cea2 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c32e expref: 180 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520644:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191894.520646:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.520649:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8800/0xfeec3c2dc5a4cea2 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c32e expref: 180 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.520659:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8800, rc 0) 00000100:00100000:2.0:1784191894.520785:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+179:123690:x1870858812456576:12345-192.168.204.16@tcp:101:cp.0 Request processed in 616us (859us total) trans 0 rc 301/301 00000100:00100000:2.0:1784191894.520801:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 741 00000100:00100000:1.0:1784191894.524079:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191894.524248:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812456832 00000100:00100000:0.0:1784191894.524259:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812456832 00000100:00100000:0.0:1784191894.524351:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 742 00000100:00100000:0.0:1784191894.524362:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+179:123690:x1870858812456832:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191894.524387:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191894.524409:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4ceb7 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c335 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.524545:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cebe lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.524563:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cebe lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.524576:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cebe lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.524591:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cec5 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.524599:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cec5 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.524627:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cec5 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191894.525370:0:164531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x26b:0x0], index 0: 0 00080000:00000400:0.0:1784191894.525385:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:0.0:1784191894.525389:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:0.0:1784191894.525391:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191894.525393:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191894.525396:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191894.525398:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191894.525416:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:0.0:1784191894.525419:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:0.0:1784191894.525420:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191894.525422:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191894.525424:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191894.525426:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191894.525460:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 278, rollback = 2 00080000:00000400:0.0:1784191894.525463:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:0.0:1784191894.525465:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:0.0:1784191894.525467:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191894.525469:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191894.525471:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191894.525588:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cecc lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.525599:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cecc lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.525608:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cecc lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.525660:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cebe lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.525666:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cebe lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.525881:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cebe lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.525891:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cebe lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.525898:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191894.525902:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cebe lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.525910:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cebe lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.525922:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191894.525925:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191894.525930:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cebe lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.525936:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cebe lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191894.525953:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000040e121fb reply state 00000000cea7130f transno 34359738804 ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cec5 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.525963:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cec5 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.525977:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9ce4d69c (ffff8af22de8be00) 00010000:00010000:0.0:1784191894.525979:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191894.525982:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784191894.526018:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4ceb7 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c335 expref: 182 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.526033:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cecc lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c335 expref: 181 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.526040:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x4c:0x0].0x0 (ffff8af22de8ba00) 00010000:00010000:0.0:1784191894.526043:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784191894.526045:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1019d4600, rc 0) 00000100:00100000:0.0:1784191894.526173:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+182:123690:x1870858812456832:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1812us (2108us total) trans 34359738804 rc 0/0 00000100:00100000:0.0:1784191894.526181:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 742 00000100:00100000:1.0:1784191894.530511:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.530631:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812456960 00000100:00100000:2.0:1784191894.530644:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812456960 00000100:00100000:2.0:1784191894.530921:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 402 00000100:00100000:2.0:1784191894.530933:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+42:69109:x1870858812456960:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:2.0:1784191894.530955:0:160165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191894.530977:0:160165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ceda lrc: 2/0,0 mode: --/PR res: [0x280000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c33c expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191894.531008:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191894.531034:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26b:0x0].0x0 since=5514s v=(0 0) 00010000:00010000:2.0:1784191894.531040:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191894.531052:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ceda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c33c expref: 43 pid: 160165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.531072:0:160165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ceda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c33c expref: 43 pid: 160165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.531086:0:160165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9c00, rc 0) 00000100:00100000:2.0:1784191894.531162:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69109:x1870858812456960:12345-192.168.204.16@tcp:101:cp.0 Request processed in 232us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191894.531169:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 402 00000100:00100000:3.0:1784191894.534112:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191894.534603:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812457088 00000100:00100000:0.0:1784191894.534615:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812457088 00000100:00100000:0.0:1784191894.534784:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 403 00000100:00100000:0.0:1784191894.534795:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:123690:x1870858812457088:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191894.534818:0:162387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191894.534841:0:162387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9ad66f0/0xfeec3c2dc5a4cee1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c343 expref: -99 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.534875:0:162387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ceda lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c33c expref: 44 pid: 160165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.534906:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191894.534910:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191894.534916:0:162387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ad66f0/0xfeec3c2dc5a4cee1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x26b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c343 expref: 44 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.534953:0:162387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ceda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c33c expref: 44 pid: 160165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.534967:0:162387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ceda lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c33c expref: 44 pid: 160165 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191894.534982:0:162387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:162387:1870858827977984:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191894.535073:0:162387:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9e780 going to sleep for 11 seconds 00000100:00100000:0.0:1784191894.537829:0:162387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:162387:1870858827977984:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191894.537872:0:162387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9ad66f0/0xfeec3c2dc5a4cee1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x26b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c343 expref: 44 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.537892:0:162387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db2a00, rc 0) 00000100:00100000:0.0:1784191894.537946:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:123690:x1870858812457088:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3152us (3842us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191894.537955:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 403 00000100:00100000:2.0:1784191894.539725:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.539861:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812457216 00000100:00100000:1.0:1784191894.539872:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812457216 00010000:00010000:1.0:1784191894.539926:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ceda lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c33c expref: 44 pid: 160165 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191894.539975:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 205 00000100:00100000:1.0:1784191894.539986:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:69111:x1870858812457216:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191894.540005:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191894.540034:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ceda lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x26b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c33c expref: 44 pid: 160165 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.540051:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ceda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x26b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c33c expref: 44 pid: 160165 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.540079:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4b2e584/0xfeec3c2dc5a4ceda lrc: 0/0,0 mode: --/PR res: [0x280000401:0x26b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c33c expref: 44 pid: 160165 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.540097:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191894.540102:0:158652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191894.540111:0:158652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9ad66f0/0xfeec3c2dc5a4cee1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c343 expref: 43 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.540142:0:158652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ad66f0/0xfeec3c2dc5a4cee1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c343 expref: 43 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.540185:0:158652:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e9ad66f0/0xfeec3c2dc5a4cee1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c343 expref: 43 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191894.540202:0:158652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:158652:1870858827978112:192.168.204.16@tcp:105: 00000100:00100000:1.0:1784191894.540301:0:158652:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23cfe9900 going to sleep for 11 seconds 00000100:00100000:3.0:1784191894.544799:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.544938:0:158652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:158652:1870858827978112:192.168.204.16@tcp:105: 00010000:00010000:1.0:1784191894.544966:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191894.545022:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69111:x1870858812457216:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5037us (5360us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191894.545033:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 205 00000100:00100000:0.0:1784191894.545161:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812457472 00000100:00100000:0.0:1784191894.545169:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812457472 00000100:00100000:0.0:1784191894.545222:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 212 00000100:00100000:0.0:1784191894.545252:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+182:123690:x1870858812457472:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:0.0:1784191894.545550:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+183:123690:x1870858812457472:12345-192.168.204.16@tcp:35:cp.0 Request processed in 301us (763us total) trans 34359738805 rc 0/0 00000100:00100000:0.0:1784191894.545558:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 212 00000100:00100000:3.0:1784191894.549332:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.550046:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812457600 00000100:00100000:1.0:1784191894.550061:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812457600 00000100:00100000:1.0:1784191894.550215:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 743 00000100:00100000:1.0:1784191894.550225:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+183:123690:x1870858812457600:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191894.550252:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191894.550274:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4cee8 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c34a expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550345:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ceef lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550360:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ceef lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550387:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ceef lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550402:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cef6 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550409:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cef6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550415:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cef6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550473:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ceef lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550481:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ceef lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550487:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ceef lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550493:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ceef lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550500:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.550512:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ceef lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550520:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ceef lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550532:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.550541:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.550547:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ceef lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550555:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4ceef lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550571:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cef6 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550577:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cef6 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550583:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cef6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550588:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.550591:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cef6 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550596:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cef6 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550603:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x6caa4986 (ffff8af204e31300) 00010000:00010000:1.0:1784191894.550605:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.550608:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cef6 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550613:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e400/0xfeec3c2dc5a4cef6 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550644:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4cee8 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c34a expref: 184 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550659:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.550661:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.550664:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e000/0xfeec3c2dc5a4cee8 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c34a expref: 184 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.550682:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3e000, rc 0) 00000100:00100000:1.0:1784191894.550819:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+183:123690:x1870858812457600:12345-192.168.204.16@tcp:101:cp.0 Request processed in 595us (1498us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191894.550826:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 743 00000100:00100000:2.0:1784191894.553637:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.553894:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812457728 00000100:00100000:1.0:1784191894.553907:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812457728 00000100:00100000:1.0:1784191894.554025:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 744 00000100:00100000:1.0:1784191894.554036:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+183:123690:x1870858812457728:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191894.554063:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191894.554105:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cefd lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c351 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554184:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cf04 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554203:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cf04 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554217:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cf04 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554235:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf0b lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554262:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf0b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554270:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf0b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554326:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cf04 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554333:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cf04 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554339:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cf04 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554346:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cf04 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554352:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200031a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.554358:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cf04 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554365:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cf04 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554378:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.554381:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.554385:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cf04 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554392:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031a00/0xfeec3c2dc5a4cf04 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554417:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf0b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554511:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf0b lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554518:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf0b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554523:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d7a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.554526:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf0b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554531:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf0b lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554539:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x6caa4986 (ffff8af204e31c00) 00010000:00010000:1.0:1784191894.554542:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.554545:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf0b lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554551:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf0b lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554589:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cefd lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c351 expref: 184 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554599:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.554602:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.554613:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030c00/0xfeec3c2dc5a4cefd lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c351 expref: 184 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.554623:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af200030c00, rc 0) 00000100:00100000:1.0:1784191894.554864:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+183:123690:x1870858812457728:12345-192.168.204.16@tcp:101:cp.0 Request processed in 828us (1240us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191894.554872:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 744 00000100:00100000:2.0:1784191894.559047:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.559497:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812457984 00000100:00100000:1.0:1784191894.559516:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812457984 00000100:00100000:1.0:1784191894.559621:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 745 00000100:00100000:1.0:1784191894.559633:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+183:123690:x1870858812457984:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191894.559659:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191894.559717:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7c00/0xfeec3c2dc5a4cf12 lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c358 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.559843:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4cf19 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.559860:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4cf19 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.559874:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4cf19 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.559889:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6c00/0xfeec3c2dc5a4cf20 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.559895:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6c00/0xfeec3c2dc5a4cf20 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.559901:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6c00/0xfeec3c2dc5a4cf20 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191894.560412:0:164531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1e8:0x0], index 1: 0 00080000:00000400:1.0:1784191894.560438:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191894.560443:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191894.560445:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191894.560447:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.560449:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191894.560451:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191894.560468:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191894.560471:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191894.560472:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191894.560474:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.560476:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191894.560478:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191894.560518:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191894.560521:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191894.560523:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191894.560524:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.560526:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191894.560528:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191894.560639:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7800/0xfeec3c2dc5a4cf27 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.560650:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7800/0xfeec3c2dc5a4cf27 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.560657:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7800/0xfeec3c2dc5a4cf27 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.560758:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4cf19 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.560781:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4cf19 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.560786:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4cf19 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.560793:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4cf19 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.560799:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d6e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.560804:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4cf19 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.560812:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4cf19 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.560825:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.560829:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.560834:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4cf19 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.560840:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4cf19 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191894.560854:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000794283ea reply state 000000004289b08e transno 34359738806 ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6c00/0xfeec3c2dc5a4cf20 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.560865:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6c00/0xfeec3c2dc5a4cf20 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.560871:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x6caa4986 (ffff8af204e31300) 00010000:00010000:1.0:1784191894.560880:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191894.560883:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191894.560922:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7c00/0xfeec3c2dc5a4cf12 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c358 expref: 186 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.560937:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7800/0xfeec3c2dc5a4cf27 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c358 expref: 185 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.560943:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x4d:0x0].0x0 (ffff8af204e31a00) 00010000:00010000:1.0:1784191894.560945:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191894.560947:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af2035d7800, rc 0) 00000100:00100000:1.0:1784191894.561021:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+186:123690:x1870858812457984:12345-192.168.204.16@tcp:101:cp.0 Request processed in 1390us (1985us total) trans 34359738806 rc 0/0 00000100:00100000:1.0:1784191894.561030:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 745 00000100:00100000:2.0:1784191894.565071:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.565242:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812458112 00000100:00100000:1.0:1784191894.565257:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812458112 00000100:00100000:1.0:1784191894.565358:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 404 00000100:00100000:1.0:1784191894.565369:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+42:69111:x1870858812458112:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191894.565394:0:162389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191894.565436:0:162389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000497ff3b0/0xfeec3c2dc5a4cf35 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c35f expref: -99 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784191894.565472:0:162389:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191894.565501:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e8:0x0].0x0 since=5514s v=(0 0) 00010000:00010000:1.0:1784191894.565515:0:162389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191894.565527:0:162389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000497ff3b0/0xfeec3c2dc5a4cf35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c35f expref: 43 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.565574:0:162389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000497ff3b0/0xfeec3c2dc5a4cf35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c35f expref: 43 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.565588:0:162389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af2035d6400, rc 0) 00000100:00100000:1.0:1784191894.565784:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69111:x1870858812458112:12345-192.168.204.16@tcp:101:cp.0 Request processed in 416us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191894.565791:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 404 00000100:00100000:2.0:1784191894.592330:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191894.592474:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812458240 00000100:00100000:0.0:1784191894.592487:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812458240 00000100:00100000:0.0:1784191894.592682:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 405 00000100:00100000:0.0:1784191894.592736:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:123690:x1870858812458240:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191894.592760:0:162396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191894.592780:0:162396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000453d8882/0xfeec3c2dc5a4cf3c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c366 expref: -99 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.592815:0:162396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000497ff3b0/0xfeec3c2dc5a4cf35 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c35f expref: 44 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.592823:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191894.592827:0:162396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191894.592833:0:162396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000453d8882/0xfeec3c2dc5a4cf3c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->319487] (req 0->319487) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c366 expref: 44 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.592869:0:162396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000497ff3b0/0xfeec3c2dc5a4cf35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c35f expref: 44 pid: 162389 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.592882:0:162396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000497ff3b0/0xfeec3c2dc5a4cf35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c35f expref: 44 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191894.592919:0:162396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:162396:1870858827978240:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191894.593013:0:162396:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9e180 going to sleep for 11 seconds 00010000:00010000:3.0:1784191894.607654:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191894.610230:0:162396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:162396:1870858827978240:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191894.610272:0:162396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000453d8882/0xfeec3c2dc5a4cf3c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->319487] (req 0->319487) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c366 expref: 44 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.610293:0:162396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af110db3400, rc 0) 00000100:00100000:0.0:1784191894.610362:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:123690:x1870858812458240:12345-192.168.204.16@tcp:101:cp.0 Request processed in 17628us (18042us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191894.610372:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 405 00000100:00100000:2.0:1784191894.611785:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.611908:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812458368 00000100:00100000:1.0:1784191894.611920:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812458368 00010000:00010000:1.0:1784191894.611964:0:165501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000497ff3b0/0xfeec3c2dc5a4cf35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c35f expref: 44 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191894.612011:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 206 00000100:00100000:1.0:1784191894.612021:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23b101850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:69110:x1870858812458368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191894.612039:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191894.612075:0:165501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000497ff3b0/0xfeec3c2dc5a4cf35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c35f expref: 44 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.612258:0:165501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000497ff3b0/0xfeec3c2dc5a4cf35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c35f expref: 44 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.612287:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000497ff3b0/0xfeec3c2dc5a4cf35 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c35f expref: 44 pid: 162389 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.612326:0:165501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191894.612331:0:165501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191894.612342:0:165501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000453d8882/0xfeec3c2dc5a4cf3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c366 expref: 43 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.612351:0:165501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000453d8882/0xfeec3c2dc5a4cf3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c366 expref: 43 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.612390:0:165501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000453d8882/0xfeec3c2dc5a4cf3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c366 expref: 43 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191894.612404:0:165501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:165501:1870858827978368:192.168.204.16@tcp:105: 00000100:00100000:1.0:1784191894.612554:0:165501:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10fb5ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1784191894.620358:0:165501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:165501:1870858827978368:192.168.204.16@tcp:105: 00010000:00010000:3.0:1784191894.620390:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191894.620469:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23b101850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69110:x1870858812458368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8448us (10416us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191894.620481:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 206 00000100:00100000:2.0:1784191894.624416:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191894.624530:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812458624 00000100:00100000:0.0:1784191894.624541:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812458624 00000100:00100000:0.0:1784191894.624605:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 213 00000100:00100000:0.0:1784191894.624619:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+186:123690:x1870858812458624:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:0.0:1784191894.625000:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+187:123690:x1870858812458624:12345-192.168.204.16@tcp:35:cp.0 Request processed in 383us (593us total) trans 34359738807 rc 0/0 00000100:00100000:0.0:1784191894.625009:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 213 00000100:00100000:2.0:1784191894.631917:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.632032:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812458752 00000100:00100000:1.0:1784191894.632042:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812458752 00000100:00100000:1.0:1784191894.632117:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 746 00000100:00100000:1.0:1784191894.632128:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+187:123690:x1870858812458752:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191894.632160:0:158667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191894.632183:0:158667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4cf43 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c36d expref: -99 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.632255:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf4a lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.632461:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf4a lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.632492:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf4a lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.632588:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf51 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.632598:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf51 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.632605:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf51 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.633011:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf4a lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.633020:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf4a lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.633026:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf4a lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.633032:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf4a lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.633038:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d7a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.633043:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf4a lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.633050:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf4a lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.633459:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.633473:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.633480:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf4a lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.633488:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf4a lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.633514:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf51 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.633519:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf51 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.633525:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf51 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.633530:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d6800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.633534:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf51 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.633540:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf51 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.633549:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x47a21a83 (ffff8af204e31c00) 00010000:00010000:1.0:1784191894.633551:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.633554:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf51 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.633559:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf51 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.633603:0:158667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4cf43 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c36d expref: 188 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.633620:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.633623:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.633627:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4cf43 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c36d expref: 188 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.634351:0:158667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af2035d6e00, rc 0) 00000100:00100000:1.0:1784191894.634439:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+187:123690:x1870858812458752:12345-192.168.204.16@tcp:101:cp.0 Request processed in 2310us (2533us total) trans 0 rc 301/301 00000100:00100000:1.0:1784191894.634449:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 746 00000100:00100000:1.0:1784191894.642567:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191894.643014:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812458880 00000100:00100000:2.0:1784191894.643026:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812458880 00000100:00100000:0.0:1784191894.643417:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 747 00000100:00100000:0.0:1784191894.643430:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+187:123690:x1870858812458880:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:0.0:1784191894.643454:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191894.643476:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cf58 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c374 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643589:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cf5f lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643604:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cf5f lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643616:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cf5f lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643646:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cf66 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643654:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cf66 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643660:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cf66 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643745:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cf5f lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643753:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cf5f lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643760:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cf5f lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643766:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cf5f lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643772:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191894.643784:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cf5f lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643792:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cf5f lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643805:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191894.643808:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191894.643812:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cf5f lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643818:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cf5f lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643835:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cf66 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643841:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cf66 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643847:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cf66 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643852:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874b200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191894.643855:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cf66 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643860:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cf66 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643867:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x47a21a83 (ffff8af22de8bc00) 00010000:00010000:0.0:1784191894.643870:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191894.643893:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cf66 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643899:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cf66 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643930:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cf58 lrc: 1/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c374 expref: 188 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643940:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191894.643943:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191894.643946:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cf58 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c374 expref: 188 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.643956:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233126800, rc 0) 00000100:00100000:0.0:1784191894.644143:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+187:123690:x1870858812458880:12345-192.168.204.16@tcp:101:cp.0 Request processed in 715us (1585us total) trans 0 rc 301/301 00000100:00100000:0.0:1784191894.644151:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 747 00000100:00100000:2.0:1784191894.648900:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.650566:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812459136 00000100:00100000:1.0:1784191894.650582:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812459136 00000100:00100000:1.0:1784191894.650910:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 748 00000100:00100000:1.0:1784191894.650922:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+187:123690:x1870858812459136:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191894.650949:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191894.650971:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4cf6d lrc: 2/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c37b expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.652056:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf74 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.652078:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf74 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.652209:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf74 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.652251:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf7b lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.652260:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf7b lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.652268:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf7b lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784191894.652836:0:164531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x26c:0x0], index 0: 0 00080000:00000400:1.0:1784191894.652850:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191894.652854:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191894.652857:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191894.652859:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.652861:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191894.652863:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191894.652884:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191894.652887:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191894.652888:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191894.652890:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.652892:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191894.652894:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191894.652926:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 278, rollback = 2 00080000:00000400:1.0:1784191894.652929:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191894.652931:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 4/278/0 00080000:00000400:1.0:1784191894.652934:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/20/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.652936:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191894.652937:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191894.653044:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7e00/0xfeec3c2dc5a4cf82 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.653070:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7e00/0xfeec3c2dc5a4cf82 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.653079:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7e00/0xfeec3c2dc5a4cf82 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.653379:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf74 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.653388:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf74 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.653393:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf74 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.653399:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf74 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.653404:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d6800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.653408:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf74 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.653415:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf74 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.653427:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.653431:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.653435:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf74 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.653441:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf74 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191894.653468:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000661e734c reply state 000000001e3f6d93 transno 34359738808 ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf7b lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.653480:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf7b lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.653488:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x47a21a83 (ffff8af204e31c00) 00010000:00010000:1.0:1784191894.653490:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191894.653493:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784191894.653545:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4cf6d lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c37b expref: 190 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.653562:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7e00/0xfeec3c2dc5a4cf82 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c37b expref: 189 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.653570:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x4e:0x0].0x0 (ffff8af204e31d00) 00010000:00010000:1.0:1784191894.653572:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191894.653574:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af2035d7e00, rc 0) 00000100:00100000:1.0:1784191894.654377:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+190:123690:x1870858812459136:12345-192.168.204.16@tcp:101:cp.0 Request processed in 3454us (5486us total) trans 34359738808 rc 0/0 00000100:00100000:1.0:1784191894.654387:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 748 00000100:00100000:2.0:1784191894.659627:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.659809:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812459264 00000100:00100000:1.0:1784191894.659821:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812459264 00000100:00100000:1.0:1784191894.659885:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 406 00000100:00100000:1.0:1784191894.659896:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69109:x1870858812459264:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:1.0:1784191894.659917:0:162395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191894.659939:0:162395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005635682b/0xfeec3c2dc5a4cf90 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c382 expref: -99 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784191894.659982:0:162395:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784191894.660003:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26c:0x0].0x0 since=5514s v=(0 0) 00010000:00010000:1.0:1784191894.660007:0:162395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191894.660017:0:162395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005635682b/0xfeec3c2dc5a4cf90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c382 expref: 44 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.660033:0:162395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005635682b/0xfeec3c2dc5a4cf90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c382 expref: 44 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.660056:0:162395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af2035d6e00, rc 0) 00000100:00100000:1.0:1784191894.660133:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:69109:x1870858812459264:12345-192.168.204.16@tcp:101:cp.0 Request processed in 240us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191894.660140:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 406 00000100:00100000:2.0:1784191894.674394:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.674583:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812459392 00000100:00100000:3.0:1784191894.674601:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812459392 00000100:00100000:3.0:1784191894.674674:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 407 00000100:00100000:3.0:1784191894.674686:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:123690:x1870858812459392:12345-192.168.204.16@tcp:101:cp.0 00010000:00010000:3.0:1784191894.674752:0:162339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191894.674776:0:162339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000407a238a/0xfeec3c2dc5a4cf97 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c389 expref: -99 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.674905:0:162339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005635682b/0xfeec3c2dc5a4cf90 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x26c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c382 expref: 45 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.674915:0:162339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191894.674919:0:162339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191894.674925:0:162339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000407a238a/0xfeec3c2dc5a4cf97 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x26c:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c389 expref: 45 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.674967:0:162339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005635682b/0xfeec3c2dc5a4cf90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x26c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c382 expref: 45 pid: 162395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.674998:0:162339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005635682b/0xfeec3c2dc5a4cf90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x26c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c382 expref: 45 pid: 162395 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191894.675013:0:162339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:162339:1870858827978496:192.168.204.16@tcp:104: 00000100:00100000:0.0:1784191894.677868:0:162339:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af105b9e180 going to sleep for 11 seconds 00000100:00100000:2.0:1784191894.696514:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.696810:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812459520 00000100:00100000:3.0:1784191894.696820:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812459520 00010000:00010000:3.0:1784191894.696868:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005635682b/0xfeec3c2dc5a4cf90 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x26c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c382 expref: 46 pid: 162395 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191894.696923:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 207 00000100:00100000:3.0:1784191894.696933:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+46:69111:x1870858812459520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191894.696952:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191894.696977:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005635682b/0xfeec3c2dc5a4cf90 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x26c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c382 expref: 46 pid: 162395 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.696994:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005635682b/0xfeec3c2dc5a4cf90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x26c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c382 expref: 46 pid: 162395 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.697028:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191894.697034:0:158651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191894.697043:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000407a238a/0xfeec3c2dc5a4cf97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c389 expref: 46 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.697055:0:158651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000407a238a/0xfeec3c2dc5a4cf97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c389 expref: 46 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.697099:0:158651:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000407a238a/0xfeec3c2dc5a4cf97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c389 expref: 46 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191894.697160:0:158651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827978624:192.168.204.16@tcp:105: 00010000:00010000:0.0:1784191894.719267:0:162339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005635682b/0xfeec3c2dc5a4cf90 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x26c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c382 expref: 46 pid: 162395 timeout: 5614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191894.719297:0:162339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:162339:1870858827978496:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191894.719333:0:162339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000407a238a/0xfeec3c2dc5a4cf97 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x26c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c389 expref: 45 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.719350:0:162339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20341b400, rc 0) 00000100:00100000:0.0:1784191894.719901:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+45:123690:x1870858812459392:12345-192.168.204.16@tcp:101:cp.0 Request processed in 45214us (45517us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191894.719912:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 407 00000100:00100000:2.0:1784191894.726842:0:158651:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2387a7240 going to sleep for 11 seconds 00000100:00100000:1.0:1784191894.730627:0:158651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:158651:1870858827978624:192.168.204.16@tcp:105: 00010000:00010000:1.0:1784191894.730660:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191894.730751:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:69111:x1870858812459520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 33819us (34259us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191894.730763:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 207 00000100:00100000:3.0:1784191894.735358:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191894.735477:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812459776 00000100:00100000:0.0:1784191894.735490:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812459776 00000100:00100000:0.0:1784191894.735576:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 214 00000100:00100000:0.0:1784191894.735587:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+190:123690:x1870858812459776:12345-192.168.204.16@tcp:35:cp.0 00000100:00100000:0.0:1784191894.735981:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+191:123690:x1870858812459776:12345-192.168.204.16@tcp:35:cp.0 Request processed in 395us (634us total) trans 34359738809 rc 0/0 00000100:00100000:0.0:1784191894.735989:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 214 00000100:00100000:2.0:1784191894.843115:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.843238:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812460032 00000100:00100000:1.0:1784191894.843250:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812460032 00000100:00100000:1.0:1784191894.843315:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 749 00000100:00100000:1.0:1784191894.843325:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+191:123692:x1870858812460032:12345-192.168.204.16@tcp:36:createmany.0 00010000:00010000:1.0:1784191894.843477:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf9e lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.843528:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf9e lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.843544:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf9e lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.843562:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6a00/0xfeec3c2dc5a4cfa5 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.843569:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6a00/0xfeec3c2dc5a4cfa5 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.843575:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6a00/0xfeec3c2dc5a4cfa5 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:1.0:1784191894.844013:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 257 < left 264, rollback = 2 00080000:00000400:1.0:1784191894.844018:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191894.844021:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:1.0:1784191894.844023:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.844026:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/2, delete: 0/0/0 00080000:00000400:1.0:1784191894.844028:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191894.844058:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 257 < left 264, rollback = 2 00080000:00000400:1.0:1784191894.844061:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191894.844063:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:1.0:1784191894.844065:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.844067:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/2, delete: 0/0/0 00080000:00000400:1.0:1784191894.844069:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191894.844149:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7000/0xfeec3c2dc5a4cfac lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.844159:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7000/0xfeec3c2dc5a4cfac lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.844177:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7000/0xfeec3c2dc5a4cfac lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191894.844196:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007b5ded10 reply state 0000000072b67ba1 transno 34359738810 ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7000/0xfeec3c2dc5a4cfac lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.844209:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7000/0xfeec3c2dc5a4cfac lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.844216:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x4f:0x0].0x0 (ffff8af204e31600) 00010000:00010000:1.0:1784191894.844219:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191894.844223:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784191894.844228:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab5:0x4f:0x0]: returning size 4096 00010000:00010000:1.0:1784191894.844237:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf9e lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.844244:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf9e lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.844250:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf9e lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.844256:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf9e lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.844263:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d6800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.844267:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf9e lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.844275:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf9e lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.844297:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.844299:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.844303:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf9e lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.844310:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cf9e lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191894.844323:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007b5ded10 reply state 0000000072b67ba1 transno 34359738810 ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6a00/0xfeec3c2dc5a4cfa5 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.844330:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6a00/0xfeec3c2dc5a4cfa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.844336:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xff182846 (ffff8af204e31100) 00010000:00010000:1.0:1784191894.844337:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191894.844339:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1784191894.844461:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+193:123692:x1870858812460032:12345-192.168.204.16@tcp:36:createmany.0 Request processed in 1134us (1369us total) trans 34359738810 rc 0/0 00000100:00100000:1.0:1784191894.844469:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 749 00000100:00100000:2.0:1784191894.853468:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191894.853623:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812460288 00000100:00100000:0.0:1784191894.853636:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812460288 00000100:00100000:0.0:1784191894.853749:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 750 00000100:00100000:0.0:1784191894.853760:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+193:123692:x1870858812460288:12345-192.168.204.16@tcp:36:createmany.0 00010000:00010000:0.0:1784191894.853915:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cfb3 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.853931:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cfb3 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.853943:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cfb3 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.853960:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cfba lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.853967:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cfba lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.853973:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cfba lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:0.0:1784191894.854436:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 264, rollback = 2 00080000:00000400:0.0:1784191894.854441:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191894.854443:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:0.0:1784191894.854445:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191894.854447:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/1, delete: 0/0/0 00080000:00000400:0.0:1784191894.854449:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191894.854477:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 264, rollback = 2 00080000:00000400:0.0:1784191894.854480:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191894.854481:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:0.0:1784191894.854483:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191894.854495:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/1, delete: 0/0/0 00080000:00000400:0.0:1784191894.854509:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191894.854602:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cfc1 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.854614:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cfc1 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.854621:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cfc1 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191894.854634:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b83a0866 reply state 00000000575ed7ff transno 34359738811 ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cfc1 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.854647:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cfc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.854653:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x50:0x0].0x0 (ffff8af22de8bb00) 00010000:00010000:0.0:1784191894.854657:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191894.854660:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784191894.854666:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab5:0x50:0x0]: returning size 4096 00010000:00010000:0.0:1784191894.854674:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cfb3 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.854681:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cfb3 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.854715:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cfb3 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.854723:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cfb3 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.854730:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874b200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191894.854741:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cfb3 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.854749:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cfb3 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.854759:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191894.854762:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191894.854765:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cfb3 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.854772:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4cfb3 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191894.854789:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b83a0866 reply state 00000000575ed7ff transno 34359738811 ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cfba lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.854797:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cfba lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.854803:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x43454b14 (ffff8af22de8bc00) 00010000:00010000:0.0:1784191894.854805:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191894.854807:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1784191894.854905:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+195:123692:x1870858812460288:12345-192.168.204.16@tcp:36:createmany.0 Request processed in 1144us (1447us total) trans 34359738811 rc 0/0 00000100:00100000:0.0:1784191894.854913:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 750 00000100:00100000:2.0:1784191894.861014:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.861131:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812460544 00000100:00100000:1.0:1784191894.861142:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812460544 00000100:00100000:1.0:1784191894.861210:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 751 00000100:00100000:1.0:1784191894.861221:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+195:123692:x1870858812460544:12345-192.168.204.16@tcp:36:createmany.0 00010000:00010000:1.0:1784191894.861359:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cfc8 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.861376:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cfc8 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.861413:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cfc8 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.861443:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6600/0xfeec3c2dc5a4cfcf lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.861452:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6600/0xfeec3c2dc5a4cfcf lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.861458:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6600/0xfeec3c2dc5a4cfcf lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:1.0:1784191894.861924:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 258 < left 264, rollback = 2 00080000:00000400:1.0:1784191894.861929:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191894.861931:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:1.0:1784191894.861934:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.861935:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/1, delete: 0/0/0 00080000:00000400:1.0:1784191894.861937:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191894.861971:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 258 < left 264, rollback = 2 00080000:00000400:1.0:1784191894.861974:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191894.861975:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:1.0:1784191894.861977:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.861979:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/1, delete: 0/0/0 00080000:00000400:1.0:1784191894.861981:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191894.862084:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6000/0xfeec3c2dc5a4cfd6 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.862095:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6000/0xfeec3c2dc5a4cfd6 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.862103:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6000/0xfeec3c2dc5a4cfd6 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191894.862132:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f0a56f9a reply state 00000000da03095a transno 34359738812 ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6000/0xfeec3c2dc5a4cfd6 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.862146:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6000/0xfeec3c2dc5a4cfd6 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.862154:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x51:0x0].0x0 (ffff8af10fe58500) 00010000:00010000:1.0:1784191894.862157:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191894.862161:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784191894.862168:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab5:0x51:0x0]: returning size 4096 00010000:00010000:1.0:1784191894.862182:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cfc8 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.862189:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cfc8 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.862194:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cfc8 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.862201:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cfc8 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.862208:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d6800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.862212:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cfc8 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.862220:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cfc8 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.862232:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191894.862234:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.862245:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cfc8 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.862252:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4cfc8 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191894.862265:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f0a56f9a reply state 00000000da03095a transno 34359738812 ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6600/0xfeec3c2dc5a4cfcf lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.862274:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6600/0xfeec3c2dc5a4cfcf lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.862280:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x87726de2 (ffff8af204e31500) 00010000:00010000:1.0:1784191894.862283:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191894.862285:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1784191894.862376:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+197:123692:x1870858812460544:12345-192.168.204.16@tcp:36:createmany.0 Request processed in 1154us (1373us total) trans 34359738812 rc 0/0 00000100:00100000:1.0:1784191894.862385:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 751 00000100:00100000:2.0:1784191894.891333:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.891515:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812460800 00000100:00100000:3.0:1784191894.891527:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812460800 00000100:00100000:3.0:1784191894.891603:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 752 00000100:00100000:3.0:1784191894.891615:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+197:123693:x1870858812460800:12345-192.168.204.16@tcp:36:createmany.0 00010000:00010000:3.0:1784191894.891824:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4cfdd lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.891856:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4cfdd lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.891869:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4cfdd lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.891890:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cfe4 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xbda0828b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.891896:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cfe4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.891902:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cfe4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:3.0:1784191894.892198:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 264, rollback = 2 00080000:00000400:3.0:1784191894.892203:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191894.892205:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:3.0:1784191894.892207:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.892227:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.892229:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191894.892265:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 264, rollback = 2 00080000:00000400:3.0:1784191894.892268:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191894.892270:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:3.0:1784191894.892271:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.892274:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.892276:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191894.892368:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4cfdd lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.892377:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4cfdd lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.892383:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4cfdd lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.892391:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4cfdd lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.892397:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341aa00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191894.892402:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4cfdd lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.892409:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4cfdd lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.892424:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191894.892426:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.892430:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4cfdd lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.892436:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341aa00/0xfeec3c2dc5a4cfdd lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191894.892460:0:158666:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008404597e reply state 000000008b1f6aeb transno 34359738813 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cfe4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.892471:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cfe4 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.892479:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xbda0828b (ffff8af20290e900) 00010000:00010000:3.0:1784191894.892481:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191894.892484:0:158666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784191894.892597:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+199:123693:x1870858812460800:12345-192.168.204.16@tcp:36:createmany.0 Request processed in 983us (1277us total) trans 34359738813 rc 0/0 00000100:00100000:3.0:1784191894.892605:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 752 00000100:00100000:2.0:1784191894.898440:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.898643:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812461056 00000100:00100000:3.0:1784191894.898654:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812461056 00000100:00100000:3.0:1784191894.898804:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 753 00000100:00100000:3.0:1784191894.898815:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+199:123693:x1870858812461056:12345-192.168.204.16@tcp:36:createmany.0 00010000:00010000:3.0:1784191894.898945:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cfeb lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.898962:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cfeb lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.898977:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cfeb lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.898993:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cff2 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x1cda55a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.898999:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cff2 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.899023:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cff2 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:3.0:1784191894.899305:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 264, rollback = 2 00080000:00000400:3.0:1784191894.899309:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191894.899312:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:3.0:1784191894.899315:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.899317:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.899319:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191894.902319:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 264, rollback = 2 00080000:00000400:3.0:1784191894.902331:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191894.902333:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:3.0:1784191894.905821:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.905826:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.905828:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191894.906016:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cfeb lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.906030:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cfeb lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.906036:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cfeb lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.906042:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cfeb lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.906048:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010be000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191894.906053:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cfeb lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.906080:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cfeb lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.906098:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191894.906101:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.906105:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cfeb lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.906111:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be000/0xfeec3c2dc5a4cfeb lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191894.906127:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ada7ec43 reply state 00000000006d4b05 transno 34359738814 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cff2 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.906138:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cff2 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.906146:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x1cda55a (ffff8af20290e300) 00010000:00010000:3.0:1784191894.906149:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191894.906153:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784191894.906296:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+201:123693:x1870858812461056:12345-192.168.204.16@tcp:36:createmany.0 Request processed in 7477us (7860us total) trans 34359738814 rc 0/0 00000100:00100000:3.0:1784191894.906306:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 753 00000100:00100000:1.0:1784191894.910122:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.910284:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812461312 00000100:00100000:3.0:1784191894.910296:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812461312 00000100:00100000:3.0:1784191894.910375:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 754 00000100:00100000:3.0:1784191894.910388:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+201:123693:x1870858812461312:12345-192.168.204.16@tcp:36:createmany.0 00010000:00010000:3.0:1784191894.910550:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4cff9 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.910592:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4cff9 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.910605:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4cff9 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.910622:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d000 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x45fac828 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.910644:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d000 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.910651:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d000 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:3.0:1784191894.911537:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 264, rollback = 2 00080000:00000400:3.0:1784191894.911544:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191894.911546:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:3.0:1784191894.911548:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.911551:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.911552:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191894.911589:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 264, rollback = 2 00080000:00000400:3.0:1784191894.911591:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191894.911593:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:3.0:1784191894.911595:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.911597:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.911598:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191894.911879:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4cff9 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.911888:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4cff9 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.911906:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4cff9 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.911912:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4cff9 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.911919:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d08e400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191894.911924:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4cff9 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.911932:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4cff9 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.911947:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191894.911950:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.911954:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4cff9 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.911960:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4cff9 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191894.911974:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dd040e4e reply state 0000000070d2841b transno 34359738815 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d000 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.911984:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d000 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.911990:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x45fac828 (ffff8af20290e400) 00010000:00010000:3.0:1784191894.911992:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191894.911995:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784191894.912625:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+203:123693:x1870858812461312:12345-192.168.204.16@tcp:36:createmany.0 Request processed in 2235us (2509us total) trans 34359738815 rc 0/0 00000100:00100000:3.0:1784191894.912646:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 754 00000100:00100000:3.0:1784191894.933387:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191894.933556:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812461440 00000100:00100000:0.0:1784191894.933566:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812461440 00000100:00100000:0.0:1784191894.933639:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 755 00000100:00100000:0.0:1784191894.933650:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+203:123694:x1870858812461440:12345-192.168.204.16@tcp:101:createmany.0 00010000:00010000:0.0:1784191894.933686:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191894.933754:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4d007 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c390 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.933828:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d00e lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.933844:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d00e lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.933856:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d00e lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.933866:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d015 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.933872:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d015 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.933878:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d015 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.933936:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24b600/0xfeec3c2dc5a4d01c lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.933944:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24b600/0xfeec3c2dc5a4d01c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.933950:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24b600/0xfeec3c2dc5a4d01c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191894.933988:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab5:0x4f:0x0]: returning size 4096 00000004:00200000:0.0:1784191894.933991:0:161504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784191894.934010:0:161504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24b600/0xfeec3c2dc5a4d01c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.934030:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d00e lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.934036:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d00e lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.934042:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d00e lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.934048:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d00e lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.934054:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10e24be00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191894.934058:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d00e lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.934065:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d00e lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.934078:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191894.934081:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191894.934086:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d00e lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.934105:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d00e lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.934122:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d015 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.934127:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d015 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.934138:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d015 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.934143:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10e24a200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191894.934146:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d015 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.934152:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d015 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.934160:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xff182846 (ffff8af204e31100) 00010000:00010000:0.0:1784191894.934162:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191894.934165:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d015 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.934170:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d015 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.934198:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b200/0xfeec3c2dc5a4d007 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c390 expref: 205 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.934213:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24b600/0xfeec3c2dc5a4d01c lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c390 expref: 204 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.934220:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x4f:0x0].0x0 (ffff8af204e31600) 00010000:00010000:0.0:1784191894.934222:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784191894.934225:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10e24b600, rc 0) 00000100:00100000:0.0:1784191894.934288:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+204:123694:x1870858812461440:12345-192.168.204.16@tcp:101:createmany.0 Request processed in 640us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191894.934304:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 755 00000100:00100000:2.0:1784191894.938337:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.938437:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812461696 00000100:00100000:3.0:1784191894.938450:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812461696 00000100:00100000:3.0:1784191894.938533:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 756 00000100:00100000:3.0:1784191894.938545:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+204:123694:x1870858812461696:12345-192.168.204.16@tcp:36:createmany.0 00010000:00010000:2.0:1784191894.939316:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d023 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.939337:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d023 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.939350:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d023 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.939367:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4d02a lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x4f:0x0].0xbda0828b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.939375:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4d02a lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x4f:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.939409:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4d02a lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x4f:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:2.0:1784191894.939864:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 264, rollback = 2 00080000:00000400:2.0:1784191894.939870:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191894.939872:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:2.0:1784191894.939874:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191894.939876:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191894.939878:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191894.939907:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 264, rollback = 2 00080000:00000400:2.0:1784191894.939909:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:2.0:1784191894.939911:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:2.0:1784191894.939913:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191894.939915:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:2.0:1784191894.939917:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191894.939984:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d023 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.939993:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d023 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.939999:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d023 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.940006:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d023 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.940012:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191894.940015:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d023 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.940034:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d023 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.940048:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x4f:0x0].0x0 (ffff8af204e31600) 00010000:00010000:2.0:1784191894.940051:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191894.940057:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d023 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.940064:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d023 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191894.940081:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000080b1d348 reply state 0000000042a8f4b5 transno 34359738816 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4d02a lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x4f:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.940241:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4d02a lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191894.940250:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x4f:0x0].0xbda0828b (ffff8af10994d900) 00010000:00010000:2.0:1784191894.940252:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191894.940255:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784191894.940351:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+206:123694:x1870858812461696:12345-192.168.204.16@tcp:36:createmany.0 Request processed in 1806us (2022us total) trans 34359738816 rc 0/0 00000100:00100000:2.0:1784191894.940360:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 756 00000100:00100000:3.0:1784191894.944922:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.945076:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812461952 00000100:00100000:1.0:1784191894.945088:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812461952 00000100:00100000:1.0:1784191894.945170:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 757 00000100:00100000:1.0:1784191894.945182:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+206:123694:x1870858812461952:12345-192.168.204.16@tcp:36:createmany.0 00010000:00010000:1.0:1784191894.945317:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d031 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.945336:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d031 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.945347:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d031 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.945386:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7200/0xfeec3c2dc5a4d038 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x4f:0x0].0x1cda55a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.945407:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7200/0xfeec3c2dc5a4d038 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.945738:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7200/0xfeec3c2dc5a4d038 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:1.0:1784191894.946027:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 264, rollback = 2 00080000:00000400:1.0:1784191894.946031:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191894.946034:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:1.0:1784191894.946036:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.946039:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191894.946041:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191894.946071:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 264, rollback = 2 00080000:00000400:1.0:1784191894.946074:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191894.946076:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:1.0:1784191894.946078:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.946081:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191894.946082:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191894.946304:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d031 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.946312:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d031 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.946319:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d031 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.946327:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d031 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.946343:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d6200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.946347:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d031 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.946356:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d031 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.946370:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x4f:0x0].0x0 (ffff8af204e31600) 00010000:00010000:1.0:1784191894.946373:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.946377:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d031 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.946384:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d031 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191894.946610:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000003a48617 reply state 00000000e2d9ef1e transno 34359738817 ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7200/0xfeec3c2dc5a4d038 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.946625:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7200/0xfeec3c2dc5a4d038 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.946633:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x4f:0x0].0x1cda55a (ffff8af10fe58100) 00010000:00010000:1.0:1784191894.946636:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191894.946639:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784191894.947267:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+208:123694:x1870858812461952:12345-192.168.204.16@tcp:36:createmany.0 Request processed in 1910us (2180us total) trans 34359738817 rc 0/0 00000100:00100000:1.0:1784191894.947277:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 757 00000100:00100000:3.0:1784191894.949818:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.950083:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812462208 00000100:00100000:1.0:1784191894.950103:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812462208 00000100:00100000:1.0:1784191894.950170:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 758 00000100:00100000:1.0:1784191894.950198:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+208:123694:x1870858812462208:12345-192.168.204.16@tcp:36:createmany.0 00010000:00010000:1.0:1784191894.950324:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d03f lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.950341:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d03f lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.950353:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d03f lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.950367:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7600/0xfeec3c2dc5a4d046 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x4f:0x0].0x45fac828 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.950374:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7600/0xfeec3c2dc5a4d046 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.950380:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7600/0xfeec3c2dc5a4d046 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:1.0:1784191894.951001:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 264, rollback = 2 00080000:00000400:1.0:1784191894.951008:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191894.951010:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:1.0:1784191894.951013:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.951015:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191894.951017:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191894.951048:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 264, rollback = 2 00080000:00000400:1.0:1784191894.951051:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:1.0:1784191894.951053:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:1.0:1784191894.951055:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.951057:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191894.951059:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191894.951377:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d03f lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.951549:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d03f lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.951556:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d03f lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.951563:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d03f lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.951570:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d7400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.951575:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d03f lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.951583:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d03f lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.951599:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x4f:0x0].0x0 (ffff8af204e31600) 00010000:00010000:1.0:1784191894.951602:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.951607:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d03f lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.951613:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d03f lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191894.951628:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000056fb7f2c reply state 0000000019784095 transno 34359738818 ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7600/0xfeec3c2dc5a4d046 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.951640:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7600/0xfeec3c2dc5a4d046 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.951647:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x4f:0x0].0x45fac828 (ffff8af10fe58a00) 00010000:00010000:1.0:1784191894.951656:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191894.951659:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784191894.951960:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+210:123694:x1870858812462208:12345-192.168.204.16@tcp:36:createmany.0 Request processed in 1758us (2145us total) trans 34359738818 rc 0/0 00000100:00100000:1.0:1784191894.951970:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 758 00000100:00100000:2.0:1784191894.976595:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.977012:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812462336 00000100:00100000:3.0:1784191894.977024:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812462336 00000100:00100000:3.0:1784191894.977374:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 759 00000100:00100000:3.0:1784191894.977388:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+210:123695:x1870858812462336:12345-192.168.204.16@tcp:101:createmany.0 00010000:00010000:3.0:1784191894.977423:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191894.977452:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4d04d lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c397 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977557:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f800/0xfeec3c2dc5a4d054 lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977574:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f800/0xfeec3c2dc5a4d054 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977588:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f800/0xfeec3c2dc5a4d054 lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977600:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08ec00/0xfeec3c2dc5a4d05b lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977630:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08ec00/0xfeec3c2dc5a4d05b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977638:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08ec00/0xfeec3c2dc5a4d05b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977755:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f400/0xfeec3c2dc5a4d062 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977764:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f400/0xfeec3c2dc5a4d062 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x50:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977772:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f400/0xfeec3c2dc5a4d062 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x50:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191894.977815:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab5:0x50:0x0]: returning size 4096 00000004:00200000:3.0:1784191894.977819:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784191894.977843:0:158665:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f400/0xfeec3c2dc5a4d062 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x50:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977858:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f800/0xfeec3c2dc5a4d054 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977865:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f800/0xfeec3c2dc5a4d054 lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977872:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f800/0xfeec3c2dc5a4d054 lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977880:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f800/0xfeec3c2dc5a4d054 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977912:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d08f800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191894.977917:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f800/0xfeec3c2dc5a4d054 lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977925:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f800/0xfeec3c2dc5a4d054 lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977938:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:3.0:1784191894.977941:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.977948:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f800/0xfeec3c2dc5a4d054 lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977954:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f800/0xfeec3c2dc5a4d054 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977971:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08ec00/0xfeec3c2dc5a4d05b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977976:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08ec00/0xfeec3c2dc5a4d05b lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977981:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08ec00/0xfeec3c2dc5a4d05b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977986:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d08ec00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191894.977988:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08ec00/0xfeec3c2dc5a4d05b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.977995:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08ec00/0xfeec3c2dc5a4d05b lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.978012:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x43454b14 (ffff8af22de8bc00) 00010000:00010000:3.0:1784191894.978014:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.978017:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08ec00/0xfeec3c2dc5a4d05b lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.978022:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08ec00/0xfeec3c2dc5a4d05b lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.978549:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4d04d lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c397 expref: 212 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.978569:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f400/0xfeec3c2dc5a4d062 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x50:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c397 expref: 211 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.978577:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x50:0x0].0x0 (ffff8af22de8bb00) 00010000:00010000:3.0:1784191894.978579:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784191894.978582:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d08f400, rc 0) 00000100:00100000:3.0:1784191894.978837:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+211:123695:x1870858812462336:12345-192.168.204.16@tcp:101:createmany.0 Request processed in 1277us (2077us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191894.978848:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 759 00000100:00100000:2.0:1784191894.981638:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191894.981857:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812462592 00000100:00100000:3.0:1784191894.981869:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812462592 00000100:00100000:3.0:1784191894.981928:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 760 00000100:00100000:3.0:1784191894.981939:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+211:123695:x1870858812462592:12345-192.168.204.16@tcp:36:createmany.0 00010000:00010000:3.0:1784191894.982086:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d069 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.982144:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d069 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.982159:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d069 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.982176:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f000/0xfeec3c2dc5a4d070 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x50:0x0].0xbda0828b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.982183:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f000/0xfeec3c2dc5a4d070 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x50:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.982190:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f000/0xfeec3c2dc5a4d070 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x50:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:3.0:1784191894.982491:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 264, rollback = 2 00080000:00000400:3.0:1784191894.982507:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191894.982509:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:3.0:1784191894.982511:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.982513:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.982515:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191894.982547:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 264, rollback = 2 00080000:00000400:3.0:1784191894.982550:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:3.0:1784191894.982551:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:3.0:1784191894.982553:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191894.982555:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191894.982556:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191894.982627:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d069 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.982635:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d069 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.982649:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d069 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.982655:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d069 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.982661:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d08f600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191894.982676:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d069 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.982684:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d069 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.982734:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x50:0x0].0x0 (ffff8af22de8bb00) 00010000:00010000:3.0:1784191894.982736:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191894.982741:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d069 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.982747:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d069 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191894.982761:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007d47261a reply state 0000000023136c84 transno 34359738819 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f000/0xfeec3c2dc5a4d070 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x50:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.982772:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f000/0xfeec3c2dc5a4d070 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191894.982778:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x50:0x0].0xbda0828b (ffff8af20290ed00) 00010000:00010000:3.0:1784191894.982780:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191894.982782:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784191894.982870:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+213:123695:x1870858812462592:12345-192.168.204.16@tcp:36:createmany.0 Request processed in 930us (1241us total) trans 34359738819 rc 0/0 00000100:00100000:3.0:1784191894.982877:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 760 00000100:00100000:2.0:1784191894.987939:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191894.988380:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812462848 00000100:00100000:1.0:1784191894.988392:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812462848 00000100:00100000:1.0:1784191894.988479:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 761 00000100:00100000:1.0:1784191894.988490:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+213:123695:x1870858812462848:12345-192.168.204.16@tcp:36:createmany.0 00010000:00010000:1.0:1784191894.988649:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d077 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.988679:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d077 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.988718:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d077 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.988739:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d07e lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x50:0x0].0x1cda55a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.988747:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d07e lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.988754:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d07e lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:1.0:1784191894.989081:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 264, rollback = 2 00080000:00000400:1.0:1784191894.989086:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191894.989089:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:1.0:1784191894.989305:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.989322:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191894.989325:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191894.989364:0:164531:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 264, rollback = 2 00080000:00000400:1.0:1784191894.989367:0:164531:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191894.989369:0:164531:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:1.0:1784191894.989371:0:164531:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191894.989373:0:164531:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:1.0:1784191894.989375:0:164531:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191894.989460:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d077 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.989469:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d077 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.989475:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d077 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.989482:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d077 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.989489:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d7400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191894.989505:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d077 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.989514:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d077 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.989528:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x50:0x0].0x0 (ffff8af22de8bb00) 00010000:00010000:1.0:1784191894.989531:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191894.989536:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d077 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.989544:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d077 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191894.989570:0:164531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000926c29a7 reply state 000000002eb98b9e transno 34359738820 ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d07e lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.989582:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d07e lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191894.989589:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x50:0x0].0x1cda55a (ffff8af10fe58200) 00010000:00010000:1.0:1784191894.989592:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191894.989595:0:164531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784191894.989744:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+215:123695:x1870858812462848:12345-192.168.204.16@tcp:36:createmany.0 Request processed in 1253us (1815us total) trans 34359738820 rc 0/0 00000100:00100000:1.0:1784191894.989753:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 761 00000100:00100000:2.0:1784191894.996185:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191894.996788:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812463104 00000100:00100000:0.0:1784191894.996799:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812463104 00000100:00100000:0.0:1784191894.996922:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 762 00000100:00100000:0.0:1784191894.996933:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+215:123695:x1870858812463104:12345-192.168.204.16@tcp:36:createmany.0 00010000:00010000:0.0:1784191894.997076:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d085 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.997109:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d085 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.997124:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d085 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.997141:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d08c lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x50:0x0].0x45fac828 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.997148:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d08c lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.997155:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d08c lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:0.0:1784191894.997451:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 264, rollback = 2 00080000:00000400:0.0:1784191894.997455:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191894.997458:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:0.0:1784191894.997460:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191894.997462:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191894.997464:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191894.997505:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 264, rollback = 2 00080000:00000400:0.0:1784191894.997529:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191894.997531:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:0.0:1784191894.997533:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191894.997535:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191894.997537:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191894.997625:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d085 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.997633:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d085 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.997640:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d085 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.997647:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d085 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.997653:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10e24a200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191894.997658:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d085 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.997676:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d085 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.997718:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x50:0x0].0x0 (ffff8af22de8bb00) 00010000:00010000:0.0:1784191894.997721:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191894.997726:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d085 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.997733:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d085 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191894.997749:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061f20c0d reply state 00000000e09ef9e8 transno 34359738821 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d08c lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.997767:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d08c lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191894.997773:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x50:0x0].0x45fac828 (ffff8af22de8b300) 00010000:00010000:0.0:1784191894.997775:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191894.997778:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784191894.997880:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+217:123695:x1870858812463104:12345-192.168.204.16@tcp:36:createmany.0 Request processed in 946us (1704us total) trans 34359738821 rc 0/0 00000100:00100000:0.0:1784191894.997888:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 762 00000100:00100000:2.0:1784191895.014491:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191895.014609:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812463232 00000100:00100000:0.0:1784191895.014619:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812463232 00000100:00100000:0.0:1784191895.014978:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 763 00000100:00100000:0.0:1784191895.014992:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+217:123696:x1870858812463232:12345-192.168.204.16@tcp:101:createmany.0 00010000:00010000:0.0:1784191895.015022:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1784191895.015030:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784191895.015045:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d093 lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c39e expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.016839:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d09a lrc: 3/1,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.016865:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d09a lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.016877:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d09a lrc: 3/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.016887:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0a1 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.016914:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0a1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.016922:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0a1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.016990:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24b400/0xfeec3c2dc5a4d0a8 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.016999:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24b400/0xfeec3c2dc5a4d0a8 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x51:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.017006:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24b400/0xfeec3c2dc5a4d0a8 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x51:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784191895.017883:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab5:0x51:0x0]: returning size 4096 00000004:00200000:0.0:1784191895.017891:0:158666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784191895.017917:0:158666:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24b400/0xfeec3c2dc5a4d0a8 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x51:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.017933:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d09a lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.017939:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d09a lrc: 4/1,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.017945:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d09a lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.017952:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d09a lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.017970:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10e24a600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191895.017974:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d09a lrc: 4/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.017981:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d09a lrc: 5/0,0 mode: CR/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.017995:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:0.0:1784191895.017998:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191895.018003:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d09a lrc: 3/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.018008:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d09a lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.018030:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0a1 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.018035:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0a1 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.018040:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0a1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.018044:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10e24ba00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191895.018046:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0a1 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.018051:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0a1 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.018068:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x87726de2 (ffff8af204e31500) 00010000:00010000:0.0:1784191895.018071:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191895.018074:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0a1 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.018080:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0a1 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.018119:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d093 lrc: 0/0,0 mode: --/CR res: [0x200003ab5:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c39e expref: 219 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.018134:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24b400/0xfeec3c2dc5a4d0a8 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x51:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c39e expref: 218 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.018143:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x51:0x0].0x0 (ffff8af10fe58500) 00010000:00010000:0.0:1784191895.018145:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784191895.018148:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10e24b400, rc 0) 00000100:00100000:0.0:1784191895.018375:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+218:123696:x1870858812463232:12345-192.168.204.16@tcp:101:createmany.0 Request processed in 3385us (3959us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191895.018385:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 763 00000100:00100000:2.0:1784191895.024205:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191895.024381:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812463488 00000100:00100000:3.0:1784191895.024394:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812463488 00000100:00100000:3.0:1784191895.024469:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 764 00000100:00100000:3.0:1784191895.024480:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+218:123696:x1870858812463488:12345-192.168.204.16@tcp:36:createmany.0 00010000:00010000:3.0:1784191895.024630:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d0af lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191895.024646:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d0af lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191895.024659:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d0af lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191895.024744:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4d0b6 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x51:0x0].0xbda0828b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191895.024753:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4d0b6 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x51:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191895.024759:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4d0b6 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x51:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:3.0:1784191895.025061:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 264, rollback = 2 00080000:00000400:3.0:1784191895.025066:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191895.025068:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:3.0:1784191895.025071:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191895.025073:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191895.025075:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191895.025117:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 264, rollback = 2 00080000:00000400:3.0:1784191895.025120:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:3.0:1784191895.025122:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:3.0:1784191895.025124:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:3.0:1784191895.025126:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:3.0:1784191895.025128:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:3.0:1784191895.025229:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d0af lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191895.025240:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d0af lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191895.025246:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d0af lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191895.025253:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d0af lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191895.025260:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d08f600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191895.025265:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d0af lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191895.025274:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d0af lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191895.025288:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x51:0x0].0x0 (ffff8af10fe58500) 00010000:00010000:3.0:1784191895.025291:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191895.025296:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d0af lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191895.025303:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f600/0xfeec3c2dc5a4d0af lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784191895.025329:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009eaf6429 reply state 000000002a2a8e79 transno 34359738822 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4d0b6 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x51:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191895.025344:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4d0b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191895.025350:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x51:0x0].0xbda0828b (ffff8af1102d0a00) 00010000:00010000:3.0:1784191895.025352:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784191895.025355:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784191895.025447:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+220:123696:x1870858812463488:12345-192.168.204.16@tcp:36:createmany.0 Request processed in 966us (1264us total) trans 34359738822 rc 0/0 00000100:00100000:3.0:1784191895.025455:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 764 00000100:00100000:2.0:1784191895.030465:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191895.030583:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812463744 00000100:00100000:0.0:1784191895.030593:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812463744 00000100:00100000:0.0:1784191895.030657:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 765 00000100:00100000:0.0:1784191895.030678:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+220:123696:x1870858812463744:12345-192.168.204.16@tcp:36:createmany.0 00010000:00010000:0.0:1784191895.030852:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d0bd lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.030891:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d0bd lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.030905:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d0bd lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.030921:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0c4 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x51:0x0].0x1cda55a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.030928:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0c4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x51:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.030934:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0c4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x51:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:0.0:1784191895.031459:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 264, rollback = 2 00080000:00000400:0.0:1784191895.031465:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191895.031467:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:0.0:1784191895.031470:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191895.031471:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191895.031473:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191895.031514:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 264, rollback = 2 00080000:00000400:0.0:1784191895.031517:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191895.031519:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:0.0:1784191895.031521:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191895.031527:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191895.031529:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191895.031611:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d0bd lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.031621:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d0bd lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.031639:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d0bd lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.031646:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d0bd lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.031652:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10e24a200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191895.031659:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d0bd lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.031667:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d0bd lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.031682:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x51:0x0].0x0 (ffff8af10fe58500) 00010000:00010000:0.0:1784191895.031685:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191895.031811:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d0bd lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.031819:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a200/0xfeec3c2dc5a4d0bd lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191895.031835:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000562b6a41 reply state 00000000b36a81cb transno 34359738823 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0c4 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x51:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.031847:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.031855:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x51:0x0].0x1cda55a (ffff8af22de8b100) 00010000:00010000:0.0:1784191895.031857:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191895.031860:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784191895.032272:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+222:123696:x1870858812463744:12345-192.168.204.16@tcp:36:createmany.0 Request processed in 1601us (1815us total) trans 34359738823 rc 0/0 00000100:00100000:0.0:1784191895.032281:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 765 00000100:00100000:2.0:1784191895.037904:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191895.037977:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812464000 00000100:00100000:0.0:1784191895.037987:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812464000 00000100:00100000:0.0:1784191895.038050:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 766 00000100:00100000:0.0:1784191895.038060:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+222:123696:x1870858812464000:12345-192.168.204.16@tcp:36:createmany.0 00010000:00010000:0.0:1784191895.038207:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d0cb lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.038224:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d0cb lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.038249:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d0cb lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.038265:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ac00/0xfeec3c2dc5a4d0d2 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x51:0x0].0x45fac828 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.038272:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ac00/0xfeec3c2dc5a4d0d2 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x51:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.038278:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ac00/0xfeec3c2dc5a4d0d2 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x51:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:0.0:1784191895.038990:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 264, rollback = 2 00080000:00000400:0.0:1784191895.038997:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191895.039000:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:0.0:1784191895.039002:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191895.039004:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191895.039006:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191895.039061:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 260 < left 264, rollback = 2 00080000:00000400:0.0:1784191895.039063:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:0.0:1784191895.039065:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:0.0:1784191895.039067:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191895.039070:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/0, delete: 0/0/0 00080000:00000400:0.0:1784191895.039072:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:0.0:1784191895.039162:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d0cb lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.039171:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d0cb lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.039177:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d0cb lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.039183:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d0cb lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.039189:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10e24a600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191895.039194:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d0cb lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.039201:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d0cb lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.039216:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x51:0x0].0x0 (ffff8af10fe58500) 00010000:00010000:0.0:1784191895.039219:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191895.039224:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d0cb lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.039231:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24a600/0xfeec3c2dc5a4d0cb lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784191895.039260:0:158666:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d63363e reply state 000000009c9ebed7 transno 34359738824 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ac00/0xfeec3c2dc5a4d0d2 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x51:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.039273:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ac00/0xfeec3c2dc5a4d0d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191895.039279:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x51:0x0].0x45fac828 (ffff8af22de8b400) 00010000:00010000:0.0:1784191895.039282:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784191895.039284:0:158666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784191895.039382:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+224:123696:x1870858812464000:12345-192.168.204.16@tcp:36:createmany.0 Request processed in 1321us (1485us total) trans 34359738824 rc 0/0 00000100:00100000:0.0:1784191895.039391:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 766 00000100:00100000:2.0:1784191895.055335:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191895.055455:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812464256 00000100:00100000:1.0:1784191895.055470:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812464256 00000100:00100000:1.0:1784191895.055573:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 767 00000100:00100000:1.0:1784191895.055585:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+224:123697:x1870858812464256:12345-192.168.204.16@tcp:36:createmany.0 00010000:00010000:1.0:1784191895.055802:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0d9 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.055820:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0d9 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.055833:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0d9 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.055848:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4d0e0 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0xde5c5568 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.055881:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4d0e0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xde5c5568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.055888:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4d0e0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xde5c5568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:1.0:1784191895.056324:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 264, rollback = 2 00080000:00000400:1.0:1784191895.056329:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191895.056331:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:1.0:1784191895.056333:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191895.056335:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/1, delete: 0/0/0 00080000:00000400:1.0:1784191895.056337:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191895.056366:0:158667:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 264, rollback = 2 00080000:00000400:1.0:1784191895.056369:0:158667:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191895.056370:0:158667:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:1.0:1784191895.056373:0:158667:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191895.056375:0:158667:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/1, delete: 0/0/0 00080000:00000400:1.0:1784191895.056377:0:158667:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191895.056462:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4d0e7 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.056474:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4d0e7 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.056483:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4d0e7 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191895.056511:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026b654d6 reply state 00000000549b2c0a transno 34359738825 ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4d0e7 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.056523:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4d0e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.056540:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x5e:0x0].0x0 (ffff8af10fe58c00) 00010000:00010000:1.0:1784191895.056542:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191895.056546:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784191895.056552:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab5:0x5e:0x0]: returning size 4096 00010000:00010000:1.0:1784191895.056561:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0d9 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.056567:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0d9 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.056573:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0d9 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.056580:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0d9 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.056585:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d7400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191895.056589:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0d9 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.056597:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0d9 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.056608:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191895.056610:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191895.056613:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0d9 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.056618:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0d9 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191895.056632:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026b654d6 reply state 00000000549b2c0a transno 34359738825 ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4d0e0 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0xde5c5568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.056648:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4d0e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xde5c5568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.056655:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xde5c5568 (ffff8af10fe58d00) 00010000:00010000:1.0:1784191895.056657:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191895.056659:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1784191895.056804:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+226:123697:x1870858812464256:12345-192.168.204.16@tcp:36:createmany.0 Request processed in 1218us (1479us total) trans 34359738825 rc 0/0 00000100:00100000:1.0:1784191895.056812:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 767 00000100:00100000:2.0:1784191895.061055:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191895.061296:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812464512 00000100:00100000:1.0:1784191895.061310:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812464512 00000100:00100000:1.0:1784191895.061383:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 768 00000100:00100000:1.0:1784191895.061394:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+226:123697:x1870858812464512:12345-192.168.204.16@tcp:36:createmany.0 00010000:00010000:1.0:1784191895.061571:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0ee lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.061590:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0ee lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.061602:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0ee lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.061619:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6400/0xfeec3c2dc5a4d0f5 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x22897837 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.061626:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6400/0xfeec3c2dc5a4d0f5 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x22897837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.061632:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6400/0xfeec3c2dc5a4d0f5 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x22897837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:1.0:1784191895.062151:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 264, rollback = 2 00080000:00000400:1.0:1784191895.062157:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191895.062159:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:1.0:1784191895.062161:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191895.062164:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/1, delete: 0/0/0 00080000:00000400:1.0:1784191895.062166:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:1.0:1784191895.062199:0:161504:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 259 < left 264, rollback = 2 00080000:00000400:1.0:1784191895.062202:0:161504:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/0, destroy: 0/0/0 00080000:00000400:1.0:1784191895.062204:0:161504:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:1.0:1784191895.062207:0:161504:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:1.0:1784191895.062209:0:161504:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/1, delete: 0/0/0 00080000:00000400:1.0:1784191895.062211:0:161504:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00010000:00010000:1.0:1784191895.062292:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7c00/0xfeec3c2dc5a4d0fc lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.062304:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7c00/0xfeec3c2dc5a4d0fc lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.062313:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7c00/0xfeec3c2dc5a4d0fc lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191895.062330:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002baedd95 reply state 0000000019c728ff transno 34359738826 ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7c00/0xfeec3c2dc5a4d0fc lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.062341:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7c00/0xfeec3c2dc5a4d0fc lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.062349:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x5f:0x0].0x0 (ffff8af10fe58300) 00010000:00010000:1.0:1784191895.062351:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191895.062354:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784191895.062359:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab5:0x5f:0x0]: returning size 4096 00010000:00010000:1.0:1784191895.062377:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0ee lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.062384:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0ee lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.062390:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0ee lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.062396:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0ee lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.062402:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d7400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191895.062406:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0ee lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.062413:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0ee lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.062423:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:1.0:1784191895.062426:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191895.062429:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0ee lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.062436:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7400/0xfeec3c2dc5a4d0ee lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784191895.062449:0:161504:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002baedd95 reply state 0000000019c728ff transno 34359738826 ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6400/0xfeec3c2dc5a4d0f5 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x22897837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.062456:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6400/0xfeec3c2dc5a4d0f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x22897837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191895.062474:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x22897837 (ffff8af10fe58800) 00010000:00010000:1.0:1784191895.062477:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784191895.062479:0:161504:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1784191895.062593:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+228:123697:x1870858812464512:12345-192.168.204.16@tcp:36:createmany.0 Request processed in 1197us (1547us total) trans 34359738826 rc 0/0 00000100:00100000:1.0:1784191895.062602:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 768 00000100:00100000:0.0:1784191895.069291:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191895.069524:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812464768 00000100:00100000:3.0:1784191895.069642:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812464768 00000100:00100000:2.0:1784191895.070022:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 769 00000100:00100000:2.0:1784191895.070037:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+228:123697:x1870858812464768:12345-192.168.204.16@tcp:36:createmany.0 00010000:00010000:2.0:1784191895.070200:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4d103 lrc: 3/0,1 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191895.070218:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4d103 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191895.070231:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4d103 lrc: 3/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191895.070247:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d10a lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x1:0x0].0x66b69b05 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191895.070254:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d10a lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x66b69b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191895.070261:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d10a lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x66b69b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:2.0:1784191895.070872:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 258 < left 264, rollback = 2 00080000:00000400:2.0:1784191895.070877:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:2.0:1784191895.070879:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:2.0:1784191895.070880:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191895.070882:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/1, delete: 0/0/0 00080000:00000400:2.0:1784191895.070883:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191895.070907:0:158666:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 258 < left 264, rollback = 2 00080000:00000400:2.0:1784191895.070925:0:158666:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/1, destroy: 0/0/0 00080000:00000400:2.0:1784191895.070927:0:158666:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:2.0:1784191895.070928:0:158666:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:2.0:1784191895.070930:0:158666:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 4/65/1, delete: 0/0/0 00080000:00000400:2.0:1784191895.070931:0:158666:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 2/2/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191895.071008:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4d111 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191895.071017:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4d111 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191895.071022:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4d111 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191895.071034:0:158666:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d7cf785c reply state 000000008dcb8514 transno 34359738827 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4d111 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191895.071042:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4d111 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191895.071047:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x60:0x0].0x0 (ffff8af10994da00) 00010000:00010000:2.0:1784191895.071050:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191895.071053:0:158666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784191895.071056:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab5:0x60:0x0]: returning size 4096 00010000:00010000:2.0:1784191895.071064:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4d103 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191895.071070:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4d103 lrc: 4/0,1 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191895.071076:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4d103 lrc: 3/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191895.071082:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4d103 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191895.072214:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191895.072221:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4d103 lrc: 4/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191895.072230:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4d103 lrc: 5/0,0 mode: CW/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191895.072247:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x0 (ffff8af23d0d5d00) 00010000:00010000:2.0:1784191895.072250:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191895.072254:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4d103 lrc: 3/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191895.072261:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8000/0xfeec3c2dc5a4d103 lrc: 0/0,0 mode: --/CW res: [0x200003ab5:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191895.072281:0:158666:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d7cf785c reply state 000000008dcb8514 transno 34359738827 ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d10a lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x1:0x0].0x66b69b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191895.072293:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d10a lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x66b69b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191895.072300:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x66b69b05 (ffff8af10994d100) 00010000:00010000:2.0:1784191895.072302:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191895.072306:0:158666:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1784191895.072484:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+230:123697:x1870858812464768:12345-192.168.204.16@tcp:36:createmany.0 Request processed in 2447us (3200us total) trans 34359738827 rc 0/0 00000100:00100000:2.0:1784191895.072506:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 769 00010000:00010000:2.0:1784191895.640115:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191896.589525:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784191896.589556:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827978752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784191896.589632:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191896.589715:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827978752 00000100:00100000:1.0:1784191896.589723:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827978752 00000100:00100000:1.0:1784191896.589779:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1784191896.589790:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827978752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784191896.589825:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 679936 granted 26068928 pending 0 free 70639616 avail 63471616 00000100:00100000:1.0:1784191896.589875:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827978752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191896.589883:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:1.0:1784191896.589904:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784191896.589938:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827978752:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784191896.656168:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784191897.059195:0:166523:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866e6 len=0 uarg=00007ffea4d05d60 00000004:00000080:1.0:1784191897.059218:0:166523:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=c00866e6 len=608 karg=ffff8af20cf32c00 uarg=0000000000000000 00000004:00000080:1.0:1784191897.059278:0:166523:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb46d0cb4bd70 00100000:10000000:1.0:1784191897.059285:0:166523:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00100000:10000000:1.0:1784191897.061611:0:166523:0:(lfsck_namespace.c:4332:lfsck_namespace_reset()) lustre-MDT0000-osd: namespace LFSCK reset: rc = 0 00100000:10000000:3.0:1784191897.064738:0:166525:0:(scrub.c:294:scrub_thread_prep()) lustre-MDT0000: OI scrub prep, flags = 0x46 00100000:10000000:3.0:1784191897.064748:0:166525:0:(scrub.c:116:scrub_file_reset()) lustre-MDT0000: reset OI scrub file, old flags = 0x0, add flags = 0x0 00100000:10000000:3.0:1784191897.064808:0:166525:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1784191897.064899:0:166524:0:(lfsck_lib.c:2526:lfsck_start_assistant()) lustre-MDT0000-osd: start lfsck_namespace assistant thread 00100000:10000000:3.0:1784191897.065335:0:166524:0:(lfsck_namespace.c:4580:lfsck_namespace_prep()) lustre-MDT0000-osd: namespace LFSCK prep done, start pos [1, [0x0:0x0:0x0], 0x0]: rc = 0 00100000:10000000:0.0:1784191897.065382:0:166526:0:(lfsck_engine.c:1551:lfsck_assistant_engine()) lustre-MDT0000-osd: lfsck_namespace LFSCK assistant thread start 00100000:10000000:1.0:1784191897.065469:0:166525:0:(osd_scrub.c:1263:osd_scrub_main()) lustre-MDT0000: OI scrub start, flags = 0x46, pos = 12 00100000:10000000:3.0:1784191897.066794:0:166524:0:(lfsck_namespace.c:4478:lfsck_namespace_checkpoint()) lustre-MDT0000-osd: namespace LFSCK checkpoint at the pos [13, [0x0:0x0:0x0], 0x0], status = 1: rc = 0 00100000:10000000:3.0:1784191897.066805:0:166524:0:(lfsck_engine.c:1034:lfsck_master_engine()) lustre-MDT0000-osd entry: oit_flags = 0x60000, dir_flags = 0x8006, oit_cookie = 13, dir_cookie = 0x0, parent = [0x0:0x0:0x0], pid = 166524 00100000:02000000:3.0:1784191897.066884:0:166524:0:(lfsck_engine.c:823:lfsck_master_oit_engine()) *** cfs_fail_loc=1600, val=3*** 00010000:00010000:3.0:1784191897.676528:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191897.949779:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191897.949846:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191897.949864:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191897.960449:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191897.966682:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191897.970578:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812465152 00000100:00100000:2.0:1784191897.970597:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812465152 00002000:00100000:2.0:1784191897.970732:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1c6:0x0] (0->15475) req@ffff8af20cf26680 x1870858812465152/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 15968/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.970743:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20cf26680 with x1870858812465152 ext(0->15475) 00002000:00010000:2.0:1784191897.970750:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af20cf26680 00000100:00100000:2.0:1784191897.970781:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812464896 00000100:00100000:2.0:1784191897.970785:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812464896 00002000:00100000:2.0:1784191897.970809:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1c5:0x0] (0->38516) req@ffff8af20cf26d80 x1870858812464896/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 488/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.970818:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20cf26d80 with x1870858812464896 ext(0->38516) 00002000:00010000:2.0:1784191897.970822:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af20cf26d80 00000100:00100000:2.0:1784191897.970831:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812465280 00000100:00100000:2.0:1784191897.970834:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812465280 00002000:00100000:2.0:1784191897.970851:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x24a:0x0] (0->673) req@ffff8af20cf26a00 x1870858812465280/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 1168/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.970859:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20cf26a00 with x1870858812465280 ext(0->673) 00002000:00010000:2.0:1784191897.970862:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af20cf26a00 00000100:00100000:2.0:1784191897.970869:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812465024 00000100:00100000:2.0:1784191897.970872:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812465024 00002000:00100000:2.0:1784191897.970905:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x249:0x0] (0->39342) req@ffff8af233155500 x1870858812465024/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 488/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.970913:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233155500 with x1870858812465024 ext(0->39342) 00002000:00010000:2.0:1784191897.970917:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af233155500 00000100:00100000:2.0:1784191897.970931:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7 00000100:00100000:2.0:1784191897.970940:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:69109:x1870858812465152:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:2.0:1784191897.971214:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:2.0:1784191897.971225:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191897.971227:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:2.0:1784191897.971228:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191897.971230:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191897.971232:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:3.0:1784191897.973477:0:166438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8 00000100:00100000:3.0:1784191897.973512:0:166438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:69112:x1870858812464896:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:0.0:1784191897.974893:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191897.974914:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191897.974944:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191897.975144:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191897.975162:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191897.975178:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191897.975191:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191897.975221:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191897.975247:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191897.975263:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191897.975301:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191897.975328:0:160171:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1784191897.975337:0:160171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1784191897.975886:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+47:69109:x1870858812465152:12345-192.168.204.16@tcp:4:cp.0 Request processed in 4942us (26117us total) trans 17179869242 rc 0/0 00000100:00100000:2.0:1784191897.975899:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7 00002000:00100000:2.0:1784191897.975914:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1c6:0x0] (0->15475) req@ffff8af20cf26680 x1870858812465152/t17179869242(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 15968/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.975924:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20cf26680 with x1870858812465152 ext(0->15475) 00002000:00010000:2.0:1784191897.975931:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af20cf26680 00000100:00100000:2.0:1784191897.975956:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812466304 00000100:00100000:2.0:1784191897.975963:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812466304 00002000:00100000:2.0:1784191897.975998:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x24e:0x0] (0->1612) req@ffff8af233154700 x1870858812466304/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 2104/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.976007:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233154700 with x1870858812466304 ext(0->1612) 00002000:00010000:2.0:1784191897.976012:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af233154700 00000100:00100000:2.0:1784191897.976025:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812465408 00000100:00100000:2.0:1784191897.976027:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812465408 00002000:00100000:2.0:1784191897.976042:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1c7:0x0] (0->9197) req@ffff8af233157b80 x1870858812465408/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 9688/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.976050:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233157b80 with x1870858812465408 ext(0->9197) 00002000:00010000:2.0:1784191897.976053:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233157b80 00000100:00100000:2.0:1784191897.976061:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812465920 00000100:00100000:2.0:1784191897.976064:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812465920 00002000:00100000:2.0:1784191897.976077:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1c9:0x0] (0->703) req@ffff8af233157100 x1870858812465920/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 1192/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.976093:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233157100 with x1870858812465920 ext(0->703) 00002000:00010000:2.0:1784191897.976097:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233157100 00000100:00100000:2.0:1784191897.976106:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812466432 00000100:00100000:2.0:1784191897.976109:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812466432 00002000:00100000:2.0:1784191897.976124:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1cb:0x0] (0->16000) req@ffff8af233156a00 x1870858812466432/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 16496/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.976132:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233156a00 with x1870858812466432 ext(0->16000) 00002000:00010000:2.0:1784191897.976135:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233156a00 00000100:00100000:2.0:1784191897.976143:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812466944 00000100:00100000:2.0:1784191897.976145:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812466944 00002000:00100000:2.0:1784191897.976158:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1cd:0x0] (0->4217) req@ffff8af233155c00 x1870858812466944/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 4712/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.976165:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233155c00 with x1870858812466944 ext(0->4217) 00002000:00010000:2.0:1784191897.976167:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233155c00 00000100:00100000:2.0:1784191897.976174:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812465664 00000100:00100000:2.0:1784191897.976176:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812465664 00002000:00100000:2.0:1784191897.976188:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1c8:0x0] (0->4206) req@ffff8af233156680 x1870858812465664/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 4696/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.976194:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233156680 with x1870858812465664 ext(0->4206) 00002000:00010000:2.0:1784191897.976198:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233156680 00000100:00100000:2.0:1784191897.976204:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812466176 00000100:00100000:2.0:1784191897.976206:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812466176 00002000:00100000:2.0:1784191897.976217:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1ca:0x0] (0->4914) req@ffff8af233154a80 x1870858812466176/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 5408/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.976223:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233154a80 with x1870858812466176 ext(0->4914) 00002000:00010000:2.0:1784191897.976232:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233154a80 00000100:00100000:2.0:1784191897.976242:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812466688 00000100:00100000:2.0:1784191897.976245:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812466688 00002000:00100000:2.0:1784191897.976259:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1cc:0x0] (0->2857) req@ffff8af233156300 x1870858812466688/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 3352/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.976266:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233156300 with x1870858812466688 ext(0->2857) 00002000:00010000:2.0:1784191897.976269:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233156300 00000100:00100000:2.0:1784191897.976276:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812465536 00000100:00100000:2.0:1784191897.976279:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812465536 00002000:00100000:2.0:1784191897.976293:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x24b:0x0] (0->2658) req@ffff8af233157800 x1870858812465536/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 3152/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.976301:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233157800 with x1870858812465536 ext(0->2658) 00002000:00010000:2.0:1784191897.976304:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af233157800 00000100:00100000:2.0:1784191897.976311:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812466048 00000100:00100000:2.0:1784191897.976314:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812466048 00000100:00100000:3.0:1784191897.978233:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1784191897.978285:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x24d:0x0] (0->1753) req@ffff8af233155f80 x1870858812466048/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 2248/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.978299:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233155f80 with x1870858812466048 ext(0->1753) 00002000:00010000:2.0:1784191897.978304:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af233155f80 00000100:00100000:2.0:1784191897.978462:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812466560 00000100:00100000:2.0:1784191897.978470:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812466560 00002000:00100000:2.0:1784191897.978489:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x24f:0x0] (0->837) req@ffff8af233155880 x1870858812466560/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 1328/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.978497:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233155880 with x1870858812466560 ext(0->837) 00002000:00010000:2.0:1784191897.978501:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af233155880 00000100:00100000:2.0:1784191897.978510:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812467072 00000100:00100000:2.0:1784191897.978523:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812467072 00002000:00100000:2.0:1784191897.978539:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x251:0x0] (0->3005) req@ffff8af233154380 x1870858812467072/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 3496/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.978547:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233154380 with x1870858812467072 ext(0->3005) 00002000:00010000:2.0:1784191897.978550:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af233154380 00000100:00100000:2.0:1784191897.978558:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812465792 00000100:00100000:2.0:1784191897.978561:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812465792 00002000:00100000:2.0:1784191897.978575:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x24c:0x0] (0->28244) req@ffff8af106b86a00 x1870858812465792/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 488/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.978582:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af106b86a00 with x1870858812465792 ext(0->28244) 00002000:00010000:2.0:1784191897.978586:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af106b86a00 00000100:00100000:2.0:1784191897.978597:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9 00000100:00100000:2.0:1784191897.978607:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+51:69111:x1870858812465280:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:3.0:1784191897.978787:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00080000:00000400:2.0:1784191897.978872:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:2.0:1784191897.978877:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191897.978880:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:2.0:1784191897.978882:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191897.978885:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191897.978887:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191897.981034:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+53:69111:x1870858812465280:12345-192.168.204.16@tcp:4:cp.0 Request processed in 2416us (31156us total) trans 21474836552 rc 0/0 00000100:00100000:2.0:1784191897.981052:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9 00002000:00100000:2.0:1784191897.981066:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x24a:0x0] (0->673) req@ffff8af20cf26a00 x1870858812465280/t21474836552(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 1168/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.981075:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20cf26a00 with x1870858812465280 ext(0->673) 00002000:00010000:2.0:1784191897.981084:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af20cf26a00 00000100:00100000:2.0:1784191897.981137:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812466816 00000100:00100000:2.0:1784191897.981144:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812466816 00002000:00100000:2.0:1784191897.981180:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x250:0x0] (0->18268) req@ffff8af111a8e300 x1870858812466816/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 488/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.981188:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111a8e300 with x1870858812466816 ext(0->18268) 00002000:00010000:2.0:1784191897.981192:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111a8e300 00000100:00100000:2.0:1784191897.981209:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 10 00000100:00100000:2.0:1784191897.981218:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+53:69109:x1870858812465024:12345-192.168.204.16@tcp:4:cp.0 00000100:00080000:2.0:1784191897.981460:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784191897.981468:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784191897.983048:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191897.987209:0:160169:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1784191897.987226:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812467200 00000100:00100000:1.0:1784191897.987238:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812467200 00002000:00100000:1.0:1784191897.987296:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1d3:0x0] (0->7184) req@ffff8af233155180 x1870858812467200/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 7680/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191897.987308:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233155180 with x1870858812467200 ext(0->7184) 00002000:00010000:1.0:1784191897.987314:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233155180 00000100:00100000:3.0:1784191897.987743:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00080000:00000400:3.0:1784191897.987983:0:166438:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:3.0:1784191897.987987:0:166438:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:3.0:1784191897.987990:0:166438:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:3.0:1784191897.987992:0:166438:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:3.0:1784191897.987994:0:166438:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:3.0:1784191897.987995:0:166438:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191897.991855:0:166438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+55:69112:x1870858812464896:12345-192.168.204.16@tcp:4:cp.0 Request processed in 18350us (41996us total) trans 17179869243 rc 0/0 00000100:00100000:2.0:1784191897.991868:0:166438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8 00002000:00100000:2.0:1784191897.991883:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1c5:0x0] (0->38516) req@ffff8af20cf26d80 x1870858812464896/t17179869243(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 488/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.991893:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20cf26d80 with x1870858812464896 ext(0->38516) 00002000:00010000:2.0:1784191897.991899:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af20cf26d80 00000100:00100000:2.0:1784191897.991924:0:166438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812467328 00000100:00100000:2.0:1784191897.991932:0:166438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812467328 00002000:00100000:2.0:1784191897.991970:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x254:0x0] (0->268) req@ffff8af111a8d880 x1870858812467328/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 760/0 e 0 to 0 dl 1784191908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.991978:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111a8d880 with x1870858812467328 ext(0->268) 00002000:00010000:2.0:1784191897.991982:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111a8d880 00000100:00100000:2.0:1784191897.992000:0:166438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 11 00000100:00100000:2.0:1784191897.992008:0:166438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+55:69111:x1870858812466304:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:2.0:1784191897.992245:0:166438:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:2.0:1784191897.992249:0:166438:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191897.992251:0:166438:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:2.0:1784191897.992254:0:166438:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191897.992256:0:166438:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191897.992257:0:166438:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191897.993285:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:2.0:1784191897.993292:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191897.993294:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:2.0:1784191897.993296:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191897.993298:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191897.993300:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191897.997960:0:166438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+59:69111:x1870858812466304:12345-192.168.204.16@tcp:4:cp.0 Request processed in 5935us (31277us total) trans 21474836553 rc 0/0 00000100:00100000:2.0:1784191897.997980:0:166438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 11 00002000:00100000:2.0:1784191897.997996:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x24e:0x0] (0->1612) req@ffff8af233154700 x1870858812466304/t21474836553(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 2104/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.998007:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233154700 with x1870858812466304 ext(0->1612) 00002000:00010000:2.0:1784191897.998014:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af233154700 00000100:00100000:2.0:1784191897.998054:0:166438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 12 00000100:00100000:2.0:1784191897.998069:0:166438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+54:69111:x1870858812465408:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:2.0:1784191897.998302:0:166438:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:2.0:1784191897.998307:0:166438:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191897.998309:0:166438:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:2.0:1784191897.998311:0:166438:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191897.998314:0:166438:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191897.998334:0:166438:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191897.998648:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+57:69109:x1870858812465024:12345-192.168.204.16@tcp:4:cp.0 Request processed in 17430us (38220us total) trans 21474836554 rc 0/0 00000100:00100000:2.0:1784191897.998656:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 10 00002000:00100000:2.0:1784191897.998663:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x249:0x0] (0->39342) req@ffff8af233155500 x1870858812465024/t21474836554(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 488/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191897.998673:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233155500 with x1870858812465024 ext(0->39342) 00002000:00010000:2.0:1784191897.998677:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af233155500 00000100:00100000:2.0:1784191897.998713:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13 00000100:00100000:2.0:1784191897.998723:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+56:69111:x1870858812465920:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:2.0:1784191897.998810:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:2.0:1784191897.998814:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191897.998816:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:2.0:1784191897.998818:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191897.998820:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191897.998822:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191897.999998:0:166572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14 00000100:00100000:0.0:1784191898.000012:0:166572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+58:69111:x1870858812466432:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:0.0:1784191898.000226:0:166572:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191898.000231:0:166572:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191898.000233:0:166572:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191898.000235:0:166572:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191898.000237:0:166572:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191898.000239:0:166572:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191898.001791:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+60:69111:x1870858812465920:12345-192.168.204.16@tcp:4:cp.0 Request processed in 3060us (26866us total) trans 17179869245 rc 0/0 00000100:00100000:0.0:1784191898.001805:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13 00002000:00100000:0.0:1784191898.001817:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1c9:0x0] (0->703) req@ffff8af233157100 x1870858812465920/t17179869245(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 1192/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191898.001827:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233157100 with x1870858812465920 ext(0->703) 00002000:00010000:0.0:1784191898.001833:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233157100 00000100:00100000:0.0:1784191898.001872:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15 00000100:00100000:0.0:1784191898.001886:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+59:69111:x1870858812466944:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:0.0:1784191898.002082:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191898.002086:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191898.002094:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191898.002096:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191898.002098:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191898.002101:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191898.002594:0:166572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+61:69111:x1870858812466432:12345-192.168.204.16@tcp:4:cp.0 Request processed in 2583us (27645us total) trans 17179869246 rc 0/0 00000100:00100000:2.0:1784191898.002604:0:166572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14 00002000:00100000:2.0:1784191898.002611:0:166572:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1cb:0x0] (0->16000) req@ffff8af233156a00 x1870858812466432/t17179869246(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 16496/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191898.002621:0:166572:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233156a00 with x1870858812466432 ext(0->16000) 00002000:00010000:2.0:1784191898.002625:0:166572:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233156a00 00000100:00100000:2.0:1784191898.002644:0:166572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16 00000100:00100000:2.0:1784191898.002653:0:166572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+60:69110:x1870858812465664:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:2.0:1784191898.002771:0:166572:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:2.0:1784191898.002780:0:166572:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191898.002782:0:166572:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:2.0:1784191898.002784:0:166572:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191898.002786:0:166572:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191898.002788:0:166572:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191898.004621:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+62:69111:x1870858812466944:12345-192.168.204.16@tcp:4:cp.0 Request processed in 2729us (29466us total) trans 17179869247 rc 0/0 00000100:00100000:0.0:1784191898.004635:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15 00002000:00100000:0.0:1784191898.004646:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1cd:0x0] (0->4217) req@ffff8af233155c00 x1870858812466944/t17179869247(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 4712/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191898.004656:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233155c00 with x1870858812466944 ext(0->4217) 00002000:00010000:0.0:1784191898.004665:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233155c00 00000100:00100000:0.0:1784191898.004719:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17 00000100:00100000:0.0:1784191898.004731:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+61:69110:x1870858812466176:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:0.0:1784191898.004952:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191898.004957:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191898.004959:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191898.004961:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191898.004964:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191898.004966:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191898.005454:0:166572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+63:69110:x1870858812465664:12345-192.168.204.16@tcp:4:cp.0 Request processed in 2800us (30288us total) trans 17179869248 rc 0/0 00000100:00100000:0.0:1784191898.005463:0:166572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16 00002000:00100000:0.0:1784191898.005471:0:166572:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1c8:0x0] (0->4206) req@ffff8af233156680 x1870858812465664/t17179869248(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 4696/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191898.005479:0:166572:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233156680 with x1870858812465664 ext(0->4206) 00002000:00010000:0.0:1784191898.005486:0:166572:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233156680 00000100:00100000:0.0:1784191898.005504:0:166572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18 00000100:00100000:0.0:1784191898.005521:0:166572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+62:69110:x1870858812466688:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:0.0:1784191898.005614:0:166572:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191898.005618:0:166572:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191898.005620:0:166572:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191898.005621:0:166572:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191898.005623:0:166572:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191898.005625:0:166572:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:3.0:1784191898.006024:0:166438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+64:69111:x1870858812465408:12345-192.168.204.16@tcp:4:cp.0 Request processed in 7959us (31139us total) trans 17179869244 rc 0/0 00000100:00100000:3.0:1784191898.006032:0:166438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 12 00002000:00100000:3.0:1784191898.006038:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1c7:0x0] (0->9197) req@ffff8af233157b80 x1870858812465408/t17179869244(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 9688/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191898.006046:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233157b80 with x1870858812465408 ext(0->9197) 00002000:00010000:3.0:1784191898.006051:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233157b80 00000100:00100000:3.0:1784191898.006068:0:166438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19 00000100:00100000:3.0:1784191898.006075:0:166438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+56:69110:x1870858812465536:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:3.0:1784191898.006173:0:166438:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:3.0:1784191898.006176:0:166438:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:3.0:1784191898.006178:0:166438:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:3.0:1784191898.006180:0:166438:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:3.0:1784191898.006182:0:166438:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:3.0:1784191898.006184:0:166438:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191898.006539:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+63:69110:x1870858812466176:12345-192.168.204.16@tcp:4:cp.0 Request processed in 1809us (31357us total) trans 17179869249 rc 0/0 00000100:00100000:2.0:1784191898.006547:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17 00002000:00100000:2.0:1784191898.006553:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1ca:0x0] (0->4914) req@ffff8af233154a80 x1870858812466176/t17179869249(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 5408/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191898.006561:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233154a80 with x1870858812466176 ext(0->4914) 00002000:00010000:2.0:1784191898.006565:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233154a80 00000100:00100000:2.0:1784191898.006580:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20 00000100:00100000:2.0:1784191898.006588:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+58:69110:x1870858812466048:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:2.0:1784191898.006678:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:2.0:1784191898.006681:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191898.006683:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:2.0:1784191898.006686:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191898.006704:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191898.006706:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191898.006912:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191898.009263:0:166438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+60:69110:x1870858812465536:12345-192.168.204.16@tcp:4:cp.0 Request processed in 3176us (34029us total) trans 21474836555 rc 0/0 00000100:00100000:3.0:1784191898.009280:0:166438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19 00002000:00100000:3.0:1784191898.009293:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x24b:0x0] (0->2658) req@ffff8af233157800 x1870858812465536/t21474836555(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 3152/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191898.009327:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233157800 with x1870858812465536 ext(0->2658) 00002000:00010000:3.0:1784191898.009334:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af233157800 00000100:00100000:0.0:1784191898.009349:0:166572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+62:69110:x1870858812466688:12345-192.168.204.16@tcp:4:cp.0 Request processed in 3829us (34155us total) trans 17179869250 rc 0/0 00000100:00100000:0.0:1784191898.009357:0:166572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18 00002000:00100000:0.0:1784191898.009363:0:166572:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1cc:0x0] (0->2857) req@ffff8af233156300 x1870858812466688/t17179869250(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 3352/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191898.009371:0:166572:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233156300 with x1870858812466688 ext(0->2857) 00002000:00010000:0.0:1784191898.009375:0:166572:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233156300 00000100:00100000:0.0:1784191898.009389:0:166572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812467456 00000100:00100000:0.0:1784191898.009397:0:166572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812467456 00000100:00100000:3.0:1784191898.009429:0:166438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21 00002000:00100000:0.0:1784191898.009431:0:166572:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1d4:0x0] (0->1789) req@ffff8af233154000 x1870858812467456/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 2280/0 e 0 to 0 dl 1784191909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784191898.009449:0:166438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+59:69110:x1870858812466560:12345-192.168.204.16@tcp:4:cp.0 00002000:00100000:0.0:1784191898.009450:0:166572:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233154000 with x1870858812467456 ext(0->1789) 00002000:00010000:0.0:1784191898.009454:0:166572:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233154000 00000100:00100000:0.0:1784191898.009479:0:166572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 22 00000100:00100000:0.0:1784191898.009486:0:166572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+59:69110:x1870858812467072:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:0.0:1784191898.009673:0:166572:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191898.009678:0:166572:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191898.009681:0:166572:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191898.009713:0:166572:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191898.009716:0:166572:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191898.009718:0:166572:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191898.010254:0:166438:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:3.0:1784191898.010259:0:166438:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:3.0:1784191898.010261:0:166438:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:3.0:1784191898.010264:0:166438:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:3.0:1784191898.010266:0:166438:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:3.0:1784191898.010268:0:166438:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191898.010526:0:166572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+63:69110:x1870858812467072:12345-192.168.204.16@tcp:4:cp.0 Request processed in 1036us (35220us total) trans 21474836557 rc 0/0 00000100:00100000:0.0:1784191898.010534:0:166572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 22 00002000:00100000:0.0:1784191898.010542:0:166572:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x251:0x0] (0->3005) req@ffff8af233154380 x1870858812467072/t21474836557(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 3496/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191898.010550:0:166572:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233154380 with x1870858812467072 ext(0->3005) 00002000:00010000:0.0:1784191898.010555:0:166572:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af233154380 00000100:00100000:0.0:1784191898.010576:0:166572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 23 00000100:00100000:0.0:1784191898.010584:0:166572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+62:69111:x1870858812465792:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:3.0:1784191898.010869:0:166438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+63:69110:x1870858812466560:12345-192.168.204.16@tcp:4:cp.0 Request processed in 1430us (35603us total) trans 21474836558 rc 0/0 00000100:00100000:3.0:1784191898.010876:0:166438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21 00002000:00100000:3.0:1784191898.010882:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x24f:0x0] (0->837) req@ffff8af233155880 x1870858812466560/t21474836558(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 1328/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191898.010891:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233155880 with x1870858812466560 ext(0->837) 00002000:00010000:3.0:1784191898.010894:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af233155880 00000100:00100000:3.0:1784191898.010908:0:166438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 24 00000100:00100000:3.0:1784191898.010915:0:166438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+62:69111:x1870858812466816:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:2.0:1784191898.013837:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+63:69110:x1870858812466048:12345-192.168.204.16@tcp:4:cp.0 Request processed in 7236us (38586us total) trans 21474836556 rc 0/0 00000100:00100000:2.0:1784191898.013853:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20 00002000:00100000:2.0:1784191898.013869:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x24d:0x0] (0->1753) req@ffff8af233155f80 x1870858812466048/t21474836556(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 2248/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191898.013880:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233155f80 with x1870858812466048 ext(0->1753) 00002000:00010000:2.0:1784191898.013888:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af233155f80 00000100:00100000:2.0:1784191898.013931:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 25 00000100:00100000:2.0:1784191898.013944:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+62:69109:x1870858812467200:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:2.0:1784191898.014200:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:2.0:1784191898.014204:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191898.014207:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:2.0:1784191898.014209:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191898.014211:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191898.014212:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191898.015151:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+64:69109:x1870858812467200:12345-192.168.204.16@tcp:4:cp.0 Request processed in 1205us (32106us total) trans 17179869251 rc 0/0 00000100:00100000:2.0:1784191898.015162:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 25 00002000:00100000:2.0:1784191898.015171:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1d3:0x0] (0->7184) req@ffff8af233155180 x1870858812467200/t17179869251(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 7680/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191898.015181:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233155180 with x1870858812467200 ext(0->7184) 00002000:00010000:2.0:1784191898.015187:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233155180 00000100:00100000:2.0:1784191898.015215:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 26 00000100:00100000:2.0:1784191898.015225:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+62:69111:x1870858812467328:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:2.0:1784191898.017624:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:2.0:1784191898.017635:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191898.017638:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:2.0:1784191898.017641:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191898.017643:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191898.017645:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191898.022066:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+64:69111:x1870858812467328:12345-192.168.204.16@tcp:4:cp.0 Request processed in 6830us (34311us total) trans 21474836559 rc 0/0 00000100:00100000:2.0:1784191898.022083:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 26 00002000:00100000:2.0:1784191898.022112:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x254:0x0] (0->268) req@ffff8af111a8d880 x1870858812467328/t21474836559(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 760/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191898.022122:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111a8d880 with x1870858812467328 ext(0->268) 00002000:00010000:2.0:1784191898.022127:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111a8d880 00000100:00100000:2.0:1784191898.022162:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 27 00000100:00100000:2.0:1784191898.022175:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+63:69112:x1870858812467456:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:3.0:1784191898.022279:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191898.022333:0:160171:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1784191898.022344:0:160171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:3.0:1784191898.022367:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191898.022392:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191898.022406:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191898.022451:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191898.022490:0:160169:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1784191898.022496:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812467840 00000100:00100000:3.0:1784191898.022504:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812467840 00002000:00100000:3.0:1784191898.022536:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1d6:0x0] (0->111012) req@ffff8af20d789500 x1870858812467840/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1784191909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191898.022544:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20d789500 with x1870858812467840 ext(0->111012) 00002000:00010000:3.0:1784191898.022547:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af20d789500 00080000:00000400:2.0:1784191898.022557:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00000100:00100000:3.0:1784191898.022558:0:160169:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00080000:00000400:2.0:1784191898.022561:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00000100:00100000:3.0:1784191898.022562:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812467968 00080000:00000400:2.0:1784191898.022563:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00000100:00100000:3.0:1784191898.022564:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812467968 00080000:00000400:2.0:1784191898.022566:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191898.022569:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191898.022572:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00002000:00100000:3.0:1784191898.022575:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1d2:0x0] (0->3078) req@ffff8af20d78b100 x1870858812467968/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 3568/0 e 0 to 0 dl 1784191909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191898.022581:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20d78b100 with x1870858812467968 ext(0->3078) 00002000:00010000:3.0:1784191898.022584:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af20d78b100 00000100:00100000:3.0:1784191898.022590:0:160169:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1784191898.022595:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812468480 00000100:00100000:3.0:1784191898.022597:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812468480 00002000:00100000:3.0:1784191898.022618:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1cf:0x0] (0->55539) req@ffff8af20d78b480 x1870858812468480/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1784191909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191898.022626:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20d78b480 with x1870858812468480 ext(0->55539) 00002000:00010000:3.0:1784191898.022629:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af20d78b480 00000100:00100000:3.0:1784191898.022636:0:160169:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1784191898.022641:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812467584 00000100:00100000:3.0:1784191898.022644:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812467584 00002000:00100000:3.0:1784191898.022656:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1d5:0x0] (0->6429) req@ffff8af20d78a300 x1870858812467584/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 6920/0 e 0 to 0 dl 1784191909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191898.022663:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20d78a300 with x1870858812467584 ext(0->6429) 00002000:00010000:3.0:1784191898.022672:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af20d78a300 00000100:00100000:3.0:1784191898.022680:0:160169:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1784191898.022683:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812468096 00000100:00100000:3.0:1784191898.022686:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812468096 00002000:00100000:3.0:1784191898.022718:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x253:0x0] (0->6812) req@ffff8af10fb63100 x1870858812468096/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 7304/0 e 0 to 0 dl 1784191909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191898.022725:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10fb63100 with x1870858812468096 ext(0->6812) 00002000:00010000:3.0:1784191898.022728:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10fb63100 00000100:00100000:2.0:1784191898.024510:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+69:69112:x1870858812467456:12345-192.168.204.16@tcp:4:cp.0 Request processed in 2330us (17589us total) trans 17179869252 rc 0/0 00000100:00100000:2.0:1784191898.024524:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 27 00002000:00100000:2.0:1784191898.024536:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1d4:0x0] (0->1789) req@ffff8af233154000 x1870858812467456/t17179869252(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 2280/448 e 0 to 0 dl 1784191909 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191898.024549:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233154000 with x1870858812467456 ext(0->1789) 00002000:00010000:2.0:1784191898.024557:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233154000 00000100:00100000:2.0:1784191898.024594:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 28 00000100:00100000:2.0:1784191898.024606:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+68:69111:x1870858812467840:12345-192.168.204.16@tcp:4:cp.0 00000020:00000080:1.0:1784191898.046184:0:166575:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866e7 len=0 uarg=00007fff0ab33350 00000004:00000080:1.0:1784191898.046210:0:166575:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=400866e7 len=608 karg=ffff8af20cf32400 uarg=0000000000000000 00000004:00000080:1.0:1784191898.046280:0:166575:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb46d0cb53d70 00100000:10000000:2.0:1784191898.046508:0:166526:0:(lfsck_engine.c:1760:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant sync before exit 00000004:00080000:2.0:1784191898.046533:0:166526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 5518225843291ns, next at 5461450533856ns, rc = 0 00080000:00080000:2.0:1784191898.046566:0:166526:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1784191898.046591:0:166526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 5518225901303ns, next at 5416918483924ns, rc = 0 00080000:00080000:2.0:1784191898.046597:0:166526:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1784191898.048115:0:158645:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 26 committed 00000004:00080000:1.0:1784191898.048140:0:158645:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 28 committed 00000001:00080000:1.0:1784191898.048186:0:158645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738827 is committed 00010000:00010000:2.0:1784191898.048532:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be800/0xfeec3c2dc5a4c3c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048545:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be800/0xfeec3c2dc5a4c3c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048556:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be800/0xfeec3c2dc5a4c3c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048562:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010be800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.048566:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be800/0xfeec3c2dc5a4c3c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048574:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be800/0xfeec3c2dc5a4c3c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048595:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xff118af2 (ffff8af214e83d00) 00010000:00010000:2.0:1784191898.048599:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.048603:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be800/0xfeec3c2dc5a4c3c0 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048610:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be800/0xfeec3c2dc5a4c3c0 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048642:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c41b lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048649:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c41b lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048671:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c41b lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048676:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cc800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.048678:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c41b lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048685:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c41b lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048712:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xb2d5a33e (ffff8af216636000) 00010000:00010000:2.0:1784191898.048714:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.048718:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c41b lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048723:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc800/0xfeec3c2dc5a4c41b lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048739:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68400/0xfeec3c2dc5a4c476 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048745:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68400/0xfeec3c2dc5a4c476 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048750:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68400/0xfeec3c2dc5a4c476 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048755:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.048758:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68400/0xfeec3c2dc5a4c476 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048775:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68400/0xfeec3c2dc5a4c476 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048784:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x4958ff4 (ffff8af215ff6100) 00010000:00010000:2.0:1784191898.048786:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.048789:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68400/0xfeec3c2dc5a4c476 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048795:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68400/0xfeec3c2dc5a4c476 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048814:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048820:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048825:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048830:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd69e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.048833:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048839:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048846:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x57ba1cca (ffff8af215ff6000) 00010000:00010000:2.0:1784191898.048848:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.048851:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4d1 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048863:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69e00/0xfeec3c2dc5a4c4d1 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048879:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c52c lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048885:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c52c lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048890:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c52c lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048895:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010bea00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.048898:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c52c lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048903:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c52c lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048911:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x407c6222 (ffff8af216687300) 00010000:00010000:2.0:1784191898.048913:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.048916:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c52c lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048921:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bea00/0xfeec3c2dc5a4c52c lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048933:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c587 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048939:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c587 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048950:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c587 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048956:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010bf200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.048958:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c587 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048964:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c587 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048975:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x239dea14 (ffff8af216687400) 00010000:00010000:2.0:1784191898.048978:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.048980:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c587 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.048985:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf200/0xfeec3c2dc5a4c587 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049003:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049009:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049014:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049018:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cda00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.049021:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049037:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049045:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x130f79e0 (ffff8af2047f9800) 00010000:00010000:2.0:1784191898.049047:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.049050:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5e2 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049055:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cda00/0xfeec3c2dc5a4c5e2 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049072:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4c63d lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049077:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4c63d lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049082:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4c63d lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049086:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10874b000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.049088:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4c63d lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049094:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4c63d lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049099:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xc735cef4 (ffff8af216687000) 00010000:00010000:2.0:1784191898.049101:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.049104:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4c63d lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049115:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874b000/0xfeec3c2dc5a4c63d lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049130:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c698 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049135:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c698 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049141:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c698 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049145:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10f2cc200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.049148:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c698 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049153:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c698 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049161:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x21aa2247 (ffff8af2047f9e00) 00010000:00010000:2.0:1784191898.049164:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.049166:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c698 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049172:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc200/0xfeec3c2dc5a4c698 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049185:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4c6f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049190:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4c6f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049201:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4c6f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049206:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af242073800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.049209:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4c6f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049214:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4c6f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049222:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xbf580d0c (ffff8af2047f9100) 00010000:00010000:2.0:1784191898.049224:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.049226:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4c6f3 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049231:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073800/0xfeec3c2dc5a4c6f3 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049246:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c74e lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049252:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c74e lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049257:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c74e lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049262:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7ea00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.049264:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c74e lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049279:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c74e lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049288:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe3541c1d (ffff8af2047f9b00) 00010000:00010000:2.0:1784191898.049290:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.049292:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c74e lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049298:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ea00/0xfeec3c2dc5a4c74e lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049313:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c7a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049319:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c7a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049324:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c7a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049330:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd69a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.049332:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c7a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049338:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c7a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049344:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x89d48c8d (ffff8af215ff6600) 00010000:00010000:2.0:1784191898.049347:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.049349:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c7a9 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049360:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69a00/0xfeec3c2dc5a4c7a9 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049376:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d800/0xfeec3c2dc5a4c804 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049382:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d800/0xfeec3c2dc5a4c804 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049387:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d800/0xfeec3c2dc5a4c804 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049391:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7d800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.049394:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d800/0xfeec3c2dc5a4c804 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049399:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d800/0xfeec3c2dc5a4c804 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049407:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xa38d6329 (ffff8af2047f9700) 00010000:00010000:2.0:1784191898.049409:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.049411:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d800/0xfeec3c2dc5a4c804 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049416:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d800/0xfeec3c2dc5a4c804 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049433:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c85f lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049453:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c85f lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049465:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c85f lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049469:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7d000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.049472:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c85f lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049477:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c85f lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049486:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xbb599949 (ffff8af2047f9300) 00010000:00010000:2.0:1784191898.049488:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.049490:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c85f lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049497:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d000/0xfeec3c2dc5a4c85f lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049512:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4c8ba lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049517:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4c8ba lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049524:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4c8ba lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049528:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3fa00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.049531:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4c8ba lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049547:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4c8ba lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049556:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x1a616f3f (ffff8af20dabc800) 00010000:00010000:2.0:1784191898.049558:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.049560:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4c8ba lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049565:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fa00/0xfeec3c2dc5a4c8ba lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049580:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c915 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049587:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c915 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049593:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c915 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049598:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af200030400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.049600:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c915 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049607:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c915 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049615:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x6d38f012 (ffff8af20dabc100) 00010000:00010000:2.0:1784191898.049617:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.049620:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c915 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049632:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030400/0xfeec3c2dc5a4c915 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049647:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c970 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049653:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c970 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049658:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c970 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049662:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1010be600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.049665:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c970 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049673:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c970 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049681:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x52815b39 (ffff8af2112b6600) 00010000:00010000:2.0:1784191898.049683:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.049685:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c970 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049722:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010be600/0xfeec3c2dc5a4c970 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049737:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c9cb lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049742:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c9cb lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049752:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c9cb lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049758:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af23dd68800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.049761:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c9cb lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049767:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c9cb lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049775:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9cfce7b5 (ffff8af210e98900) 00010000:00010000:2.0:1784191898.049777:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.049780:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c9cb lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049785:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68800/0xfeec3c2dc5a4c9cb lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049802:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ca26 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049808:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ca26 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049813:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ca26 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049817:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d6200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.049820:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ca26 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049836:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ca26 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049845:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe708c894 (ffff8af207499600) 00010000:00010000:2.0:1784191898.049849:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.049851:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ca26 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049856:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6200/0xfeec3c2dc5a4ca26 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049872:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4ca81 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049878:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4ca81 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049882:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4ca81 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049887:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d5a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.049890:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4ca81 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049895:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4ca81 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049901:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xd13f1037 (ffff8af110071c00) 00010000:00010000:2.0:1784191898.049903:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.049906:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4ca81 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049917:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5a00/0xfeec3c2dc5a4ca81 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049933:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4cadc lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049939:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4cadc lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049944:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4cadc lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049949:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7c800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.049952:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4cadc lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049958:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4cadc lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049965:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xc701cb36 (ffff8af2382d2700) 00010000:00010000:2.0:1784191898.049967:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.049970:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4cadc lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049976:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c800/0xfeec3c2dc5a4cadc lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049993:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cb37 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.049999:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cb37 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050010:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cb37 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050015:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233126600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.050018:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cb37 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050024:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cb37 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050032:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x322afea2 (ffff8af214e83c00) 00010000:00010000:2.0:1784191898.050034:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.050037:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cb37 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050043:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4cb37 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050058:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4cb92 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050063:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4cb92 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050069:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4cb92 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050074:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7ca00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.050076:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4cb92 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050091:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4cb92 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050100:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xaa0c2c16 (ffff8af216603d00) 00010000:00010000:2.0:1784191898.050102:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.050105:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4cb92 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050110:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7ca00/0xfeec3c2dc5a4cb92 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050128:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cbed lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050135:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cbed lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050140:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cbed lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050144:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1019d4c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.050146:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cbed lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050151:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cbed lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050158:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xd47b514a (ffff8af203904400) 00010000:00010000:2.0:1784191898.050160:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.050163:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cbed lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050173:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4c00/0xfeec3c2dc5a4cbed lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050189:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cc48 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050195:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cc48 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050200:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cc48 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050206:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.050209:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cc48 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050215:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cc48 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050222:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x7772308b (ffff8af2198e6900) 00010000:00010000:2.0:1784191898.050225:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.050228:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cc48 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050233:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533400/0xfeec3c2dc5a4cc48 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050246:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cca3 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050252:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cca3 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050264:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cca3 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050269:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af223b7c400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.050272:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cca3 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050278:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cca3 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050287:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xe087ee79 (ffff8af216603e00) 00010000:00010000:2.0:1784191898.050289:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.050292:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cca3 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050298:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c400/0xfeec3c2dc5a4cca3 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050318:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4ccfe lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050324:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4ccfe lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050329:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4ccfe lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050334:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20cd7e600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.050336:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4ccfe lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050353:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4ccfe lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050361:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x4d2290fc (ffff8af10994dc00) 00010000:00010000:2.0:1784191898.050364:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.050366:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4ccfe lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050372:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e600/0xfeec3c2dc5a4ccfe lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050389:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cd59 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050395:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cd59 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050401:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cd59 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050407:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.050410:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cd59 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050415:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cd59 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050423:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x489b8eb2 (ffff8af20290e500) 00010000:00010000:2.0:1784191898.050425:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.050428:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cd59 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050454:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533200/0xfeec3c2dc5a4cd59 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050473:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4cdb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050479:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4cdb4 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050485:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4cdb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050491:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3fe00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.050494:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4cdb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050500:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4cdb4 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050508:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xf2ca543e (ffff8af20dabc900) 00010000:00010000:2.0:1784191898.050510:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.050513:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4cdb4 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050518:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fe00/0xfeec3c2dc5a4cdb4 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050533:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ce0f lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050539:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ce0f lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050551:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ce0f lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050556:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20341a200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.050559:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ce0f lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050565:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ce0f lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050574:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xd06bcd9f (ffff8af20290e100) 00010000:00010000:2.0:1784191898.050576:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.050579:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ce0f lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050584:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a200/0xfeec3c2dc5a4ce0f lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050601:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ce6a lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050607:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ce6a lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050612:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ce6a lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050617:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3ec00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.050620:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ce6a lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050636:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ce6a lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050644:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x22eacdcf (ffff8af204e31200) 00010000:00010000:2.0:1784191898.050647:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.050649:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ce6a lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050655:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ec00/0xfeec3c2dc5a4ce6a lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050671:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cec5 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050678:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cec5 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050684:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cec5 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050723:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.050726:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cec5 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050732:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cec5 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050739:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x9ce4d69c (ffff8af22de8be00) 00010000:00010000:2.0:1784191898.050742:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.050745:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cec5 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050756:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4cec5 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050779:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6c00/0xfeec3c2dc5a4cf20 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050784:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6c00/0xfeec3c2dc5a4cf20 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050790:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6c00/0xfeec3c2dc5a4cf20 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050795:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d6c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.050798:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6c00/0xfeec3c2dc5a4cf20 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050803:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6c00/0xfeec3c2dc5a4cf20 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050813:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x6caa4986 (ffff8af204e31300) 00010000:00010000:2.0:1784191898.050815:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.050818:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6c00/0xfeec3c2dc5a4cf20 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050823:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6c00/0xfeec3c2dc5a4cf20 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050839:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf7b lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050846:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf7b lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050857:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf7b lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050862:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d7a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.050866:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf7b lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050873:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf7b lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050882:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x47a21a83 (ffff8af204e31c00) 00010000:00010000:2.0:1784191898.050883:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.050887:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf7b lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050893:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7a00/0xfeec3c2dc5a4cf7b lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050907:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6a00/0xfeec3c2dc5a4cfa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050914:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6a00/0xfeec3c2dc5a4cfa5 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050919:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6a00/0xfeec3c2dc5a4cfa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050923:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d6a00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.050926:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6a00/0xfeec3c2dc5a4cfa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050942:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6a00/0xfeec3c2dc5a4cfa5 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050951:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xff182846 (ffff8af204e31100) 00010000:00010000:2.0:1784191898.050954:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.050957:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6a00/0xfeec3c2dc5a4cfa5 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050963:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6a00/0xfeec3c2dc5a4cfa5 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xff182846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050977:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7000/0xfeec3c2dc5a4cfac lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050983:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7000/0xfeec3c2dc5a4cfac lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050991:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7000/0xfeec3c2dc5a4cfac lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.050996:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d7000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.050999:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7000/0xfeec3c2dc5a4cfac lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051005:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7000/0xfeec3c2dc5a4cfac lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051012:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x4f:0x0].0x0 (ffff8af204e31600) 00010000:00010000:2.0:1784191898.051015:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.051018:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7000/0xfeec3c2dc5a4cfac lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051029:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7000/0xfeec3c2dc5a4cfac lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051043:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cfba lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051049:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cfba lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051055:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cfba lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051060:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233126800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.051063:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cfba lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051069:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cfba lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051077:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x43454b14 (ffff8af22de8bc00) 00010000:00010000:2.0:1784191898.051079:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.051082:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cfba lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051087:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4cfba lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x43454b14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051099:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cfc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051105:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cfc1 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051117:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cfc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051122:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.051125:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cfc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051130:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cfc1 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051139:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x50:0x0].0x0 (ffff8af22de8bb00) 00010000:00010000:2.0:1784191898.051141:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.051144:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cfc1 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051149:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4cfc1 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051161:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6600/0xfeec3c2dc5a4cfcf lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051167:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6600/0xfeec3c2dc5a4cfcf lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051173:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6600/0xfeec3c2dc5a4cfcf lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051179:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d6600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.051182:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6600/0xfeec3c2dc5a4cfcf lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051196:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6600/0xfeec3c2dc5a4cfcf lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051204:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x87726de2 (ffff8af204e31500) 00010000:00010000:2.0:1784191898.051206:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.051208:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6600/0xfeec3c2dc5a4cfcf lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051215:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6600/0xfeec3c2dc5a4cfcf lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051229:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6000/0xfeec3c2dc5a4cfd6 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051234:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6000/0xfeec3c2dc5a4cfd6 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051240:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6000/0xfeec3c2dc5a4cfd6 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051245:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d6000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.051248:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6000/0xfeec3c2dc5a4cfd6 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051254:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6000/0xfeec3c2dc5a4cfd6 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051261:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x51:0x0].0x0 (ffff8af10fe58500) 00010000:00010000:2.0:1784191898.051263:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.051266:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6000/0xfeec3c2dc5a4cfd6 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051277:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6000/0xfeec3c2dc5a4cfd6 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051289:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cfe4 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051296:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cfe4 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051303:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cfe4 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051308:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b6d7c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.051311:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cfe4 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051318:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cfe4 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051326:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xbda0828b (ffff8af20290e900) 00010000:00010000:2.0:1784191898.051328:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.051331:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cfe4 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051336:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7c00/0xfeec3c2dc5a4cfe4 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051351:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cff2 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051358:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cff2 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051369:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cff2 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051374:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.051377:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cff2 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051383:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cff2 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051390:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x1cda55a (ffff8af20290e300) 00010000:00010000:2.0:1784191898.051392:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.051395:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cff2 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.051400:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4c00/0xfeec3c2dc5a4cff2 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191898.051580:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191898.052068:0:160169:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1784191898.052088:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812467712 00000100:00100000:1.0:1784191898.052102:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812467712 00002000:00100000:1.0:1784191898.052156:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1ce:0x0] (0->2191) req@ffff8af233157480 x1870858812467712/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 2680/0 e 0 to 0 dl 1784191909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191898.052166:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233157480 with x1870858812467712 ext(0->2191) 00002000:00010000:1.0:1784191898.052172:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233157480 00000100:00100000:1.0:1784191898.053718:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191898.053842:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1784191898.053883:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d000 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.053896:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d000 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.053904:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d000 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.053909:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d08e600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.053913:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d000 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.053941:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d000 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.053956:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x45fac828 (ffff8af20290e400) 00010000:00010000:2.0:1784191898.053959:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.053964:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d000 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.053970:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d000 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.053989:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4d02a lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.053994:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4d02a lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054000:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4d02a lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054005:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.054007:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4d02a lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054013:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4d02a lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054019:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x4f:0x0].0xbda0828b (ffff8af10994d900) 00010000:00010000:2.0:1784191898.054021:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.054024:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4d02a lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x4f:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054034:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9000/0xfeec3c2dc5a4d02a lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x4f:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054053:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7200/0xfeec3c2dc5a4d038 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054059:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7200/0xfeec3c2dc5a4d038 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054066:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7200/0xfeec3c2dc5a4d038 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054071:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d7200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.054073:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7200/0xfeec3c2dc5a4d038 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054080:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7200/0xfeec3c2dc5a4d038 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054089:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x4f:0x0].0x1cda55a (ffff8af10fe58100) 00010000:00010000:2.0:1784191898.054091:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.054094:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7200/0xfeec3c2dc5a4d038 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054100:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7200/0xfeec3c2dc5a4d038 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x4f:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054116:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7600/0xfeec3c2dc5a4d046 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054122:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7600/0xfeec3c2dc5a4d046 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054136:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7600/0xfeec3c2dc5a4d046 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054141:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d7600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.054144:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7600/0xfeec3c2dc5a4d046 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054150:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7600/0xfeec3c2dc5a4d046 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054159:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x4f:0x0].0x45fac828 (ffff8af10fe58a00) 00010000:00010000:2.0:1784191898.054161:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.054164:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7600/0xfeec3c2dc5a4d046 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054170:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7600/0xfeec3c2dc5a4d046 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x4f:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054185:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f000/0xfeec3c2dc5a4d070 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054192:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f000/0xfeec3c2dc5a4d070 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054197:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f000/0xfeec3c2dc5a4d070 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054202:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d08f000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.054205:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f000/0xfeec3c2dc5a4d070 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054221:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f000/0xfeec3c2dc5a4d070 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054230:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x50:0x0].0xbda0828b (ffff8af20290ed00) 00010000:00010000:2.0:1784191898.054232:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.054235:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f000/0xfeec3c2dc5a4d070 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x50:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054241:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f000/0xfeec3c2dc5a4d070 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x50:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054257:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d07e lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054264:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d07e lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054270:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d07e lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054276:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d6200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.054278:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d07e lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054284:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d07e lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054291:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x50:0x0].0x1cda55a (ffff8af10fe58200) 00010000:00010000:2.0:1784191898.054294:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.054296:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d07e lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054309:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6200/0xfeec3c2dc5a4d07e lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054327:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d08c lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054333:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d08c lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054338:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d08c lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054343:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10e24be00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.054346:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d08c lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054351:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d08c lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054359:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x50:0x0].0x45fac828 (ffff8af22de8b300) 00010000:00010000:2.0:1784191898.054362:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.054365:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d08c lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054370:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24be00/0xfeec3c2dc5a4d08c lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054388:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4d0b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054394:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4d0b6 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054406:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4d0b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054411:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d08e400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.054413:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4d0b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054419:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4d0b6 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054427:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x51:0x0].0xbda0828b (ffff8af1102d0a00) 00010000:00010000:2.0:1784191898.054429:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.054431:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4d0b6 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x51:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054448:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e400/0xfeec3c2dc5a4d0b6 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x51:0x0].0xbda0828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054464:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054469:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054475:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054480:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10e24ba00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.054482:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054498:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054507:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x51:0x0].0x1cda55a (ffff8af22de8b100) 00010000:00010000:2.0:1784191898.054509:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.054511:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0c4 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x51:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054516:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ba00/0xfeec3c2dc5a4d0c4 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x51:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054531:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ac00/0xfeec3c2dc5a4d0d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054536:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ac00/0xfeec3c2dc5a4d0d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054541:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ac00/0xfeec3c2dc5a4d0d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054545:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10e24ac00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.054548:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ac00/0xfeec3c2dc5a4d0d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054554:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ac00/0xfeec3c2dc5a4d0d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x51:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054560:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x51:0x0].0x45fac828 (ffff8af22de8b400) 00010000:00010000:2.0:1784191898.054562:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.054564:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ac00/0xfeec3c2dc5a4d0d2 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x51:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054575:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24ac00/0xfeec3c2dc5a4d0d2 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x51:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054592:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4d0e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xde5c5568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054598:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4d0e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xde5c5568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054604:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4d0e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xde5c5568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054609:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d6800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.054612:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4d0e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xde5c5568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054618:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4d0e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0xde5c5568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054626:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0xde5c5568 (ffff8af10fe58d00) 00010000:00010000:2.0:1784191898.054628:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.054631:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4d0e0 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xde5c5568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054637:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6800/0xfeec3c2dc5a4d0e0 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0xde5c5568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054649:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4d0e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054655:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4d0e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054667:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4d0e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054672:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d6e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.054675:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4d0e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054681:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4d0e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054714:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x5e:0x0].0x0 (ffff8af10fe58c00) 00010000:00010000:2.0:1784191898.054717:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.054719:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4d0e7 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054726:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6e00/0xfeec3c2dc5a4d0e7 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054741:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6400/0xfeec3c2dc5a4d0f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x22897837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054747:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6400/0xfeec3c2dc5a4d0f5 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x22897837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054753:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6400/0xfeec3c2dc5a4d0f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x22897837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054758:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d6400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.054761:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6400/0xfeec3c2dc5a4d0f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x22897837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054776:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6400/0xfeec3c2dc5a4d0f5 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x22897837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054784:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x22897837 (ffff8af10fe58800) 00010000:00010000:2.0:1784191898.054786:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.054789:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6400/0xfeec3c2dc5a4d0f5 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x22897837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054794:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d6400/0xfeec3c2dc5a4d0f5 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x22897837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054806:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7c00/0xfeec3c2dc5a4d0fc lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054812:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7c00/0xfeec3c2dc5a4d0fc lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054818:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7c00/0xfeec3c2dc5a4d0fc lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054823:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2035d7c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.054826:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7c00/0xfeec3c2dc5a4d0fc lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054832:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7c00/0xfeec3c2dc5a4d0fc lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054839:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x5f:0x0].0x0 (ffff8af10fe58300) 00010000:00010000:2.0:1784191898.054841:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.054843:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7c00/0xfeec3c2dc5a4d0fc lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054854:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7c00/0xfeec3c2dc5a4d0fc lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054869:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d10a lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x66b69b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054875:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d10a lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x66b69b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054882:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d10a lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x66b69b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054887:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b8e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.054890:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d10a lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x66b69b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054896:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d10a lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x1:0x0].0x66b69b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054904:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x1:0x0].0x66b69b05 (ffff8af10994d100) 00010000:00010000:2.0:1784191898.054906:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.054909:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d10a lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x66b69b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054915:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8e00/0xfeec3c2dc5a4d10a lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x1:0x0].0x66b69b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054926:0:106485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4d111 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054932:0:106485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4d111 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054942:0:106485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4d111 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054948:0:106485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191898.054951:0:106485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4d111 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054957:0:106485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4d111 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054965:0:106485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x60:0x0].0x0 (ffff8af10994da00) 00010000:00010000:2.0:1784191898.054968:0:106485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191898.054970:0:106485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4d111 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191898.054976:0:106485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9800/0xfeec3c2dc5a4d111 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x60:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00100000:10000000:2.0:1784191898.055006:0:166526:0:(lfsck_engine.c:1766:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant synced before exit: rc = 0 00100000:10000000:2.0:1784191898.055010:0:166526:0:(lfsck_engine.c:1790:lfsck_assistant_engine()) lustre-MDT0000-osd: lfsck_namespace LFSCK assistant thread exit: rc = 0 00100000:10000000:2.0:1784191898.055162:0:166524:0:(lfsck_engine.c:826:lfsck_master_oit_engine()) lustre-MDT0000-osd: OIT scan exit for engine stop, cookie 13 00100000:10000000:2.0:1784191898.055167:0:166524:0:(lfsck_engine.c:1053:lfsck_master_engine()) lustre-MDT0000-osd ffff8af110050000 exit: oit_flags = 0x60000, dir_flags = 0x8006, oit_cookie = 12, dir_cookie = 0x0, parent = [0x0:0x0:0x0], pid = 166524: rc = 0 00100000:10000000:2.0:1784191898.055176:0:166524:0:(lfsck_lib.c:2594:lfsck_post_generic()) lustre-MDT0000-osd: waiting for assistant to do lfsck_namespace post, rc = 0 00100000:10000000:2.0:1784191898.055179:0:166524:0:(lfsck_lib.c:2604:lfsck_post_generic()) lustre-MDT0000-osd: the assistant has done lfsck_namespace post, rc = 0 00100000:10000000:2.0:1784191898.055258:0:166524:0:(lfsck_namespace.c:4808:lfsck_namespace_post()) lustre-MDT0000-osd: namespace LFSCK post done: rc = 0 00000100:00100000:1.0:1784191898.059977:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191898.060103:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00100000:10000000:1.0:1784191898.060471:0:166525:0:(scrub.c:368:scrub_thread_post()) lustre-MDT0000: OI scrub post with result = 0 00100000:10000000:1.0:1784191898.060521:0:166525:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1784191898.060524:0:166525:0:(osd_scrub.c:1303:osd_scrub_main()) lustre-MDT0000: OI scrub: stop, pos = 20036: rc = 0 00000100:00100000:1.0:1784191898.060670:0:160171:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1784191898.060680:0:160171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812468224 00000100:00100000:1.0:1784191898.060708:0:160171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812468224 00002000:00100000:1.0:1784191898.060765:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x255:0x0] (0->4116) req@ffff8af20d5c9880 x1870858812468224/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 4608/0 e 0 to 0 dl 1784191909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191898.060776:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20d5c9880 with x1870858812468224 ext(0->4116) 00002000:00010000:1.0:1784191898.060782:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af20d5c9880 00000100:00100000:1.0:1784191898.060800:0:160171:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1784191898.060807:0:160171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812468352 00000100:00100000:1.0:1784191898.060811:0:160171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812468352 00002000:00100000:1.0:1784191898.060828:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x1d0:0x0] (0->6212) req@ffff8af233156d80 x1870858812468352/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 6704/0 e 0 to 0 dl 1784191909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191898.060836:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233156d80 with x1870858812468352 ext(0->6212) 00002000:00010000:1.0:1784191898.060839:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233156d80 00000100:00100000:1.0:1784191898.060847:0:160171:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1784191898.060851:0:160171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812468736 00000100:00100000:1.0:1784191898.060853:0:160171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812468736 00002000:00100000:1.0:1784191898.060864:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x25a:0x0] (0->35426) req@ffff8af20d5cb480 x1870858812468736/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 488/0 e 0 to 0 dl 1784191909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191898.060871:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20d5cb480 with x1870858812468736 ext(0->35426) 00002000:00010000:1.0:1784191898.060875:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af20d5cb480 00000100:00100000:1.0:1784191898.060881:0:160171:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1784191898.060886:0:160171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812469248 00000100:00100000:1.0:1784191898.060888:0:160171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812469248 00002000:00100000:1.0:1784191898.060899:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x1d1:0x0] (0->233) req@ffff8af20d5cbb80 x1870858812469248/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 728/0 e 0 to 0 dl 1784191909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191898.060905:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20d5cbb80 with x1870858812469248 ext(0->233) 00002000:00010000:1.0:1784191898.060908:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af20d5cbb80 00000100:00100000:2.0:1784191898.061201:0:166576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 29 00000100:00100000:2.0:1784191898.061212:0:166576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+72:69111:x1870858812467968:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:2.0:1784191898.061425:0:166576:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:2.0:1784191898.061429:0:166576:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191898.061432:0:166576:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:2.0:1784191898.061434:0:166576:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191898.061448:0:166576:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191898.061450:0:166576:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191898.068618:0:166576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+74:69111:x1870858812467968:12345-192.168.204.16@tcp:4:cp.0 Request processed in 7395us (46247us total) trans 17179869253 rc 0/0 00000100:00100000:0.0:1784191898.068635:0:166576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 29 00002000:00100000:0.0:1784191898.068649:0:166576:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1d2:0x0] (0->3078) req@ffff8af20d78b100 x1870858812467968/t17179869253(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 3568/448 e 0 to 0 dl 1784191909 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191898.068659:0:166576:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20d78b100 with x1870858812467968 ext(0->3078) 00002000:00010000:0.0:1784191898.068666:0:166576:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af20d78b100 00000100:00100000:0.0:1784191898.068720:0:166576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 30 00000100:00100000:0.0:1784191898.068733:0:166576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+73:69112:x1870858812468480:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:2.0:1784191898.071581:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191898.071623:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00080000:00000400:1.0:1784191898.071664:0:166572:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:1.0:1784191898.071670:0:166572:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:1.0:1784191898.071678:0:166572:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:1.0:1784191898.071681:0:166572:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:1.0:1784191898.071683:0:166572:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:1.0:1784191898.071685:0:166572:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191898.071722:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191898.071740:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191898.071753:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00080000:00000400:2.0:1784191898.071993:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:2.0:1784191898.071997:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191898.071999:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:2.0:1784191898.072001:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191898.072003:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191898.072005:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191898.072136:0:166438:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:3.0:1784191898.072140:0:166438:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:3.0:1784191898.072142:0:166438:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:3.0:1784191898.072144:0:166438:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:3.0:1784191898.072146:0:166438:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:3.0:1784191898.072148:0:166438:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191898.072229:0:160171:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:0.0:1784191898.072239:0:160171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_006' 00000100:00100000:0.0:1784191898.073094:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+75:69111:x1870858812467840:12345-192.168.204.16@tcp:4:cp.0 Request processed in 48484us (50808us total) trans 17179869254 rc 0/0 00000100:00100000:0.0:1784191898.073107:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 28 00002000:00100000:0.0:1784191898.073120:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1d6:0x0] (0->111012) req@ffff8af20d789500 x1870858812467840/t17179869254(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 488/448 e 0 to 0 dl 1784191909 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191898.073131:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20d789500 with x1870858812467840 ext(0->111012) 00002000:00010000:0.0:1784191898.073138:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af20d789500 00000100:00100000:0.0:1784191898.073166:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812468608 00000100:00100000:0.0:1784191898.073174:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812468608 00002000:00100000:0.0:1784191898.073208:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x252:0x0] (0->937) req@ffff8af10f4ee300 x1870858812468608/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 1432/0 e 0 to 0 dl 1784191909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191898.073217:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10f4ee300 with x1870858812468608 ext(0->937) 00002000:00010000:0.0:1784191898.073220:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10f4ee300 00000100:00100000:0.0:1784191898.073231:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812468864 00000100:00100000:0.0:1784191898.073235:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812468864 00002000:00100000:0.0:1784191898.073250:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1d7:0x0] (0->13878) req@ffff8af10f4ec700 x1870858812468864/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 14368/0 e 0 to 0 dl 1784191909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191898.073257:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10f4ec700 with x1870858812468864 ext(0->13878) 00002000:00010000:0.0:1784191898.073261:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af10f4ec700 00000100:00100000:0.0:1784191898.073269:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812469120 00000100:00100000:0.0:1784191898.073271:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812469120 00002000:00100000:0.0:1784191898.073284:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x258:0x0] (0->1693) req@ffff8af10f4ec380 x1870858812469120/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 2184/0 e 0 to 0 dl 1784191909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191898.073291:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10f4ec380 with x1870858812469120 ext(0->1693) 00002000:00010000:0.0:1784191898.073294:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10f4ec380 00000100:00100000:0.0:1784191898.073300:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812468992 00000100:00100000:0.0:1784191898.073313:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812468992 00002000:00100000:0.0:1784191898.073345:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x257:0x0] (0->8440) req@ffff8af10f4eed80 x1870858812468992/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 8936/0 e 0 to 0 dl 1784191909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191898.073352:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10f4eed80 with x1870858812468992 ext(0->8440) 00002000:00010000:0.0:1784191898.073355:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10f4eed80 00000100:00100000:0.0:1784191898.073364:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812469376 00000100:00100000:0.0:1784191898.073367:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812469376 00002000:00100000:0.0:1784191898.073379:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x256:0x0] (0->4149) req@ffff8af10f4ed180 x1870858812469376/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 4640/0 e 0 to 0 dl 1784191909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191898.073386:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10f4ed180 with x1870858812469376 ext(0->4149) 00002000:00010000:0.0:1784191898.073389:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10f4ed180 00000100:00100000:0.0:1784191898.073400:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 31 00000100:00100000:0.0:1784191898.073409:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+75:69109:x1870858812467584:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:0.0:1784191898.073604:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191898.073608:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191898.073616:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191898.073618:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191898.073621:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191898.073622:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:3.0:1784191898.073967:0:166438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+73:69111:x1870858812466816:12345-192.168.204.16@tcp:4:cp.0 Request processed in 62876us (95003us total) trans 21474836561 rc 0/0 00000100:00100000:3.0:1784191898.074295:0:166438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 24 00002000:00100000:3.0:1784191898.074304:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x250:0x0] (0->18268) req@ffff8af111a8e300 x1870858812466816/t21474836561(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 488/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191898.074314:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111a8e300 with x1870858812466816 ext(0->18268) 00002000:00010000:3.0:1784191898.074318:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111a8e300 00000100:00100000:3.0:1784191898.074339:0:166438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 32 00000100:00100000:3.0:1784191898.074347:0:166438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+72:69109:x1870858812468096:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:3.0:1784191898.074493:0:166438:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:3.0:1784191898.074497:0:166438:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:3.0:1784191898.074499:0:166438:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:3.0:1784191898.074501:0:166438:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:3.0:1784191898.074509:0:166438:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:3.0:1784191898.074510:0:166438:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191898.075812:0:166572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+73:69111:x1870858812465792:12345-192.168.204.16@tcp:4:cp.0 Request processed in 65222us (97581us total) trans 21474836560 rc 0/0 00000100:00100000:0.0:1784191898.075823:0:166572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 23 00002000:00100000:0.0:1784191898.075833:0:166572:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x24c:0x0] (0->28244) req@ffff8af106b86a00 x1870858812465792/t21474836560(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:68/0 lens 488/448 e 0 to 0 dl 1784191908 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191898.075842:0:166572:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af106b86a00 with x1870858812465792 ext(0->28244) 00002000:00010000:0.0:1784191898.075849:0:166572:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af106b86a00 00000100:00100000:0.0:1784191898.075879:0:166572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 33 00000100:00100000:0.0:1784191898.075889:0:166572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+77:69109:x1870858812467712:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:0.0:1784191898.076046:0:166572:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191898.076050:0:166572:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191898.076053:0:166572:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191898.076055:0:166572:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191898.076057:0:166572:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191898.076058:0:166572:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191898.077113:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+79:69109:x1870858812467584:12345-192.168.204.16@tcp:4:cp.0 Request processed in 3699us (54699us total) trans 17179869255 rc 0/0 00000100:00100000:0.0:1784191898.077122:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 31 00002000:00100000:0.0:1784191898.077132:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1d5:0x0] (0->6429) req@ffff8af20d78a300 x1870858812467584/t17179869255(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 6920/448 e 0 to 0 dl 1784191909 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191898.077141:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20d78a300 with x1870858812467584 ext(0->6429) 00002000:00010000:0.0:1784191898.077146:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af20d78a300 00000100:00100000:0.0:1784191898.077167:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 34 00000100:00100000:0.0:1784191898.077176:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+72:69109:x1870858812468224:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:0.0:1784191898.077306:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191898.077310:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191898.077312:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191898.077315:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191898.077330:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191898.077332:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191898.077603:0:166572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+78:69109:x1870858812467712:12345-192.168.204.16@tcp:4:cp.0 Request processed in 1715us (26029us total) trans 17179869256 rc 0/0 00000100:00100000:2.0:1784191898.077617:0:166572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 33 00002000:00100000:2.0:1784191898.077624:0:166572:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1ce:0x0] (0->2191) req@ffff8af233157480 x1870858812467712/t17179869256(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 2680/448 e 0 to 0 dl 1784191909 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191898.077632:0:166572:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233157480 with x1870858812467712 ext(0->2191) 00002000:00010000:2.0:1784191898.077636:0:166572:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233157480 00000100:00100000:2.0:1784191898.077656:0:166572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 35 00000100:00100000:2.0:1784191898.077665:0:166572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+77:69112:x1870858812468352:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:2.0:1784191898.077798:0:166572:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:2.0:1784191898.077806:0:166572:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191898.077808:0:166572:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:2.0:1784191898.077810:0:166572:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191898.077812:0:166572:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191898.077814:0:166572:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191898.078577:0:166572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+79:69112:x1870858812468352:12345-192.168.204.16@tcp:4:cp.0 Request processed in 910us (24732us total) trans 17179869257 rc 0/0 00000100:00100000:2.0:1784191898.078586:0:166572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 35 00002000:00100000:2.0:1784191898.078594:0:166572:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1d0:0x0] (0->6212) req@ffff8af233156d80 x1870858812468352/t17179869257(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 6704/448 e 0 to 0 dl 1784191909 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191898.078603:0:166572:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233156d80 with x1870858812468352 ext(0->6212) 00002000:00010000:2.0:1784191898.078608:0:166572:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233156d80 00000100:00100000:2.0:1784191898.078633:0:166572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 36 00000100:00100000:2.0:1784191898.078642:0:166572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+74:69110:x1870858812468736:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:0.0:1784191898.079079:0:166438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+75:69109:x1870858812468096:12345-192.168.204.16@tcp:4:cp.0 Request processed in 4731us (56637us total) trans 21474836562 rc 0/0 00000100:00100000:0.0:1784191898.079087:0:166438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 32 00002000:00100000:0.0:1784191898.079099:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x253:0x0] (0->6812) req@ffff8af10fb63100 x1870858812468096/t21474836562(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 7304/448 e 0 to 0 dl 1784191909 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191898.079107:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10fb63100 with x1870858812468096 ext(0->6812) 00002000:00010000:0.0:1784191898.079111:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10fb63100 00000100:00100000:0.0:1784191898.079128:0:166438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 37 00000100:00100000:0.0:1784191898.079136:0:166438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+78:69109:x1870858812469248:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:0.0:1784191898.079259:0:166438:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191898.079263:0:166438:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191898.079265:0:166438:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191898.079267:0:166438:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191898.079268:0:166438:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191898.079270:0:166438:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191898.079551:0:166576:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191898.079555:0:166576:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191898.079557:0:166576:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191898.079559:0:166576:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191898.079560:0:166576:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191898.079562:0:166576:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191898.080891:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+74:69109:x1870858812468224:12345-192.168.204.16@tcp:4:cp.0 Request processed in 3705us (27171us total) trans 21474836563 rc 0/0 00000100:00100000:2.0:1784191898.080907:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 34 00002000:00100000:2.0:1784191898.080919:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x255:0x0] (0->4116) req@ffff8af20d5c9880 x1870858812468224/t21474836563(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 4608/448 e 0 to 0 dl 1784191909 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191898.080929:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20d5c9880 with x1870858812468224 ext(0->4116) 00002000:00010000:2.0:1784191898.080935:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af20d5c9880 00000100:00100000:2.0:1784191898.080966:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 38 00000100:00100000:2.0:1784191898.080976:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+73:69110:x1870858812468608:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:2.0:1784191898.081168:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:2.0:1784191898.081173:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191898.081181:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:2.0:1784191898.081183:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191898.081185:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191898.081187:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191898.081963:0:166438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+82:69109:x1870858812469248:12345-192.168.204.16@tcp:4:cp.0 Request processed in 2823us (21855us total) trans 17179869258 rc 0/0 00000100:00100000:0.0:1784191898.081973:0:166438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 37 00002000:00100000:0.0:1784191898.081983:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1d1:0x0] (0->233) req@ffff8af20d5cbb80 x1870858812469248/t17179869258(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 728/448 e 0 to 0 dl 1784191909 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191898.081992:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20d5cbb80 with x1870858812469248 ext(0->233) 00002000:00010000:0.0:1784191898.081998:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af20d5cbb80 00000100:00100000:0.0:1784191898.082019:0:166438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 39 00000100:00100000:0.0:1784191898.082027:0:166438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+81:69111:x1870858812468864:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:0.0:1784191898.082202:0:166438:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:0.0:1784191898.082206:0:166438:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191898.082208:0:166438:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:0.0:1784191898.082210:0:166438:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191898.082212:0:166438:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191898.082214:0:166438:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191898.082711:0:166438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+83:69111:x1870858812468864:12345-192.168.204.16@tcp:4:cp.0 Request processed in 661us (11062us total) trans 17179869260 rc 0/0 00000100:00100000:0.0:1784191898.082720:0:166438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 39 00002000:00100000:0.0:1784191898.082728:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1d7:0x0] (0->13878) req@ffff8af10f4ec700 x1870858812468864/t17179869260(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 14368/448 e 0 to 0 dl 1784191909 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191898.082736:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10f4ec700 with x1870858812468864 ext(0->13878) 00002000:00010000:0.0:1784191898.082742:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af10f4ec700 00000100:00100000:0.0:1784191898.082769:0:166438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 40 00000100:00100000:0.0:1784191898.082777:0:166438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+75:69110:x1870858812469120:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:0.0:1784191898.082887:0:166438:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:0.0:1784191898.082891:0:166438:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191898.082893:0:166438:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:0.0:1784191898.082895:0:166438:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191898.082897:0:166438:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191898.082899:0:166438:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191898.083337:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+75:69110:x1870858812468608:12345-192.168.204.16@tcp:4:cp.0 Request processed in 2361us (11762us total) trans 21474836564 rc 0/0 00000100:00100000:2.0:1784191898.083346:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 38 00002000:00100000:2.0:1784191898.083353:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x252:0x0] (0->937) req@ffff8af10f4ee300 x1870858812468608/t21474836564(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 1432/448 e 0 to 0 dl 1784191909 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191898.083362:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10f4ee300 with x1870858812468608 ext(0->937) 00002000:00010000:2.0:1784191898.083366:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10f4ee300 00000100:00100000:2.0:1784191898.083385:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 41 00000100:00100000:2.0:1784191898.083392:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+74:69111:x1870858812468992:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:2.0:1784191898.083528:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:2.0:1784191898.083532:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191898.083534:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:2.0:1784191898.083536:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191898.083539:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191898.083541:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191898.084165:0:166438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+76:69110:x1870858812469120:12345-192.168.204.16@tcp:4:cp.0 Request processed in 1386us (12440us total) trans 21474836565 rc 0/0 00000100:00100000:0.0:1784191898.084175:0:166438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 40 00002000:00100000:0.0:1784191898.084183:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x258:0x0] (0->1693) req@ffff8af10f4ec380 x1870858812469120/t21474836565(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 2184/448 e 0 to 0 dl 1784191909 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191898.084206:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10f4ec380 with x1870858812469120 ext(0->1693) 00002000:00010000:0.0:1784191898.084211:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10f4ec380 00000100:00100000:0.0:1784191898.084232:0:166438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 42 00000100:00100000:0.0:1784191898.084240:0:166438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+75:69111:x1870858812469376:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:2.0:1784191898.084559:0:166576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+81:69112:x1870858812468480:12345-192.168.204.16@tcp:4:cp.0 Request processed in 15830us (62164us total) trans 17179869259 rc 0/0 00000100:00100000:2.0:1784191898.084568:0:166576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 30 00002000:00100000:2.0:1784191898.084575:0:166576:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1cf:0x0] (0->55539) req@ffff8af20d78b480 x1870858812468480/t17179869259(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 488/448 e 0 to 0 dl 1784191909 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191898.084583:0:166576:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20d78b480 with x1870858812468480 ext(0->55539) 00002000:00010000:2.0:1784191898.084587:0:166576:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af20d78b480 00000100:00100000:2.0:1784191898.084901:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+77:69111:x1870858812468992:12345-192.168.204.16@tcp:4:cp.0 Request processed in 1508us (13159us total) trans 21474836566 rc 0/0 00000100:00100000:2.0:1784191898.084914:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 41 00002000:00100000:2.0:1784191898.084921:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x257:0x0] (0->8440) req@ffff8af10f4eed80 x1870858812468992/t21474836566(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 8936/448 e 0 to 0 dl 1784191909 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191898.084930:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10f4eed80 with x1870858812468992 ext(0->8440) 00002000:00010000:2.0:1784191898.084934:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10f4eed80 00080000:00000400:0.0:1784191898.085504:0:166438:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191898.085509:0:166438:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191898.085512:0:166438:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191898.085514:0:166438:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191898.085516:0:166438:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191898.085517:0:166438:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191898.086830:0:166438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+78:69111:x1870858812469376:12345-192.168.204.16@tcp:4:cp.0 Request processed in 2581us (15066us total) trans 21474836567 rc 0/0 00000100:00100000:0.0:1784191898.086844:0:166438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 42 00002000:00100000:0.0:1784191898.086856:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x256:0x0] (0->4149) req@ffff8af10f4ed180 x1870858812469376/t21474836567(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 4640/448 e 0 to 0 dl 1784191909 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191898.086867:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10f4ed180 with x1870858812469376 ext(0->4149) 00002000:00010000:0.0:1784191898.086874:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10f4ed180 00000100:00100000:0.0:1784191898.097895:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00080000:00000400:2.0:1784191898.100355:0:166572:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:2.0:1784191898.100365:0:166572:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191898.100367:0:166572:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:2.0:1784191898.100370:0:166572:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191898.100372:0:166572:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191898.100374:0:166572:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:3.0:1784191898.101899:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812469504 00000100:00100000:3.0:1784191898.101912:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812469504 00002000:00100000:3.0:1784191898.101960:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x259:0x0] (0->6233) req@ffff8af22de44380 x1870858812469504/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 6728/0 e 0 to 0 dl 1784191909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191898.101972:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af22de44380 with x1870858812469504 ext(0->6233) 00002000:00010000:3.0:1784191898.101978:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af22de44380 00000100:00100000:3.0:1784191898.102011:0:160169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 43 00000100:00100000:3.0:1784191898.102021:0:160169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+80:69111:x1870858812469504:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:3.0:1784191898.102315:0:160169:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:3.0:1784191898.102319:0:160169:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:3.0:1784191898.102321:0:160169:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:3.0:1784191898.102324:0:160169:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:3.0:1784191898.102326:0:160169:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:3.0:1784191898.102328:0:160169:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:3.0:1784191898.103118:0:160169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+82:69111:x1870858812469504:12345-192.168.204.16@tcp:4:cp.0 Request processed in 1093us (5229us total) trans 21474836569 rc 0/0 00000100:00100000:3.0:1784191898.103129:0:160169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 43 00002000:00100000:3.0:1784191898.103139:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x259:0x0] (0->6233) req@ffff8af22de44380 x1870858812469504/t21474836569(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 6728/448 e 0 to 0 dl 1784191909 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191898.103149:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af22de44380 with x1870858812469504 ext(0->6233) 00002000:00010000:3.0:1784191898.103155:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af22de44380 00000100:00100000:3.0:1784191898.103925:0:166572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+80:69110:x1870858812468736:12345-192.168.204.16@tcp:4:cp.0 Request processed in 25278us (43953us total) trans 21474836568 rc 0/0 00000100:00100000:3.0:1784191898.103935:0:166572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 36 00002000:00100000:3.0:1784191898.103944:0:166572:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x25a:0x0] (0->35426) req@ffff8af20d5cb480 x1870858812468736/t21474836568(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:69/0 lens 488/448 e 0 to 0 dl 1784191909 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191898.103960:0:166572:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20d5cb480 with x1870858812468736 ext(0->35426) 00002000:00010000:3.0:1784191898.103965:0:166572:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af20d5cb480 00000100:00100000:0.0:1784191898.124974:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784191898.125001:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827978880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191898.125075:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191898.125138:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827978880 00000100:00100000:0.0:1784191898.125146:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827978880 00000100:00100000:0.0:1784191898.125204:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1784191898.125213:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827978880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784191898.125257:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 42520576 avail 36388864 00000100:00100000:0.0:1784191898.125306:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827978880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191898.125314:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1784191898.125365:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827978880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191898.129290:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784191898.129369:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827979008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784191898.129467:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191898.130212:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827979136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784191898.130251:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191898.133110:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784191898.133132:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827979264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784191898.133198:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191898.135503:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827979008 00000100:00100000:3.0:1784191898.135519:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827979008 00000100:00100000:2.0:1784191898.135678:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827979136 00000100:00100000:2.0:1784191898.135683:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827979136 00000100:00100000:2.0:1784191898.135730:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1784191898.135740:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827979008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784191898.135769:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3907584 granted 60450752 pending 815104 free 70840320 avail 63672320 00000100:00100000:2.0:1784191898.135857:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827979008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (6390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191898.135864:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1784191898.135882:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1784191898.135888:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827979136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784191898.135897:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3907584 granted 60450752 pending 815104 free 70840320 avail 63672320 00000100:00100000:2.0:1784191898.135922:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827979136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (5671us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191898.135935:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1784191898.135989:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827979008:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1784191898.136426:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784191898.138088:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827979136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191898.138256:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827979264 00000100:00100000:3.0:1784191898.138265:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827979264 00000100:00100000:3.0:1784191898.138916:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00080000:2.0:1784191898.138968:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784191898.139001:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827979264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784191898.139033:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1585152 granted 59987904 pending 651264 free 70438912 avail 63270912 00000100:00100000:3.0:1784191898.139128:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827979264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (5930us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191898.139135:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1784191898.139212:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827979264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784191898.635877:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784191898.635900:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827979392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784191898.635973:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191898.636031:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827979392 00000100:00100000:1.0:1784191898.636039:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827979392 00000100:00100000:1.0:1784191898.636094:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:1.0:1784191898.636103:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827979392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784191898.636141:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42676224 avail 36544512 00000100:00100000:1.0:1784191898.636200:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858827979392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191898.636208:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:1.0:1784191898.636268:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858827979392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784191898.640441:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827979648:0@lo:400:kworker.0 00000100:00100000:1.0:1784191898.640525:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191898.640562:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858827980160:0@lo:400:kworker.0 00000100:00100000:1.0:1784191898.640606:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191898.640637:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784191898.640643:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827979776:0@lo:400:kworker.0 00000100:00100000:1.0:1784191898.640667:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191898.640683:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827980288:0@lo:400:kworker.0 00000100:00100000:1.0:1784191898.640729:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191898.640765:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827979648 00000100:00100000:1.0:1784191898.640772:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827979648 00000100:00100000:1.0:1784191898.640837:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1784191898.640846:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827979648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191898.640900:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858827979648:12345-0@lo:400:kworker.0 Request processed in 54us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191898.640906:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1784191898.640934:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827980160 00000100:00100000:1.0:1784191898.640938:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827980160 00000100:00100000:1.0:1784191898.640964:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827979776 00000100:00100000:1.0:1784191898.640967:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827979776 00000100:00100000:1.0:1784191898.640984:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827980288 00000100:00100000:1.0:1784191898.640987:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827980288 00000100:00100000:1.0:1784191898.641001:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1784191898.641007:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858827980160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191898.641384:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827979520:0@lo:400:kworker.0 00000100:00100000:0.0:1784191898.641423:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191898.641465:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858827980032:0@lo:400:kworker.0 00000100:00100000:0.0:1784191898.641489:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191898.641504:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784191898.641510:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858827979904:0@lo:400:kworker.0 00000100:00100000:0.0:1784191898.641534:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191898.641546:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858827980416:0@lo:400:kworker.0 00000100:00100000:0.0:1784191898.641569:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191898.641592:0:158658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827979520 00000100:00100000:0.0:1784191898.641596:0:158658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827979520 00000100:00100000:0.0:1784191898.641629:0:158658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1784191898.641636:0:158658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106500:x1870858827979520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191898.641674:0:158658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106500:x1870858827979520:12345-0@lo:400:kworker.0 Request processed in 38us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191898.641680:0:158658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1784191898.641743:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827979520:0@lo:400:kworker.0 00000100:00100000:1.0:1784191898.641898:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858827980160:12345-0@lo:400:kworker.0 Request processed in 890us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191898.641906:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1784191898.641922:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827980032 00000100:00100000:1.0:1784191898.641924:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827980032 00000100:00100000:1.0:1784191898.641940:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827979904 00000100:00100000:1.0:1784191898.641943:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827979904 00000100:00100000:1.0:1784191898.641969:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827980416 00000100:00100000:1.0:1784191898.641971:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827980416 00000100:00100000:1.0:1784191898.641984:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1784191898.641990:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827979776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191898.642023:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858827979776:12345-0@lo:400:kworker.0 Request processed in 33us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191898.642029:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1784191898.642040:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1784191898.642046:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827980288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191898.642074:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827980288:12345-0@lo:400:kworker.0 Request processed in 28us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191898.642080:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1784191898.642089:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1784191898.642094:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858827980032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191898.642170:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858827980032:12345-0@lo:400:kworker.0 Request processed in 76us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191898.642186:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1784191898.642199:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1784191898.642205:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858827979904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191898.642370:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858827979904:12345-0@lo:400:kworker.0 Request processed in 31us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191898.642378:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1784191898.642391:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1784191898.642398:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858827980416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191898.642439:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858827980416:12345-0@lo:400:kworker.0 Request processed in 42us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191898.642453:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1784191898.642627:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858827979776:0@lo:400:kworker.0 00000100:00100000:1.0:1784191898.642640:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827980288:0@lo:400:kworker.0 00000100:00100000:1.0:1784191898.642652:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827979648:0@lo:400:kworker.0 00000100:00100000:1.0:1784191898.642663:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858827980160:0@lo:400:kworker.0 00000100:00080000:3.0:1784191898.642788:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784191898.642792:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784191898.642795:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191898.642935:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858827980032:0@lo:400:kworker.0 00000100:00100000:0.0:1784191898.642953:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858827979904:0@lo:400:kworker.0 00000100:00100000:0.0:1784191898.642973:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858827980416:0@lo:400:kworker.0 00010000:00010000:2.0:1784191898.703093:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191899.478772:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191899.478818:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191899.478857:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191899.478883:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191899.478909:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191899.478947:0:158659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812469632 00000100:00100000:0.0:1784191899.478961:0:158659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812469632 00000100:00100000:0.0:1784191899.479030:0:158659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 294 00000100:00100000:0.0:1784191899.479045:0:158659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812469632:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191899.479151:0:158659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812469632:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 109us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191899.479160:0:158659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 294 00000100:00100000:0.0:1784191899.479203:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812470016 00000100:00100000:0.0:1784191899.479207:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812470016 00000100:00100000:0.0:1784191899.479256:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812470144 00000100:00100000:0.0:1784191899.479259:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812470144 00000100:00100000:0.0:1784191899.479291:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 184 00000100:00100000:0.0:1784191899.479298:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+80:69112:x1870858812470016:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191899.479332:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+80:69112:x1870858812470016:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 35us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191899.479338:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 184 00000100:00100000:0.0:1784191899.479352:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 185 00000100:00100000:0.0:1784191899.479358:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+81:69110:x1870858812470144:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191899.479387:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+81:69110:x1870858812470144:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 29us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191899.479407:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 185 00000100:00100000:3.0:1784191899.480252:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812469760 00000100:00100000:3.0:1784191899.480265:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812469760 00000100:00100000:3.0:1784191899.480336:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812469888 00000100:00100000:3.0:1784191899.480340:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812469888 00000100:00100000:3.0:1784191899.480376:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 366 00000100:00100000:3.0:1784191899.480385:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+91:69110:x1870858812469760:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191899.480475:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+91:69110:x1870858812469760:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 91us (1719us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191899.480484:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 366 00000100:00100000:3.0:1784191899.480503:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 367 00000100:00100000:3.0:1784191899.480510:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812469888:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191899.480555:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812469888:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 46us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191899.480563:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 367 00000100:00080000:3.0:1784191899.480585:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784191899.480590:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784191899.480593:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784191899.480596:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1784191899.665269:0:165481:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 21474836546 batchid updated 00000020:00080000:1.0:1784191899.668677:0:165502:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474836546 00000004:00080000:1.0:1784191899.668814:0:165502:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af236805f00 with version 18 00000020:00080000:1.0:1784191899.668834:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 21474836537 cancel update log [0x200003ab4:0x2:0x0].1: rc = 0 00000020:00080000:1.0:1784191899.668978:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 21474836537 cancel update log [0x240002b10:0x2:0x0].1: rc = 0 00000004:00080000:1.0:1784191899.669012:0:165502:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af2368059c0 with version 19 00000020:00080000:1.0:1784191899.669030:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 21474836538 cancel update log [0x200003ab4:0x2:0x0].2: rc = 0 00000020:00080000:1.0:1784191899.669054:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 21474836538 cancel update log [0x240002b10:0x2:0x0].2: rc = 0 00000004:00080000:1.0:1784191899.669083:0:165502:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af236805c00 with version 20 00000020:00080000:1.0:1784191899.669086:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 21474836539 cancel update log [0x200003ab4:0x2:0x0].3: rc = 0 00000020:00080000:1.0:1784191899.669108:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 21474836539 cancel update log [0x240002b10:0x2:0x0].3: rc = 0 00000004:00080000:1.0:1784191899.669136:0:165502:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af236805b40 with version 21 00000020:00080000:1.0:1784191899.669140:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 21474836540 cancel update log [0x200003ab4:0x2:0x0].4: rc = 0 00000020:00080000:1.0:1784191899.669160:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 21474836540 cancel update log [0x240002b10:0x2:0x0].4: rc = 0 00000004:00080000:1.0:1784191899.669189:0:165502:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af20c1f9c00 with version 22 00000020:00080000:1.0:1784191899.669193:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 21474836541 cancel update log [0x200003ab4:0x2:0x0].5: rc = 0 00000020:00080000:1.0:1784191899.669213:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 21474836541 cancel update log [0x240002b10:0x2:0x0].5: rc = 0 00000004:00080000:1.0:1784191899.669237:0:165502:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af23392a180 with version 23 00000020:00080000:1.0:1784191899.669271:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 21474836542 cancel update log [0x200003ab4:0x2:0x0].6: rc = 0 00000020:00080000:1.0:1784191899.669301:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 21474836542 cancel update log [0x240002b10:0x2:0x0].6: rc = 0 00000004:00080000:1.0:1784191899.669321:0:165502:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af23392a9c0 with version 24 00000020:00080000:1.0:1784191899.669324:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 21474836543 cancel update log [0x200003ab4:0x2:0x0].7: rc = 0 00000020:00080000:1.0:1784191899.669584:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 21474836543 cancel update log [0x240002b10:0x2:0x0].7: rc = 0 00000004:00080000:1.0:1784191899.669612:0:165502:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af23392ac00 with version 25 00000020:00080000:1.0:1784191899.669615:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 21474836544 cancel update log [0x200003ab4:0x2:0x0].8: rc = 0 00000020:00080000:1.0:1784191899.669635:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 21474836544 cancel update log [0x240002b10:0x2:0x0].8: rc = 0 00000004:00080000:1.0:1784191899.669657:0:165502:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af23392a600 with version 26 00000020:00080000:1.0:1784191899.669659:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 21474836545 cancel update log [0x200003ab4:0x2:0x0].9: rc = 0 00000020:00080000:1.0:1784191899.669677:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 21474836545 cancel update log [0x240002b10:0x2:0x0].9: rc = 0 00000004:00080000:1.0:1784191899.669747:0:165502:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8af23392aa80 with version 27 00000020:00080000:1.0:1784191899.669750:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 21474836546 cancel update log [0x200003ab4:0x2:0x0].10: rc = 0 00000020:00080000:1.0:1784191899.669772:0:165502:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 21474836546 cancel update log [0x240002b10:0x2:0x0].10: rc = 0 00000020:00080000:1.0:1784191899.669781:0:165502:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474836546 00000004:00080000:0.0:1784191899.669895:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 18 rpc_version 18 00000020:00100000:0.0:1784191899.669951:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784191899.669968:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af22de47800 x1870858827980672/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784191899.670002:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de47800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827980672:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784191899.670117:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191899.670160:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af202d61480 going to sleep for 11 seconds 00000100:00100000:0.0:1784191899.670199:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827980672 00000100:00100000:0.0:1784191899.670211:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827980672 00000100:00100000:0.0:1784191899.670288:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1784191899.670301:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:165486:x1870858827980672:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784191899.670539:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:165486:x1870858827980672:12345-0@lo:1000:osp_up0-1.0 Request processed in 239us (420us total) trans 34359738828 rc 0/0 00000100:00100000:0.0:1784191899.670547:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1784191899.670628:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de47800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827980672:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1784191899.670643:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 19 rpc_version 19 00000020:00100000:0.0:1784191899.670659:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784191899.670665:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af22de44700 x1870858827980928/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784191899.670679:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de44700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827980928:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784191899.670874:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191899.670892:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1784191899.671390:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827980928 00000100:00100000:1.0:1784191899.671414:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827980928 00000100:00100000:1.0:1784191899.671458:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1784191899.671468:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:165486:x1870858827980928:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784191899.671634:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:165486:x1870858827980928:12345-0@lo:1000:osp_up0-1.0 Request processed in 167us (759us total) trans 34359738829 rc 0/0 00000100:00100000:1.0:1784191899.671642:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1784191899.671826:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de44700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827980928:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1784191899.671839:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 20 rpc_version 20 00000020:00100000:1.0:1784191899.672109:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784191899.672117:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af23bc64380 x1870858827981184/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784191899.672140:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc64380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827981184:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784191899.672185:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191899.672212:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23392ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191899.672231:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827981184 00000100:00100000:1.0:1784191899.672236:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827981184 00000100:00100000:1.0:1784191899.672271:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:1.0:1784191899.672279:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:165486:x1870858827981184:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784191899.673763:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:165486:x1870858827981184:12345-0@lo:1000:osp_up0-1.0 Request processed in 121us (215us total) trans 34359738830 rc 0/0 00000100:00100000:1.0:1784191899.673783:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:1.0:1784191899.674476:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc64380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827981184:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1784191899.674502:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 21 rpc_version 21 00000020:00100000:1.0:1784191899.674549:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784191899.674557:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af23bc66300 x1870858827981440/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784191899.674586:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23bc66300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827981440:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784191899.674676:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191899.676031:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23392ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1784191899.676515:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827981440 00000100:00100000:0.0:1784191899.676539:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827981440 00000100:00100000:0.0:1784191899.676630:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:0.0:1784191899.676641:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23bc67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:165486:x1870858827981440:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784191899.677143:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23bc67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:165486:x1870858827981440:12345-0@lo:1000:osp_up0-1.0 Request processed in 501us (2464us total) trans 34359738831 rc 0/0 00000100:00100000:0.0:1784191899.677153:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:3.0:1784191899.677764:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23bc66300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827981440:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1784191899.677787:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 22 rpc_version 22 00000020:00100000:3.0:1784191899.677820:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784191899.677829:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af10fb62d80 x1870858827981696/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191899.677863:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827981696:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784191899.677930:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191899.678010:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af106955840 going to sleep for 11 seconds 00000100:00100000:1.0:1784191899.678172:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827981696 00000100:00100000:1.0:1784191899.678181:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827981696 00000100:00100000:1.0:1784191899.678290:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1784191899.678301:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:165486:x1870858827981696:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784191899.678575:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:165486:x1870858827981696:12345-0@lo:1000:osp_up0-1.0 Request processed in 276us (644us total) trans 34359738832 rc 0/0 00000100:00100000:1.0:1784191899.678597:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:3.0:1784191899.678752:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827981696:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1784191899.678763:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 23 rpc_version 23 00000020:00100000:3.0:1784191899.678780:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784191899.678785:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af10fb61c00 x1870858827981952/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191899.678801:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb61c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827981952:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784191899.678834:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191899.679264:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23f5923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191899.680846:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827981952 00000100:00100000:0.0:1784191899.680872:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827981952 00000100:00100000:0.0:1784191899.680965:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1784191899.680978:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:165486:x1870858827981952:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784191899.681639:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:165486:x1870858827981952:12345-0@lo:1000:osp_up0-1.0 Request processed in 659us (2799us total) trans 34359738833 rc 0/0 00000100:00100000:0.0:1784191899.681650:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1784191899.681883:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb61c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827981952:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1784191899.681903:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 24 rpc_version 24 00000020:00100000:2.0:1784191899.681932:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784191899.681941:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af10f4edf80 x1870858827982208/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784191899.681967:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4edf80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827982208:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784191899.682031:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191899.682057:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10673fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784191899.682432:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827982208 00000100:00100000:0.0:1784191899.682441:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827982208 00000100:00100000:0.0:1784191899.682500:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1784191899.682512:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:165486:x1870858827982208:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784191899.682722:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:165486:x1870858827982208:12345-0@lo:1000:osp_up0-1.0 Request processed in 179us (657us total) trans 34359738834 rc 0/0 00000100:00100000:0.0:1784191899.682731:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1784191899.682777:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4edf80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827982208:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1784191899.682786:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 25 rpc_version 25 00000020:00100000:0.0:1784191899.682803:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784191899.682809:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af22de45500 x1870858827982464/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784191899.682825:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827982464:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784191899.683849:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191899.683984:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af227a6ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1784191899.684151:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827982464 00000100:00100000:2.0:1784191899.684160:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827982464 00000100:00100000:2.0:1784191899.684206:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:2.0:1784191899.684214:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:165486:x1870858827982464:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784191899.684393:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:165486:x1870858827982464:12345-0@lo:1000:osp_up0-1.0 Request processed in 178us (548us total) trans 34359738835 rc 0/0 00000100:00100000:2.0:1784191899.684418:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:0.0:1784191899.684642:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827982464:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1784191899.684656:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 26 rpc_version 26 00000020:00100000:0.0:1784191899.684679:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784191899.684713:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af22de44e00 x1870858827982720/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784191899.684735:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de44e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827982720:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784191899.684775:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191899.684793:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af202d61480 going to sleep for 11 seconds 00000100:00100000:2.0:1784191899.685006:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827982720 00000100:00100000:2.0:1784191899.685073:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827982720 00000100:00100000:2.0:1784191899.685114:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:2.0:1784191899.685121:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:165486:x1870858827982720:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784191899.685224:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:165486:x1870858827982720:12345-0@lo:1000:osp_up0-1.0 Request processed in 104us (448us total) trans 34359738836 rc 0/0 00000100:00100000:2.0:1784191899.685254:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1784191899.686174:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de44e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827982720:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1784191899.686190:0:165486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af23d0e2540 version 27 rpc_version 27 00000020:00100000:0.0:1784191899.686214:0:165486:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784191899.686221:0:165486:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af20d5c9500 x1870858827982976/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784191899.686242:0:165486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827982976:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784191899.686303:0:165486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191899.686337:0:165486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2257ce3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191899.687189:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827982976 00000100:00100000:2.0:1784191899.687203:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827982976 00000100:00100000:2.0:1784191899.687266:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:2.0:1784191899.687277:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:165486:x1870858827982976:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784191899.688221:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:165486:x1870858827982976:12345-0@lo:1000:osp_up0-1.0 Request processed in 940us (1912us total) trans 34359738837 rc 0/0 00000100:00100000:2.0:1784191899.688235:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:0.0:1784191899.688562:0:165486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:165486:1870858827982976:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1784191899.725578:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191900.760452:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784191900.893746:0:166675:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1784191900.893835:0:166675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10e24b800/0xfeec3c2dc5a4745f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a47466 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.893855:0:166675:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10e24b800/0xfeec3c2dc5a4745f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a47466 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.893863:0:166675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10e24b800/0xfeec3c2dc5a4745f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a47466 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.893871:0:166675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.116@tcp lock: ffff8af10e24b800/0xfeec3c2dc5a4745f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a47466 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.893910:0:166675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784191900.893916:0:166675:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784191900.893953:0:166675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784191900.893959:0:166675:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784191900.893965:0:166675:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784191900.894002:0:166675:0:(import.c:65:import_set_state_nolock()) ffff8af10f79b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1784191900.895174:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784191900.895186:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.116@tcp lock: ffff8af10e24b800/0xfeec3c2dc5a4745f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a47466 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191900.895218:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10e24b800 already unused, calling callback (ffffffffc1384c20) 10000000:00010000:3.0:1784191900.895222:0:160901:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.116@tcp lock: ffff8af10e24b800/0xfeec3c2dc5a4745f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a47466 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191900.895233:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af10e24b800/0xfeec3c2dc5a4745f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a47466 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784191900.895240:0:160901:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af10e24b800/0xfeec3c2dc5a4745f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a47466 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784191900.895246:0:160901:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784191900.895249:0:160901:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784191900.895252:0:160901:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1784191900.895296:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.116@tcp lock: ffff8af10e24b800/0xfeec3c2dc5a4745f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a47466 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191900.895302:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784191900.895332:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.116@tcp lock: ffff8af10e24b800/0xfeec3c2dc5a4745f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a47466 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191900.895340:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af10e24b800/0xfeec3c2dc5a4745f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a47466 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191900.895355:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191900.895357:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191900.895359:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191900.895368:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784191900.895435:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827983232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191900.895532:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191900.895676:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827983232 00000100:00100000:1.0:1784191900.895686:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827983232 00000100:00100000:1.0:1784191900.895791:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784191900.895802:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858827983232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191900.895820:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191900.895841:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af10e24a800/0xfeec3c2dc5a47466 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4745f expref: 24 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.895869:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191900.895919:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:106499:x1870858827983232:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191900.895927:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784191900.895976:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827983232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191900.897890:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:106498:1870858827983104:0@lo:39:umount.0 00000100:00100000:0.0:1784191900.897983:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191900.901144:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827983104 00000100:00100000:3.0:1784191900.901177:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827983104 00000100:00100000:2.0:1784191900.901395:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:2.0:1784191900.901410:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106498:x1870858827983104:12345-0@lo:39:umount.0 00000020:00000080:2.0:1784191900.901463:0:158666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a47490 00000100:00080000:2.0:1784191900.901479:0:158666:0:(import.c:65:import_set_state_nolock()) ffff8af20c67e800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1784191900.901652:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:106498:x1870858827983104:12345-0@lo:39:umount.0 Request processed in 244us (3667us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191900.901661:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000020:00000080:2.0:1784191900.901675:0:158666:0:(genops.c:906:class_export_put()) final put ffff8af23f5f8800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1784191900.901774:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784191900.901945:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10f79b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784191900.901977:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:106498:1870858827983104:0@lo:39:umount.0 00000020:00000080:0.0:1784191900.903371:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23f5f8800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784191900.903503:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af20c67e800 for lustre-MDT0000 00000100:00080000:1.0:1784191900.904799:0:166675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784191900.904808:0:166675:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784191900.904818:0:166675:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784191900.906257:0:166675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10e24b000/0xfeec3c2dc5a473b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a473b7 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.906283:0:166675:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10e24b000/0xfeec3c2dc5a473b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a473b7 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.906292:0:166675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10e24b000/0xfeec3c2dc5a473b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a473b7 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.906299:0:166675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.116@tcp lock: ffff8af10e24b000/0xfeec3c2dc5a473b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a473b7 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.906330:0:166675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784191900.906336:0:166675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4abf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4abfd expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.906342:0:166675:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4abf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4abfd expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.906367:0:166675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4abf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4abfd expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.906373:0:166675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4abf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4abfd expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.906416:0:166675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784191900.906442:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784191900.906450:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.116@tcp lock: ffff8af10e24b000/0xfeec3c2dc5a473b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a473b7 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.906457:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10e24b000 already unused, calling callback (ffffffffc1384c20) 10000000:00010000:1.0:1784191900.906462:0:160901:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.116@tcp lock: ffff8af10e24b000/0xfeec3c2dc5a473b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a473b7 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.906472:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af10e24b000/0xfeec3c2dc5a473b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a473b7 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191900.906480:0:160901:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af10e24b000/0xfeec3c2dc5a473b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a473b7 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191900.906486:0:160901:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784191900.906489:0:160901:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1784191900.906539:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.116@tcp lock: ffff8af10e24b000/0xfeec3c2dc5a473b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a473b7 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.906545:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191900.906573:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.116@tcp lock: ffff8af10e24b000/0xfeec3c2dc5a473b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a473b7 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.906592:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af10e24b000/0xfeec3c2dc5a473b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a473b7 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.906613:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191900.906617:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4abf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4abfd expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.906623:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9e00 already unused, calling callback (ffffffffc1384c20) 10000000:00010000:1.0:1784191900.908840:0:160901:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4abf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4abfd expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.908884:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4abf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4abfd expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191900.908893:0:160901:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4abf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4abfd expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191900.908900:0:160901:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1784191900.908904:0:160901:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1784191900.908908:0:160901:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1784191900.908987:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4abf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4abfd expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.908994:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191900.909016:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4abf6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4abfd expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.909039:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4abf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4abfd expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.909096:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191900.909100:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191900.909103:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191900.909144:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827983360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191900.909252:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191900.909346:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784191900.909354:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827983488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191900.909378:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191900.909440:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827983360 00000100:00100000:1.0:1784191900.909452:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827983360 00000100:00100000:1.0:1784191900.909521:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827983488 00000100:00100000:1.0:1784191900.909524:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827983488 00000100:00100000:1.0:1784191900.909548:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784191900.909558:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858827983360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191900.909576:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191900.909595:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af233126200/0xfeec3c2dc5a473b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a473b0 expref: 24 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.909610:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191900.909781:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784191900.909797:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:106501:x1870858827983488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784191900.909806:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191900.909817:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af20cd7f800/0xfeec3c2dc5a4abfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4abf6 expref: 23 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191900.909828:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784191900.909911:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191900.910260:0:166675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af242072800/0xfeec3c2dc5a47b6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a47b74 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191900.910273:0:166675:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af242072800/0xfeec3c2dc5a47b6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a47b74 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191900.910281:0:166675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af242072800/0xfeec3c2dc5a47b6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a47b74 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191900.910289:0:166675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.116@tcp lock: ffff8af242072800/0xfeec3c2dc5a47b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a47b74 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191900.910336:0:166675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191900.910346:0:166675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10e24ae00/0xfeec3c2dc5a473a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a473a9 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191900.910353:0:166675:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10e24ae00/0xfeec3c2dc5a473a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a473a9 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191900.910359:0:166675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10e24ae00/0xfeec3c2dc5a473a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a473a9 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191900.910365:0:166675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.116@tcp lock: ffff8af10e24ae00/0xfeec3c2dc5a473a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a473a9 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191900.910378:0:166675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1784191900.910392:0:166675:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1784191900.910399:0:166675:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1784191900.910454:0:166675:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1784191900.910461:0:166675:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1784191900.910468:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1784191900.910475:0:166675:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1784191900.911041:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784191900.911051:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.116@tcp lock: ffff8af242072800/0xfeec3c2dc5a47b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a47b74 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191900.911060:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af242072800 already unused, calling callback (ffffffffc1384c20) 10000000:00010000:3.0:1784191900.911064:0:158654:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.116@tcp lock: ffff8af242072800/0xfeec3c2dc5a47b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a47b74 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191900.911074:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af242072800/0xfeec3c2dc5a47b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a47b74 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784191900.911081:0:158654:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af242072800/0xfeec3c2dc5a47b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a47b74 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784191900.911088:0:158654:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784191900.911091:0:158654:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784191900.911093:0:158654:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784191900.911131:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.116@tcp lock: ffff8af242072800/0xfeec3c2dc5a47b6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a47b74 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191900.911138:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784191900.911282:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.116@tcp lock: ffff8af242072800/0xfeec3c2dc5a47b6d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a47b74 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191900.911290:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af242072800/0xfeec3c2dc5a47b6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a47b74 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191900.911309:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784191900.911313:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.116@tcp lock: ffff8af10e24ae00/0xfeec3c2dc5a473a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a473a9 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191900.911332:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10e24ae00 already unused, calling callback (ffffffffc1384c20) 10000000:00010000:3.0:1784191900.911335:0:158654:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.116@tcp lock: ffff8af10e24ae00/0xfeec3c2dc5a473a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a473a9 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191900.911343:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af10e24ae00/0xfeec3c2dc5a473a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a473a9 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784191900.911349:0:158654:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af10e24ae00/0xfeec3c2dc5a473a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a473a9 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784191900.911355:0:158654:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1784191900.911357:0:158654:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1784191900.911359:0:158654:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1784191900.911376:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.116@tcp lock: ffff8af10e24ae00/0xfeec3c2dc5a473a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a473a9 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191900.911390:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784191900.911398:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.116@tcp lock: ffff8af10e24ae00/0xfeec3c2dc5a473a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a473a9 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191900.911404:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af10e24ae00/0xfeec3c2dc5a473a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a473a9 expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191900.911415:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191900.911417:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191900.911419:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191900.911963:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827983744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191900.917884:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:106501:x1870858827983488:12345-0@lo:103:ldlm_bl.0 Request processed in 8077us (8487us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191900.917906:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000004:00000080:2.0:1784191900.918366:0:166675:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:0.0:1784191900.920263:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827983616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191900.920377:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191900.920528:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827983488:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784191900.920564:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191900.922279:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827983616 00000100:00100000:2.0:1784191900.922299:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827983616 00000100:00100000:2.0:1784191900.922405:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784191900.922419:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:106499:x1870858827983616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191900.922443:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191900.922474:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af10d532c00/0xfeec3c2dc5a47b74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a47b6d expref: 22 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191900.922511:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191900.922605:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:106499:x1870858827983616:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (2229us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191900.922615:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784191900.922813:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827983616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191900.932743:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+20:106501:x1870858827983360:12345-0@lo:103:ldlm_bl.0 Request processed in 23168us (23473us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191900.932767:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784191900.932844:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827983360:0@lo:103:ldlm_bl.0 00000001:00080000:0.0:1784191900.934393:0:158645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738837 is committed 00000020:00000080:3.0:1784191900.934888:0:166675:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1784191900.934904:0:166675:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8af1086f3000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784191900.934937:0:166675:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8af1017ce000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 34359738837 stale:0 00000020:00080000:3.0:1784191900.934947:0:166675:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8af109052000 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 192.168.204.16@tcp 90 (0 0 86) 0 0 0 0: 0000000000000000 34359738827 stale:0 00000020:00080000:3.0:1784191900.934952:0:166675:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8af10c369000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784191900.934957:0:166675:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8af23d859000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784191900.934963:0:166675:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff8af107b74d40) has exports, disconnecting them 00000020:00080000:3.0:1784191900.934969:0:166675:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8af1086f3000), last request at 1784191862 00000020:00000080:3.0:1784191900.934979:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4aa13 00000100:00080000:3.0:1784191900.934993:0:166675:0:(import.c:65:import_set_state_nolock()) ffff8af1086f2800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784191900.935069:0:166675:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af1086f3000): rc 0 00000020:00000080:3.0:1784191900.935073:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af1086f3000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1784191900.935087:0:166675:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8af1017ce000), last request at 1784191862 00000020:00000080:3.0:1784191900.935092:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4a99c 00000100:00080000:3.0:1784191900.935096:0:166675:0:(import.c:65:import_set_state_nolock()) ffff8af1017cb800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1784191900.935221:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af1086f3000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00100000:2.0:1784191900.935235:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1784191900.935293:0:165779:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af1086f2800 for lustre-MDT0000 00000100:00100000:2.0:1784191900.935295:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827983744 00000100:00100000:2.0:1784191900.935308:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827983744 00000100:00100000:2.0:1784191900.935376:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784191900.935399:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+20:106500:x1870858827983744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191900.935423:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191900.935450:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af233126e00/0xfeec3c2dc5a473a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a473a2 expref: 20 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191900.935470:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191900.935509:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+19:106500:x1870858827983744:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191900.935517:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784191900.935583:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210f4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827983744:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191900.942672:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191900.942914:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784191900.943812:0:166675:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af1017ce000): rc 0 00000020:00000080:1.0:1784191900.943819:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af1017ce000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:1.0:1784191900.943851:0:166675:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.16@tcp (ffff8af109052000), last request at 1784191899 00000020:00000080:1.0:1784191900.943887:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4a558 00000020:00010000:1.0:1784191900.943906:0:166675:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8af109052000: total 1 00000100:00080000:1.0:1784191900.943912:0:166675:0:(import.c:65:import_set_state_nolock()) ffff8af109055000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784191900.943937:0:166675:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.16@tcp (ffff8af109052000): rc 0 00000020:00080000:1.0:1784191900.943941:0:166675:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8af10c369000), last request at 1784191898 00000020:00000080:1.0:1784191900.943944:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a478b8 00000100:00080000:1.0:1784191900.943957:0:166675:0:(import.c:65:import_set_state_nolock()) ffff8af10c368000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784191900.944008:0:166675:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af10c369000): rc 0 00000020:00000080:1.0:1784191900.944010:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af10c369000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1784191900.944016:0:166675:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8af23d859000), last request at 1784191898 00000020:00000080:1.0:1784191900.944019:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4762d 00000100:00080000:1.0:1784191900.944027:0:166675:0:(import.c:65:import_set_state_nolock()) ffff8af23d85f800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1784191900.944041:0:158654:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8af109052000: total 2 00010000:00010000:1.0:1784191900.944045:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784191900.944217:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af1017ce000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1784191900.944290:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10c369000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1784191900.944318:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af1017cb800 for lustre-MDT0000 00000020:00000080:2.0:1784191900.944328:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af10c368000 for lustre-MDT0000 00010000:00010000:1.0:1784191900.944373:0:158654:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8af109052000, canceled 0 locks, left on hash table 86. 00010000:00010000:1.0:1784191900.944449:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7d200/0xfeec3c2dc5a4cae3 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1b4 expref: 87 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944491:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9400/0xfeec3c2dc5a4b343 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8bc expref: 86 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944512:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b000/0xfeec3c2dc5a4ba89 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb6a expref: 85 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944540:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf400/0xfeec3c2dc5a4c533 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf84 expref: 84 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944560:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24b400/0xfeec3c2dc5a4d0a8 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x51:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c39e expref: 83 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944593:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200030200/0xfeec3c2dc5a4c91c lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c105 expref: 82 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944616:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5e00/0xfeec3c2dc5a4b8c2 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8babb expref: 81 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944635:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69400/0xfeec3c2dc5a4c36c lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bed5 expref: 80 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944656:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341a400/0xfeec3c2dc5a4ce16 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2ef expref: 79 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944677:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533600/0xfeec3c2dc5a4b6fb lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba0c expref: 78 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944736:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031200/0xfeec3c2dc5a4c1a5 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be26 expref: 77 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944760:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6600/0xfeec3c2dc5a4cc4f lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c240 expref: 76 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944777:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4200/0xfeec3c2dc5a4b534 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b95d expref: 75 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944793:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874bc00/0xfeec3c2dc5a4bfde lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd77 expref: 74 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944825:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4800/0xfeec3c2dc5a4ca88 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c191 expref: 73 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944845:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4ce71 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c312 expref: 72 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944860:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4a00/0xfeec3c2dc5a4be17 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcc8 expref: 71 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944876:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e800/0xfeec3c2dc5a4c8c1 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0e2 expref: 70 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944893:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10e24b600/0xfeec3c2dc5a4d01c lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c390 expref: 69 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944915:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7da00/0xfeec3c2dc5a4ccaa lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c263 expref: 68 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944937:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e800/0xfeec3c2dc5a4bc50 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc19 expref: 67 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944955:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cde00/0xfeec3c2dc5a4c6fa lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c033 expref: 66 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.944974:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533c00/0xfeec3c2dc5a4b6a0 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9e9 expref: 65 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945006:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cca00/0xfeec3c2dc5a4c14a lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be03 expref: 64 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945023:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5c00/0xfeec3c2dc5a4cbf4 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c21d expref: 63 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945042:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ee00/0xfeec3c2dc5a4b4d2 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b93a expref: 62 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945060:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5800/0xfeec3c2dc5a4bf83 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd54 expref: 61 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945077:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7a00/0xfeec3c2dc5a4ca2d lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c16e expref: 60 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945093:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5e00/0xfeec3c2dc5a4bdbc lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bca5 expref: 59 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945110:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c200/0xfeec3c2dc5a4c866 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0bf expref: 58 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945130:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4a00/0xfeec3c2dc5a4bbf5 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbf6 expref: 57 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945145:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd600/0xfeec3c2dc5a4c69f lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c010 expref: 56 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191900.945321:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191900.945436:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3a00/0xfeec3c2dc5a4ba2e lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb47 expref: 55 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945454:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd69c00/0xfeec3c2dc5a4c4d8 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf61 expref: 54 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945470:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7e00/0xfeec3c2dc5a4cf82 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c37b expref: 53 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945487:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5400/0xfeec3c2dc5a4b867 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba98 expref: 52 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945502:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7400/0xfeec3c2dc5a4c311 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8beb2 expref: 51 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945519:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4cdbb lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2cc expref: 50 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945538:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3ea00/0xfeec3c2dc5a4bd61 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc82 expref: 49 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945556:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af200031600/0xfeec3c2dc5a4c80b lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c09c expref: 48 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945575:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7e000/0xfeec3c2dc5a4b3d6 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8e6 expref: 47 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945606:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4000/0xfeec3c2dc5a4b7b1 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba52 expref: 46 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945625:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5000/0xfeec3c2dc5a4b48c lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b925 expref: 45 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945643:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fa00/0xfeec3c2dc5a4bb9a lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbd3 expref: 44 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945660:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874a800/0xfeec3c2dc5a4c644 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfed expref: 43 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.945679:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e4600/0xfeec3c2dc5a4b5ea lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9a3 expref: 42 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191900.945836:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191900.945992:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6000/0xfeec3c2dc5a4b9d3 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb24 expref: 41 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.946010:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db3800/0xfeec3c2dc5a4b327 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8b5 expref: 40 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.946024:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68a00/0xfeec3c2dc5a4c47d lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf3e expref: 39 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.946041:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2035d7800/0xfeec3c2dc5a4cf27 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c358 expref: 38 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.946074:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2c00/0xfeec3c2dc5a4b80c lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba75 expref: 37 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.946091:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f400/0xfeec3c2dc5a4d062 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x50:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c397 expref: 36 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.946111:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfe00/0xfeec3c2dc5a4c2b6 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be8f expref: 35 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.946128:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341b200/0xfeec3c2dc5a4cd60 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2a9 expref: 34 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1784191900.946843:0:166675:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af23d859000): rc 0 00000020:00000080:0.0:1784191900.946849:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af23d859000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1784191900.946882:0:166675:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb46d0f77fae0 00000100:00080000:0.0:1784191900.946912:0:166675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784191900.946919:0:166675:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474836522 gen 4 00000020:00000080:2.0:1784191900.947228:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23d859000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784191900.947304:0:165779:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af23d85f800 for lustre-MDT0000 00000100:00080000:0.0:1784191900.948145:0:166675:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00010000:00010000:1.0:1784191900.948338:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7e00/0xfeec3c2dc5a4bd06 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc5f expref: 33 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.948405:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073400/0xfeec3c2dc5a4b645 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9c6 expref: 32 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.948433:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cce00/0xfeec3c2dc5a4c0ef lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bde0 expref: 31 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.948456:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af223b7c000/0xfeec3c2dc5a4cb99 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1fa expref: 30 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.948485:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d7200/0xfeec3c2dc5a4bb3f lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbb0 expref: 29 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.948529:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f600/0xfeec3c2dc5a4bf28 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd31 expref: 28 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.948550:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68200/0xfeec3c2dc5a4c9d2 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c14b expref: 27 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.948568:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5000/0xfeec3c2dc5a4b978 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb01 expref: 26 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.948587:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cd200/0xfeec3c2dc5a4c422 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf1b expref: 25 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.948608:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5a00/0xfeec3c2dc5a4b389 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8d1 expref: 24 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.948627:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d4600/0xfeec3c2dc5a4cecc lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c335 expref: 23 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.948647:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ae00/0xfeec3c2dc5a4be72 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bceb expref: 22 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.948666:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af242073c00/0xfeec3c2dc5a4b454 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b910 expref: 21 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.948684:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4c25b lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be6c expref: 20 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784191900.948842:0:166675:0:(import.c:65:import_set_state_nolock()) ffff8af10f422800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784191900.948908:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1010b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827983872:0@lo:39:umount.0 00000100:00100000:2.0:1784191900.949019:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191900.949124:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827983872 00000100:00100000:3.0:1784191900.949135:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827983872 00000100:00100000:3.0:1784191900.949221:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1784191900.949232:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106498:x1870858827983872:12345-0@lo:39:umount.0 00000020:00000080:3.0:1784191900.949270:0:161739:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4ac04 00000100:00080000:3.0:1784191900.949280:0:161739:0:(import.c:65:import_set_state_nolock()) ffff8af23ea11800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784191900.949305:0:161739:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 25769803808 00010000:00010000:1.0:1784191900.949733:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7ec00/0xfeec3c2dc5a4cd05 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c286 expref: 19 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.949754:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b6d6e00/0xfeec3c2dc5a4bcab lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc3c expref: 18 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.949771:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20cd7fc00/0xfeec3c2dc5a4c755 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c056 expref: 17 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.949789:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b8600/0xfeec3c2dc5a4c094 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdbd expref: 16 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.949808:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4cb3e lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1d7 expref: 15 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.949828:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874aa00/0xfeec3c2dc5a4bae4 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb8d expref: 14 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.949849:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af110db2e00/0xfeec3c2dc5a4c58e lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfa7 expref: 13 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.949865:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc000/0xfeec3c2dc5a4becd lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd0e expref: 12 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.949885:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf600/0xfeec3c2dc5a4c977 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c128 expref: 11 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.949922:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1019d5200/0xfeec3c2dc5a4b91d lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bade expref: 10 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.949941:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bf800/0xfeec3c2dc5a4c3c7 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bef8 expref: 9 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.949958:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af23dd68c00/0xfeec3c2dc5a4c7b0 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c079 expref: 8 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.949973:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10b5e5200/0xfeec3c2dc5a4b35f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8c3 expref: 7 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.949993:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d533000/0xfeec3c2dc5a4b756 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba2f expref: 6 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.950010:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1010bfc00/0xfeec3c2dc5a4c200 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be49 expref: 5 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.950028:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10f2cc400/0xfeec3c2dc5a4c5e9 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfca expref: 4 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.950048:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20341ba00/0xfeec3c2dc5a4b58f lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b980 expref: 3 pid: 158667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.950066:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10874ac00/0xfeec3c2dc5a4c039 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd9a expref: 2 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191900.950098:0:158654:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8af109052000, canceled 86 locks, left on hash table 0. 00000100:00080000:0.0:1784191900.968724:0:166675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784191900.968736:0:166675:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836548 gen 3 00000004:00080000:0.0:1784191900.968761:0:166675:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1784191900.968865:0:166675:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1784191900.968912:0:166675:0:(import.c:65:import_set_state_nolock()) ffff8af233c57800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1784191900.968933:0:166675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784191900.968937:0:166675:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869239 gen 3 00000004:00080000:0.0:1784191900.968946:0:166675:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1784191900.969010:0:166675:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1784191900.969024:0:166675:0:(import.c:65:import_set_state_nolock()) ffff8af10c3a8800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1784191900.969085:0:166675:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8af107b74d40) has no exports 00000100:00100000:3.0:1784191900.972542:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+3:106498:x1870858827983872:12345-0@lo:39:umount.0 Request processed in 23292us (23504us total) trans 25769803809 rc 0/0 00000100:00100000:3.0:1784191900.972566:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00080000:2.0:1784191900.972603:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10f422800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784191900.972613:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1010b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827983872:0@lo:39:umount.0 00010000:00010000:3.0:1784191900.972724:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191900.972800:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1010b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827984000:0@lo:9:umount.0 00000100:00100000:2.0:1784191900.972887:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191900.972933:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827984128:0@lo:9:umount.0 00000100:00100000:2.0:1784191900.972963:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1784191900.973611:0:166675:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x240000401:0x1:0x0] first idx 8, last_idx 10 00000040:00080000:0.0:1784191900.973658:0:166675:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x240000401:0x1:0x0] first idx 9, last_idx 10 00000020:00080000:0.0:1784191900.973882:0:166675:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8af107b74d40) has no exports 00000100:00100000:3.0:1784191900.983551:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827984000 00000100:00100000:3.0:1784191900.983596:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827984000 00000100:00100000:3.0:1784191900.983719:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827984128 00000100:00100000:3.0:1784191900.983724:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827984128 00000100:00100000:3.0:1784191900.983762:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1784191900.983779:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:106498:x1870858827984000:12345-0@lo:9:umount.0 00000020:00000080:3.0:1784191900.983824:0:162387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a47753 00000100:00080000:3.0:1784191900.983836:0:162387:0:(import.c:65:import_set_state_nolock()) ffff8af2372e1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784191900.983902:0:162387:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836569 00000100:00100000:3.0:1784191900.984163:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+2:106498:x1870858827984000:12345-0@lo:9:umount.0 Request processed in 378us (11262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191900.984174:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1784191900.984195:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1784191900.984203:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:106498:x1870858827984128:12345-0@lo:9:umount.0 00000020:00000080:3.0:1784191900.984216:0:162387:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a478f7 00000100:00080000:3.0:1784191900.984221:0:162387:0:(import.c:65:import_set_state_nolock()) ffff8af23d0ce800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784191900.984247:0:162387:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869260 00000100:00100000:3.0:1784191900.984336:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+2:106498:x1870858827984128:12345-0@lo:9:umount.0 Request processed in 133us (11371us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191900.984343:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00010000:00010000:3.0:1784191900.984371:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191900.984379:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784191900.984437:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af233c57800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784191900.984455:0:106498:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784191900.984458:0:106498:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784191900.984463:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1010b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827984000:0@lo:9:umount.0 00000100:00080000:3.0:1784191900.984489:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10c3a8800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784191900.984494:0:106498:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784191900.984496:0:106498:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784191900.984511:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827984128:0@lo:9:umount.0 00000100:00080000:2.0:1784191900.984667:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784191900.984673:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1784191901.036058:0:158654:0:(genops.c:906:class_export_put()) final put ffff8af109052000/62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00010000:00010000:1.0:1784191901.036108:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191901.036112:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191901.036116:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784191901.036334:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af109052000/62ac9b09-d016-4ae6-b1b1-fe120a3abe0a for lustre-MDT0000 00000020:00000080:3.0:1784191901.036445:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af109055000 for lustre-MDT0000 00000020:00000080:0.0:1784191901.117222:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a473fd 00000020:00000080:0.0:1784191901.117255:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af233c52800/lustre-QMT0000_UUID 00000020:01000000:0.0:1784191901.117434:0:166675:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1784191901.120395:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784191901.120424:0:166675:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784191901.120432:0:166675:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8af23e68b380) has no exports 00000020:00000080:1.0:1784191901.120682:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af233c52800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1784191901.122105:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a473f6 00000020:00000080:3.0:1784191901.122125:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af10f422000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784191901.122219:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784191901.122235:0:166675:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784191901.122239:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af10f420000/lustre-QMT0000_UUID 00000020:00000080:3.0:1784191901.122243:0:166675:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10f420000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1784191901.122259:0:166675:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1784191901.122567:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10f422000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1784191901.122643:0:166675:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8af10ff2cd20 - data ffff8af211884af8/ffff8af110fd7000 00000020:01000000:3.0:1784191901.122885:0:166675:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8af10db0f600 - data ffff8af206623948/ffff8af237c51c00 00000100:00080000:3.0:1784191901.230796:0:166675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784191901.230810:0:166675:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474836522 gen 5 00000100:00100000:3.0:1784191901.230871:0:166675:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8af1010b9c00 x1870858827983872/t25769803809(25769803809) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784191910 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784191901.230924:0:166675:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1784191901.241051:0:166675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784191901.241916:0:166675:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836548 gen 4 00000004:00080000:3.0:1784191901.241953:0:166675:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784191901.241957:0:166675:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784191901.244849:0:158689:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784191901.244862:0:158689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 45 count 1 00000040:00080000:0.0:1784191901.244887:0:158689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 8 count 2 00000100:00080000:3.0:1784191901.245969:0:166675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784191901.245978:0:166675:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869239 gen 4 00000004:00080000:3.0:1784191901.246042:0:166675:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784191901.246046:0:166675:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784191901.261596:0:158691:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784191901.261612:0:158691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x22:0x0] index 40 count 1 00000040:00080000:2.0:1784191901.261642:0:158691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 8 count 2 00000020:00000080:0.0:1784191901.263206:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a473c5 00000020:00000080:0.0:1784191901.263223:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af206b38800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784191901.264164:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a473da 00000020:00000080:0.0:1784191901.264177:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af20c678000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784191901.264183:0:166675:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1784191901.264189:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784191901.264200:0:166675:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784191901.264205:0:166675:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8af107b73380) has no exports 00000020:00000080:2.0:1784191901.264435:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af206b38800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784191901.264447:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af20c678000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1784191901.265570:0:166675:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1784191901.265591:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4743c 00000020:00000080:0.0:1784191901.265602:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af10c3a8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784191901.265672:0:166675:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784191901.265681:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784191901.265706:0:166675:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784191901.265711:0:166675:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8af20d7d8000) has no exports 00000020:00000080:0.0:1784191901.265720:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a47435 00000020:00000080:0.0:1784191901.265725:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af10cc40000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784191901.268000:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10c3a8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1784191901.272530:0:166675:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784191901.272543:0:166675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784191901.272550:0:166675:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869239 gen 5 00000004:00080000:0.0:1784191901.272560:0:166675:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784191901.272563:0:166675:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784191901.274439:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10cc40000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784191901.274908:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784191901.274927:0:166675:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784191901.274939:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a47427 00000020:00000080:0.0:1784191901.274952:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af20d91c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784191901.276626:0:165779:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af10c3a8800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1784191901.276645:0:165779:0:(genops.c:906:class_export_put()) final put ffff8af20d91f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784191901.276648:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af20d91f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1784191901.276657:0:165779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784191901.279266:0:166675:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784191901.279280:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784191901.279360:0:166675:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784191901.279367:0:166675:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8af227700000) has no exports 00000020:00000080:0.0:1784191901.279388:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a47420 00000020:00000080:0.0:1784191901.279400:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af233c50000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784191901.279787:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af20d91c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1784191901.279804:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af233c50000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1784191901.280406:0:166675:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784191901.280414:0:166675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784191901.280419:0:166675:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836548 gen 5 00000004:00080000:0.0:1784191901.280429:0:166675:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784191901.280433:0:166675:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784191901.280497:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784191901.280507:0:166675:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1784191901.280531:0:166675:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1784191901.280549:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a47412 00000020:00000080:0.0:1784191901.280557:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af20d91d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784191901.280564:0:166675:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1784191901.280567:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784191901.280573:0:166675:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784191901.280576:0:166675:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff8af23e688000) has no exports 00000020:00000080:0.0:1784191901.280583:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4740b 00000020:00000080:0.0:1784191901.280586:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af10f426800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784191901.281159:0:165779:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af233c57800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1784191901.281169:0:165779:0:(genops.c:906:class_export_put()) final put ffff8af20d91e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784191901.281172:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af20d91e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1784191901.281178:0:165779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784191901.281281:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af20d91d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1784191901.281287:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10f426800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784191901.336856:0:166675:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1784191901.336870:0:166675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784191901.336877:0:166675:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 21474836522 gen 6 00000100:00100000:2.0:1784191901.336887:0:166675:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784191901.336983:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784191901.337001:0:166675:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784191901.337042:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784191901.337080:0:166675:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784191901.337089:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af206b3b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784191901.337097:0:166675:0:(genops.c:865:class_export_destroy()) destroying export ffff8af206b3b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1784191901.337122:0:166675:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784191901.337318:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a473e1 00000020:00000080:2.0:1784191901.337330:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af20c67c800/lustre-MDD0000_UUID 00000020:01000000:2.0:1784191901.337337:0:166675:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1784191901.337342:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784191901.337348:0:166675:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784191901.337354:0:166675:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8af1077a0000) has no exports 00000020:00000080:2.0:1784191901.337391:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784191901.337396:0:166675:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1784191901.337401:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a473e8 00000020:00000080:2.0:1784191901.337406:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af20c679800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784191901.337418:0:166675:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af202ccc000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1784191901.337423:0:166675:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af202ccc000 3 00000020:01000004:2.0:1784191901.337427:0:166675:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8af202ccc000 from lustre-MDT0000 00000020:00000080:2.0:1784191901.337455:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784191901.337459:0:166675:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1784191901.337462:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af206b3d000/lustre-MDT0000_UUID 00000020:00000080:2.0:1784191901.337464:0:166675:0:(genops.c:865:class_export_destroy()) destroying export ffff8af206b3d000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1784191901.337473:0:166675:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1784191901.337506:0:166675:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1784191901.337511:0:166675:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1784191901.337515:0:166675:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1784191901.337517:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784191901.337520:0:166675:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1784191901.337531:0:166675:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8af1086f4000 9424fd8d-001c-4ed5-89e0-95e0bf2d2c97 192.168.204.16@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784191901.337539:0:166675:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8af20d954000 f7a68c78-a3ad-4338-9a3e-dc550a0e9642 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784191901.337544:0:166675:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8af227704d40) has exports, disconnecting them 00000020:00080000:2.0:1784191901.337549:0:166675:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.16@tcp (ffff8af1086f4000), last request at 1784191842 00000020:00000080:2.0:1784191901.337582:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4a535 00000020:00010000:2.0:1784191901.337586:0:166675:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8af1086f4000: total 2 00000100:00080000:2.0:1784191901.337592:0:166675:0:(import.c:65:import_set_state_nolock()) ffff8af1086f7800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784191901.337611:0:166675:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.16@tcp (ffff8af1086f4000): rc 0 00000020:00080000:2.0:1784191901.337614:0:166675:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8af20d954000), last request at 1784191621 00000020:00000080:2.0:1784191901.337622:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4738d 00000020:00010000:2.0:1784191901.337625:0:166675:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8af20d954000: total 2 00000100:00080000:2.0:1784191901.337627:0:166675:0:(import.c:65:import_set_state_nolock()) ffff8af20d950800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784191901.337634:0:166675:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af20d954000): rc 0 00000020:00080000:2.0:1784191901.337639:0:166675:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8af227704d40) has no exports 00000020:00010000:3.0:1784191901.337850:0:160901:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8af1086f4000: total 2 00010000:00010000:3.0:1784191901.337905:0:160901:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8af1086f4000, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1784191901.337943:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af223b7ce00/0xfeec3c2dc5a4a543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5c1 expref: 5 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191901.337968:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af110db3000/0xfeec3c2dc5a4abe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b6b6 expref: 4 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191901.337981:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af20cd7fe00/0xfeec3c2dc5a4a53c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5ba expref: 3 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191901.337994:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af20cd7f000/0xfeec3c2dc5a4a551 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b5f9 expref: 2 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191901.338003:0:160901:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8af1086f4000, canceled 4 locks, left on hash table 0. 00000020:00000080:3.0:1784191901.338023:0:160901:0:(genops.c:906:class_export_put()) final put ffff8af1086f4000/9424fd8d-001c-4ed5-89e0-95e0bf2d2c97 00000020:00010000:3.0:1784191901.338029:0:160901:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8af20d954000: total 3 00010000:00010000:3.0:1784191901.338045:0:160901:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8af20d954000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1784191901.338061:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af20341a800/0xfeec3c2dc5a475ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a475e7 expref: 14 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191901.338075:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af20341b800/0xfeec3c2dc5a47b58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a47b51 expref: 13 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191901.338104:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af233126000/0xfeec3c2dc5a47879 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a47872 expref: 12 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191901.338116:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af10de3f800/0xfeec3c2dc5a4a9fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a9f7 expref: 11 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191901.338128:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af10e24a000/0xfeec3c2dc5a474ac lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a474a5 expref: 10 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191901.338141:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af233127600/0xfeec3c2dc5a47618 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a47611 expref: 9 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191901.338155:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af20341ac00/0xfeec3c2dc5a4739b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a47394 expref: 8 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191901.338166:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af10e24aa00/0xfeec3c2dc5a478a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4789c expref: 7 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191901.338177:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af242072000/0xfeec3c2dc5a47b4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a47b43 expref: 6 pid: 158659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191901.338191:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af233127400/0xfeec3c2dc5a4a933 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a92c expref: 5 pid: 158660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191901.338203:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af110db2000/0xfeec3c2dc5a4a9f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a9e9 expref: 4 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191901.338219:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af110db2400/0xfeec3c2dc5a4a941 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4a93a expref: 3 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191901.338245:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af10de3f400/0xfeec3c2dc5a4abef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4abe8 expref: 2 pid: 158658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191901.338257:0:160901:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8af20d954000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1784191901.338270:0:160901:0:(genops.c:906:class_export_put()) final put ffff8af20d954000/f7a68c78-a3ad-4338-9a3e-dc550a0e9642 00010000:00010000:3.0:1784191901.338277:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191901.338279:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191901.338281:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191901.338289:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784191901.338316:0:165779:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af10f422800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1784191901.338327:0:165779:0:(genops.c:906:class_export_put()) final put ffff8af233c56800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784191901.338330:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af233c56800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1784191901.338345:0:165779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784191901.338411:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af20c67c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1784191901.338417:0:165779:0:(genops.c:906:class_export_put()) final put ffff8af20c67a000/lustre-MDD0000_UUID 00000020:00000080:3.0:1784191901.338419:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af20c67a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1784191901.338423:0:165779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1784191901.338453:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af20c679800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784191901.338457:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af1086f4000/9424fd8d-001c-4ed5-89e0-95e0bf2d2c97 for MGS 00000020:00000080:3.0:1784191901.338501:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af20d954000/f7a68c78-a3ad-4338-9a3e-dc550a0e9642 for MGS 00000020:00000080:3.0:1784191901.338514:0:165779:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af1086f7800 for MGS 00000020:00000080:3.0:1784191901.338518:0:165779:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af20d950800 for MGS 00000100:00100000:0.0:1784191901.339821:0:158660:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8af105a83a00:158660] 2 exiting: rc = 0 00000100:00100000:0.0:1784191901.340084:0:158659:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8af105a83e00:158659] 1 exiting: rc = 0 00000100:00100000:0.0:1784191901.340175:0:158658:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8af110eb9a00:158658] 0 exiting: rc = 1 00000100:00100000:2.0:1784191901.345165:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345180:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345187:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345194:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345203:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345211:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345220:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345227:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345234:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345242:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345248:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345254:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345261:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345266:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345273:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345278:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345284:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345290:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345501:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345511:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345517:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345525:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345531:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345558:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345566:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345572:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345579:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345586:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345594:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345602:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345609:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.345615:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346037:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346044:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346052:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346059:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346066:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346072:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346079:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346086:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346093:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346099:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346106:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346114:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346121:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346759:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346767:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346777:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346785:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346793:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346800:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346807:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346814:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346820:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346826:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346832:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346842:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346850:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346874:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346881:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346888:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346894:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346899:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784191901.346906:0:166675:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1784191901.349823:0:166675:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8af10491a060 - data ffff8af2245dd948/ffff8af1019d0c00 00000020:01000000:3.0:1784191901.349999:0:166675:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8af20299b420 - data ffff8af2245ad360/ffff8af23b246c00 00000020:00000080:3.0:1784191901.350763:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a47371 00000020:00000080:3.0:1784191901.350779:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af10f702000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1784191901.350802:0:166675:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af202ccc000 from MGS, refs=2 00000020:01000004:3.0:1784191901.350821:0:166675:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af202ccc000 2 00000020:01000004:3.0:1784191901.350826:0:166675:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8af202ccc000 from MGS 00000020:00000080:3.0:1784191901.350858:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784191901.350867:0:166675:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1784191901.350871:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af2199f2000/MGS 00000020:00000080:3.0:1784191901.350875:0:166675:0:(genops.c:865:class_export_destroy()) destroying export ffff8af2199f2000/MGS for MGS 00000020:01000000:3.0:1784191901.350885:0:166675:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1784191901.350998:0:166675:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1784191901.351004:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784191901.351010:0:166675:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784191901.351023:0:166675:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8af105945000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784191901.351031:0:166675:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff8af2277019c0) has exports, disconnecting them 00000020:00080000:3.0:1784191901.351037:0:166675:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8af105945000), last request at 1784191621 00000020:00000080:3.0:1784191901.351042:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a47474 00000020:00080000:3.0:1784191901.351054:0:166675:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af105945000): rc 0 00000020:00000080:2.0:1784191901.351495:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10f702000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784191901.351737:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af105945000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1784191901.352759:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af105945000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1784191901.353774:0:166675:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1784191901.353784:0:166675:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784191901.353790:0:166675:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784191901.353799:0:166675:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784191901.353838:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af10f79b800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1784191901.354024:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784191901.354037:0:166675:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1784191901.354044:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af10f79d000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1784191901.354048:0:166675:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10f79d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1784191901.354056:0:166675:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1784191901.354197:0:166675:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af202ccc000 1 00000020:00000080:2.0:1784191901.354204:0:166675:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a47363 00000020:00000080:2.0:1784191901.354214:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af202ccc800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1784191901.354225:0:166675:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1784191901.354233:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af202ccc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784191901.354242:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784191901.354247:0:166675:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784191901.354252:0:166675:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8af227703380) has no exports 00000020:00000080:2.0:1784191901.573276:0:166675:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784191901.573294:0:166675:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1784191901.573301:0:166675:0:(genops.c:906:class_export_put()) final put ffff8af202ccb000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784191901.573307:0:166675:0:(genops.c:865:class_export_destroy()) destroying export ffff8af202ccb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1784191901.573314:0:166675:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1784191901.573509:0:166675:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8af202ccf800 00000020:02000400:2.0:1784191901.574019:0:166675:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1784191901.772920:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191902.803410:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191903.244798:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784191903.244827:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827984256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784191903.244920:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191903.244982:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827984256 00000100:00100000:1.0:1784191903.244991:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827984256 00000100:00100000:1.0:1784191903.245065:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1784191903.245077:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23e5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827984256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784191903.245122:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1585152 granted 59987904 pending 651264 free 70430720 avail 63262720 00000100:00100000:1.0:1784191903.245189:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23e5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827984256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191903.245197:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1784191903.245262:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827984256:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784191903.245479:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191903.245721:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784191903.245735:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827984384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191903.245780:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191903.245826:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827984384 00000100:00100000:0.0:1784191903.245830:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827984384 00000100:00100000:0.0:1784191903.245860:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:0.0:1784191903.245866:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10d29ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:106501:x1870858827984384:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1784191903.245873:0:158670:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784191903.245905:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10d29ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:106501:x1870858827984384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 38us (124us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784191903.245911:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:02020000:0.0:1784191903.245937:0:106501:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:2.0:1784191903.251452:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827984512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784191903.251568:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191903.251658:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827984512 00000100:00100000:2.0:1784191903.251669:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827984512 00000100:00100000:2.0:1784191903.251768:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1784191903.251780:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827984512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784191903.251826:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3907584 granted 60450752 pending 815104 free 70823936 avail 63655936 00000100:00100000:2.0:1784191903.251887:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858827984512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191903.251895:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:2.0:1784191903.251926:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784191903.253143:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858827984512:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784191903.255950:0:106501:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784191903.255960:0:106501:0:(import.c:65:import_set_state_nolock()) ffff8af1093a8800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784191903.255966:0:106501:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784191903.255974:0:106501:0:(import.c:65:import_set_state_nolock()) ffff8af1093a8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784191903.255989:0:106501:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5482 00000100:00080000:0.0:1784191903.256002:0:106501:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8af1093a8800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:0.0:1784191903.268987:0:106501:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af10d29d180 x1870858827984640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784191903.272520:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858827984640:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1784191903.272836:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191903.273555:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827984640 00000100:00100000:3.0:1784191903.273569:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827984640 00000100:00100000:3.0:1784191903.273710:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:3.0:1784191903.273720:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:106498:x1870858827984640:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1784191903.273751:0:161739:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784191903.273839:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:106498:x1870858827984640:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 119us (1004us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784191903.273848:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00080000:3.0:1784191903.273908:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af1093a8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784191903.273915:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784191903.273919:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858827984640:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1784191903.760129:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858827984896:0@lo:400:kworker.0 00000100:00100000:0.0:1784191903.760250:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191903.760300:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827985408:0@lo:400:kworker.0 00000100:00100000:0.0:1784191903.760344:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191903.760389:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784191903.760396:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:106501:1870858827985024:0@lo:400:kworker.0 00000100:00100000:0.0:1784191903.760427:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191903.760472:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827984896 00000100:00100000:0.0:1784191903.760489:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827984896 00000100:00100000:0.0:1784191903.760548:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827985408 00000100:00100000:0.0:1784191903.760552:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827985408 00000100:00100000:0.0:1784191903.760570:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827985024 00000100:00100000:0.0:1784191903.760573:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827985024 00000100:00100000:0.0:1784191903.760632:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1784191903.760647:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:106501:x1870858827985024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191903.760766:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:106501:x1870858827985024:12345-0@lo:400:kworker.0 Request processed in 121us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191903.760775:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1784191903.760800:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:0.0:1784191903.760805:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:106501:x1870858827984896:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1784191903.760812:0:158667:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784191903.760842:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:106501:x1870858827984896:12345-0@lo:400:kworker.0 Request processed in 35us (593us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784191903.760873:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:0.0:1784191903.760887:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:0.0:1784191903.760891:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:106501:x1870858827985408:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1784191903.760896:0:158667:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784191903.760920:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:106501:x1870858827985408:12345-0@lo:400:kworker.0 Request processed in 27us (591us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784191903.760926:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00080000:0.0:1784191903.760953:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784191903.760994:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:106501:1870858827985024:0@lo:400:kworker.0 00000100:00080000:0.0:1784191903.761008:0:106501:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784191903.761015:0:106501:0:(import.c:65:import_set_state_nolock()) ffff8af23d85c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784191903.761020:0:106501:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784191903.761027:0:106501:0:(import.c:65:import_set_state_nolock()) ffff8af23d85c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784191903.761032:0:106501:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5271 00000100:00080000:0.0:1784191903.761039:0:106501:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8af23d85c000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:0.0:1784191903.761069:0:106501:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af10ec82d80 x1870858827985536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784191903.761089:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858827984896:0@lo:400:kworker.0 00000100:00080000:0.0:1784191903.761101:0:106501:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784191903.761104:0:106501:0:(import.c:65:import_set_state_nolock()) ffff8af23ea15000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784191903.761107:0:106501:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784191903.761110:0:106501:0:(import.c:65:import_set_state_nolock()) ffff8af23ea15000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784191903.761114:0:106501:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5482 00000100:00080000:0.0:1784191903.761124:0:106501:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8af23ea15000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:0.0:1784191903.761137:0:106501:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af10ec81880 x1870858827985664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784191903.761148:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858827985408:0@lo:400:kworker.0 00000100:00100000:3.0:1784191903.761297:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827984768:0@lo:400:kworker.0 00000400:00000100:3.0:1784191903.761355:0:106500:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870858827984768 offset 0 length 224: 4 00000100:00100000:3.0:1784191903.761399:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858827985280:0@lo:400:kworker.0 00000100:00100000:3.0:1784191903.761429:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191903.761460:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784191903.761466:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858827985152:0@lo:400:kworker.0 00000100:00100000:3.0:1784191903.761491:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191903.761523:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827985280 00000100:00100000:3.0:1784191903.761528:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827985280 00000100:00100000:3.0:1784191903.761569:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827985152 00000100:00100000:3.0:1784191903.761572:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827985152 00000100:00100000:3.0:1784191903.761583:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1784191903.761589:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858827985280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191903.761634:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858827985280:12345-0@lo:400:kworker.0 Request processed in 45us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191903.761641:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1784191903.761657:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:3.0:1784191903.761661:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:106500:x1870858827985152:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784191903.761666:0:164531:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784191903.761716:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:106500:x1870858827985152:12345-0@lo:400:kworker.0 Request processed in 53us (222us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784191903.761723:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:3.0:1784191903.761748:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:106498:1870858827985536:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1784191903.761778:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191903.761798:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:106498:1870858827985664:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1784191903.761821:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191903.761864:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827985536 00000100:00100000:3.0:1784191903.761878:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827985536 00000100:00100000:3.0:1784191903.761893:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827985664 00000100:00100000:3.0:1784191903.761896:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827985664 00000100:00100000:3.0:1784191903.761905:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:3.0:1784191903.761910:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:106498:x1870858827985536:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1784191903.761934:0:161504:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784191903.761967:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:106498:x1870858827985536:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 56us (188us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784191903.761974:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:3.0:1784191903.761986:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:3.0:1784191903.761990:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:106498:x1870858827985664:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1784191903.761998:0:161504:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784191903.762023:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:106498:x1870858827985664:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 32us (202us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784191903.762030:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00080000:3.0:1784191903.762044:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784191903.762066:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23d85c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784191903.762071:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784191903.762074:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:106498:1870858827985536:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1784191903.762083:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23ea15000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784191903.762086:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784191903.762089:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:106498:1870858827985664:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1784191903.762120:0:106500:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784191903.762124:0:106500:0:(import.c:65:import_set_state_nolock()) ffff8af10c36a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784191903.762127:0:106500:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784191903.762138:0:106500:0:(import.c:65:import_set_state_nolock()) ffff8af10c36a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784191903.762142:0:106500:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5287 00000100:00080000:3.0:1784191903.762148:0:106500:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8af10c36a000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:3.0:1784191903.762170:0:106500:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af104c79880 x1870858827985792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191903.762189:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858827985152:0@lo:400:kworker.0 00000100:00100000:3.0:1784191903.762205:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858827985280:0@lo:400:kworker.0 00000100:00100000:3.0:1784191903.762226:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:106498:1870858827985792:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1784191903.762252:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191903.762276:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827985792 00000100:00100000:3.0:1784191903.762280:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827985792 00000100:00100000:3.0:1784191903.762296:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:3.0:1784191903.762301:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:106498:x1870858827985792:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1784191903.762312:0:161504:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784191903.762357:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:106498:x1870858827985792:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 54us (105us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784191903.762364:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00080000:3.0:1784191903.762385:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10c36a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784191903.762389:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784191903.762392:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:106498:1870858827985792:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:3.0:1784191903.773056:0:160977:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784191903.773070:0:160977:0:(genops.c:906:class_export_put()) final put ffff8af23d0c8000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1784191903.773104:0:160977:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869260 is committed 00000020:00000080:0.0:1784191903.773533:0:123300:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23d0c8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1784191903.773728:0:123300:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af23d0ce800 for lustre-OST0001 00000001:00100000:1.0:1784191903.785362:0:160160:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784191903.785377:0:160160:0:(genops.c:906:class_export_put()) final put ffff8af2372e7000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1784191903.785411:0:160160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836569 is committed 00000020:00000080:0.0:1784191903.785939:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af2372e7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784191903.786000:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af2372e1000 for lustre-OST0000 00010000:00010000:1.0:1784191903.819894:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1784191904.612828:0:106493:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.16@tcp portal 26 match 1870858812470272 offset 0 length 224: 4 00000100:00100000:0.0:1784191904.612884:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191904.615754:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191904.615798:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191904.616177:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191904.616221:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812470400 00000100:00100000:0.0:1784191904.616373:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812470400 00000100:00100000:0.0:1784191904.616439:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812470528 00000100:00100000:0.0:1784191904.616443:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812470528 00000100:00100000:0.0:1784191904.616506:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 370 00000100:00100000:0.0:1784191904.616522:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812470528:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191904.616728:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812470528:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 211us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191904.616736:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 370 00000100:00100000:0.0:1784191904.616758:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 777 00000100:00100000:0.0:1784191904.616764:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:69111:x1870858812470400:12345-192.168.204.16@tcp:400:kworker.0 00000020:00080000:0.0:1784191904.616771:0:161504:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.16@tcp 00000100:00100000:0.0:1784191904.616798:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:69111:x1870858812470400:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 34us (1057us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784191904.616819:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 777 00000100:00100000:0.0:1784191904.616847:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812470784 00000100:00100000:0.0:1784191904.616852:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812470784 00000100:00100000:0.0:1784191904.616882:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812470656 00000100:00100000:0.0:1784191904.616885:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812470656 00000100:00100000:0.0:1784191904.616905:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 186 00000100:00100000:0.0:1784191904.616911:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69110:x1870858812470784:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191904.616938:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69110:x1870858812470784:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 28us (4056us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191904.616945:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 186 00000100:00100000:0.0:1784191904.616956:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 187 00000100:00100000:0.0:1784191904.616961:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:69109:x1870858812470656:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191904.616983:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:69109:x1870858812470656:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 22us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191904.616989:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 187 00000100:00080000:0.0:1784191904.617009:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784191904.617013:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784191904.617016:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191904.663232:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191904.666478:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812470912 00000100:00100000:2.0:1784191904.666499:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812470912 00000100:00100000:2.0:1784191904.666582:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 778 00000100:00100000:2.0:1784191904.666594:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:69108:x1870858812470912:12345-192.168.204.16@tcp:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1784191904.666632:0:158665:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784191904.666770:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:69108:x1870858812470912:12345-192.168.204.16@tcp:38:ptlrpcd_00_02.0 Request processed in 175us (3565us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784191904.666780:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 778 00010000:00010000:0.0:1784191904.843985:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784191905.816609:0:165481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1784191905.816633:0:165481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769803809 is committed 00000020:00000080:0.0:1784191905.816641:0:165481:0:(genops.c:906:class_export_put()) final put ffff8af23ea13000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784191905.817979:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23ea13000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1784191905.818078:0:165779:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af23ea11800 for lustre-MDT0001 00010000:00010000:3.0:1784191905.868327:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191906.900536:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191907.916025:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191908.363908:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784191908.363932:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827985920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784191908.364007:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191908.364148:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827985920 00000100:00100000:1.0:1784191908.364179:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827985920 00000100:00100000:1.0:1784191908.364261:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1784191908.364272:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827985920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784191908.364313:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1585152 granted 59336640 pending 0 free 70430720 avail 63262720 00000100:00100000:1.0:1784191908.364372:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827985920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191908.364381:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:0.0:1784191908.364570:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784191908.364739:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827985920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784191908.368671:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784191908.368711:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827986048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784191908.368784:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191908.368839:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827986048 00000100:00100000:3.0:1784191908.368846:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827986048 00000100:00100000:3.0:1784191908.368915:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1784191908.368924:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827986048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784191908.368956:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3907584 granted 59635648 pending 0 free 70823936 avail 63655936 00000100:00100000:3.0:1784191908.369002:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827986048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191908.369009:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1784191908.369052:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827986048:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784191908.370724:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784191908.880642:0:165779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784191908.880649:0:165779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784191908.880653:0:165779:0:(import.c:65:import_set_state_nolock()) ffff8af23d85c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784191908.880661:0:165779:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5523 00000100:00080000:3.0:1784191908.880667:0:165779:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784191908.880674:0:165779:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8af23d85c000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:3.0:1784191908.880713:0:165779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af104c7a300 x1870858827986304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784191908.880780:0:165779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784191908.880784:0:165779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784191908.880786:0:165779:0:(import.c:65:import_set_state_nolock()) ffff8af10c36a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784191908.880789:0:165779:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5523 00000100:00080000:3.0:1784191908.880792:0:165779:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784191908.880796:0:165779:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8af10c36a000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:3.0:1784191908.880808:0:165779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af23310a680 x1870858827986560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784191908.880824:0:165779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784191908.880827:0:165779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784191908.880829:0:165779:0:(import.c:65:import_set_state_nolock()) ffff8af1093a8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784191908.880833:0:165779:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5523 00000100:00080000:3.0:1784191908.880836:0:165779:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784191908.880840:0:165779:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8af1093a8800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:3.0:1784191908.880851:0:165779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af233109500 x1870858827986816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784191908.880871:0:165779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784191908.880874:0:165779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784191908.880875:0:165779:0:(import.c:65:import_set_state_nolock()) ffff8af23ea15000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784191908.880878:0:165779:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5523 00000100:00080000:3.0:1784191908.880880:0:165779:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784191908.880883:0:165779:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8af23ea15000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:3.0:1784191908.880892:0:165779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af233108e00 x1870858827987200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191908.880944:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827986176:0@lo:400:kworker.0 00000400:00000100:3.0:1784191908.881079:0:106500:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870858827986176 offset 0 length 224: 4 00000100:00100000:3.0:1784191908.881134:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827987072:0@lo:400:kworker.0 00000100:00100000:3.0:1784191908.881168:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191908.881197:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784191908.881203:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827986944:0@lo:400:kworker.0 00000100:00100000:3.0:1784191908.881224:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191908.881265:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:106498:1870858827986304:0@lo:38:kworker.0 00000100:00100000:3.0:1784191908.881292:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191908.881310:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:106498:1870858827986560:0@lo:38:kworker.0 00000100:00100000:3.0:1784191908.881329:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191908.881347:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858827986816:0@lo:38:kworker.0 00000100:00100000:3.0:1784191908.881369:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191908.881388:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:106498:1870858827987200:0@lo:38:kworker.0 00000100:00100000:3.0:1784191908.881408:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191908.881440:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:106501:1870858827986432:0@lo:400:kworker.0 00000100:00100000:3.0:1784191908.881465:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191908.881489:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784191908.881495:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827986688:0@lo:400:kworker.0 00000100:00100000:3.0:1784191908.881518:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191908.881549:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827987072 00000100:00100000:3.0:1784191908.881555:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827987072 00000100:00100000:3.0:1784191908.881599:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827986944 00000100:00100000:3.0:1784191908.881603:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827986944 00000100:00100000:3.0:1784191908.883538:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1784191908.883551:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827987072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191908.883654:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827987072:12345-0@lo:400:kworker.0 Request processed in 105us (2485us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191908.883662:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1784191908.883682:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1784191908.883706:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827986944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191908.883739:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827986944:12345-0@lo:400:kworker.0 Request processed in 51us (2514us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191908.883745:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1784191908.883776:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827986304 00000100:00100000:3.0:1784191908.883784:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827986304 00000100:00100000:3.0:1784191908.883799:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827986560 00000100:00100000:3.0:1784191908.883802:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827986560 00000100:00100000:3.0:1784191908.883809:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827987200 00000100:00100000:3.0:1784191908.883811:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827987200 00000100:00100000:3.0:1784191908.883819:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827986432 00000100:00100000:3.0:1784191908.883822:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827986432 00000100:00100000:3.0:1784191908.883859:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827986688 00000100:00100000:3.0:1784191908.883863:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827986688 00000100:00100000:3.0:1784191908.883878:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1784191908.883883:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106501:x1870858827986432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191908.883936:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106501:x1870858827986432:12345-0@lo:400:kworker.0 Request processed in 52us (2469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191908.883942:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1784191908.883955:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1784191908.883961:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827986688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191908.883992:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827986688:12345-0@lo:400:kworker.0 Request processed in 31us (2473us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191908.884012:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1784191908.884024:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:3.0:1784191908.884028:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:106498:x1870858827986304:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784191908.884047:0:158666:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784191908.884082:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:106498:x1870858827986304:12345-0@lo:38:kworker.0 Request processed in 53us (2789us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784191908.884088:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:3.0:1784191908.884100:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:3.0:1784191908.884104:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:106498:x1870858827986560:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784191908.884113:0:158666:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784191908.884137:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:106498:x1870858827986560:12345-0@lo:38:kworker.0 Request processed in 32us (2806us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784191908.884143:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:3.0:1784191908.884153:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:3.0:1784191908.884157:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:106498:x1870858827987200:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784191908.884165:0:158666:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784191908.884190:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:106498:x1870858827987200:12345-0@lo:38:kworker.0 Request processed in 31us (2781us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784191908.884195:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:3.0:1784191908.884214:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827986816 00000100:00100000:3.0:1784191908.884218:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827986816 00000100:00100000:3.0:1784191908.884257:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:3.0:1784191908.884261:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:106498:x1870858827986816:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784191908.884270:0:158670:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784191908.884304:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:106498:x1870858827986816:12345-0@lo:38:kworker.0 Request processed in 41us (2934us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784191908.884310:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00080000:0.0:1784191908.884899:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191908.885277:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827986944:0@lo:400:kworker.0 00000100:00100000:3.0:1784191908.885293:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827987072:0@lo:400:kworker.0 00000100:00100000:3.0:1784191908.886081:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827986688:0@lo:400:kworker.0 00000100:00100000:3.0:1784191908.886097:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:106501:1870858827986432:0@lo:400:kworker.0 00000100:00080000:3.0:1784191908.886136:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23d85c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784191908.886142:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784191908.886146:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:106498:1870858827986304:0@lo:38:kworker.0 00000100:00080000:3.0:1784191908.886156:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10c36a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784191908.886159:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784191908.886162:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:106498:1870858827986560:0@lo:38:kworker.0 00000100:00080000:3.0:1784191908.886172:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af1093a8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784191908.886175:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784191908.886178:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858827986816:0@lo:38:kworker.0 00000100:00080000:3.0:1784191908.886190:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23ea15000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784191908.886194:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784191908.886197:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:106498:1870858827987200:0@lo:38:kworker.0 00010000:00010000:3.0:1784191908.946884:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1784191909.721057:0:106492:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.204.16@tcp portal 26 match 1870858812471040 offset 0 length 224: 4 00000100:00100000:2.0:1784191909.729884:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191909.729969:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191909.729998:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812471168 00000100:00100000:2.0:1784191909.730006:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812471168 00000100:00100000:2.0:1784191909.730044:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812471296 00000100:00100000:2.0:1784191909.730047:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812471296 00000100:00100000:2.0:1784191909.730086:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 373 00000100:00100000:2.0:1784191909.730096:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812471296:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191909.730832:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812471296:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 734us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191909.730842:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 373 00000100:00100000:2.0:1784191909.730865:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 782 00000100:00100000:2.0:1784191909.730869:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:69108:x1870858812471168:12345-192.168.204.16@tcp:38:kworker.0 00010000:00020000:2.0:1784191909.730889:0:158666:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784191909.730918:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:69108:x1870858812471168:12345-192.168.204.16@tcp:38:kworker.0 Request processed in 46us (1044us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784191909.730925:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 782 00000100:00080000:2.0:1784191909.730949:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784191909.733081:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191909.733171:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812471552 00000100:00100000:2.0:1784191909.733179:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812471552 00000100:00100000:2.0:1784191909.733263:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 190 00000100:00100000:2.0:1784191909.733274:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69109:x1870858812471552:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191909.733335:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69109:x1870858812471552:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 65us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191909.733342:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 190 00000100:00080000:0.0:1784191909.733656:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784191909.737817:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191909.740786:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812471424 00000100:00100000:2.0:1784191909.740819:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812471424 00000100:00100000:2.0:1784191909.740966:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 191 00000100:00100000:2.0:1784191909.740977:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:69110:x1870858812471424:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191909.741070:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:69110:x1870858812471424:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 94us (3261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191909.741078:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 191 00000100:00080000:0.0:1784191909.743559:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784191909.964540:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191910.987864:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191912.017643:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784191912.601365:0:167171:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784191912.601374:0:167171:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1784191912.601382:0:167171:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1784191912.601543:0:167171:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8af109051000 00000020:01000004:3.0:1784191912.601569:0:167171:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1784191912.601592:0:167171:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1784191912.601613:0:167171:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8af105a78000) 00000020:00000080:3.0:1784191912.601640:0:167171:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784191912.702918:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1784191912.703810:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1784191912.713799:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (16/1) registered 00100000:10000000:2.0:1784191912.717158:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1784191912.721516:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1784191912.723713:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1784191912.724666:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x56:0x0] (16/1) registered 00100000:10000000:3.0:1784191912.725181:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1784191912.725533:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x3f:0x0] (16/1) registered 00100000:10000000:3.0:1784191912.726077:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1784191912.726461:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1784191912.728454:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1784191912.730055:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x60:0x0] (16/1) registered 00100000:10000000:3.0:1784191912.731538:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x47:0x0] (16/1) registered 00100000:10000000:3.0:1784191912.734223:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x5d:0x0] (16/1) registered 00100000:10000000:3.0:1784191912.735962:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x54:0x0] (16/1) registered 00100000:10000000:3.0:1784191912.736446:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (16/1) registered 00100000:10000000:3.0:1784191912.736785:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x5e:0x0] (16/1) registered 00100000:10000000:3.0:1784191912.737116:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x4b:0x0] (16/1) registered 00100000:10000000:3.0:1784191912.737501:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1784191912.737870:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x62:0x0] (16/1) registered 00100000:10000000:3.0:1784191912.738074:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x4c:0x0] (16/1) registered 00100000:10000000:3.0:1784191912.738453:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1784191912.738831:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x55:0x0] (16/1) registered 00100000:10000000:3.0:1784191912.739368:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1784191912.740363:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1784191912.742558:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1784191912.743116:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x4e:0x0] (16/1) registered 00100000:10000000:3.0:1784191912.743753:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1784191912.744374:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x5f:0x0] (16/1) registered 00100000:10000000:3.0:1784191912.745233:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1784191912.745915:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1784191912.746356:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1784191912.746743:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1784191912.750961:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1784191912.751410:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1784191912.752439:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1784191912.755090:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1784191912.756227:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1784191912.757408:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1784191912.758429:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784191912.760389:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1784191912.762054:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1784191912.762566:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1784191912.763024:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1784191912.763233:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1784191912.770241:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1784191912.774359:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1784191912.775354:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1784191912.775904:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1784191912.776508:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1784191912.776878:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1784191912.777927:0:167171:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1784191912.779055:0:167171:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784191912.780900:0:167171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1784191912.780916:0:167171:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784191912.781809:0:167171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeec3c2dc5a4d11f 00000020:01000004:0.0:1784191912.781824:0:167171:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1784191912.781839:0:167171:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1784191912.781847:0:167171:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8af109051000 from MGS 00000020:01000004:0.0:1784191912.781851:0:167171:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1784191912.781866:0:167171:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8af20d7d99c0) 00000020:00000080:0.0:1784191912.781880:0:167171:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1784191912.781972:0:167171:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af109051000 from MGS, refs=2 00080000:01000000:0.0:1784191912.781978:0:167171:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784191912.781983:0:167171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeec3c2dc5a4d12d 00010000:00010000:0.0:1784191912.782183:0:167171:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1784191912.797447:0:167171:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1784191912.799058:0:167175:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1784191912.799113:0:167171:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1784191912.799179:0:167171:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784191912.800839:0:167171:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784191912.801148:0:167171:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784191912.802781:0:167171:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1784191912.802794:0:167171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1784191912.810849:0:167171:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1784191912.810870:0:167171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1784191912.811795:0:167171:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1784191912.811803:0:167171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1784191912.815063:0:167171:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1784191912.815093:0:167171:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1784191912.815095:0:167171:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.116@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1784191912.815099:0:167171:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.116@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:1.0:1784191912.815106:0:167171:0:(import.c:65:import_set_state_nolock()) ffff8af212f4c800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1784191912.815112:0:167171:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1784191912.830514:0:167171:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.116@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1784191912.830520:0:167171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1784191912.830528:0:167171:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8af10d29d180 x1870858827984768/t0(0) o400->MGC192.168.204.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784191919 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784191912.830560:0:167171:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8af104c7bb80 x1870858827986176/t0(0) o400->MGC192.168.204.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784191924 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1784191912.830570:0:167171:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1784191912.830573:0:167171:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1784191912.830592:0:167171:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1784191912.830595:0:167171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:2.0:1784191912.831352:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827986176:0@lo:400:kworker.0 00000100:00100000:2.0:1784191912.831374:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827984768:0@lo:400:kworker.0 10000000:01000000:1.0:1784191912.832879:0:167171:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1784191912.832902:0:167171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af23dd69800/0xfeec3c2dc5a474a5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xfeec3c2dc5a474ac expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191912.832916:0:167171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af23dd69800/0xfeec3c2dc5a474a5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xfeec3c2dc5a474ac expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191912.832923:0:167171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784191912.832947:0:167171:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784191912.832956:0:167171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af23dd69800/0xfeec3c2dc5a474a5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xfeec3c2dc5a474ac expref: -99 pid: 159394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.832974:0:167171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af23dd69000/0xfeec3c2dc5a47394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xfeec3c2dc5a4739b expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191912.832981:0:167171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af23dd69000/0xfeec3c2dc5a47394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xfeec3c2dc5a4739b expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191912.832986:0:167171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784191912.832990:0:167171:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784191912.832994:0:167171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af23dd69000/0xfeec3c2dc5a47394 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xfeec3c2dc5a4739b expref: -99 pid: 158644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.833002:0:167171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af10e24bc00/0xfeec3c2dc5a475e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xfeec3c2dc5a475ee expref: -99 pid: 160159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191912.833008:0:167171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af10e24bc00/0xfeec3c2dc5a475e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xfeec3c2dc5a475ee expref: -99 pid: 160159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191912.833013:0:167171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784191912.833035:0:167171:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784191912.833039:0:167171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af10e24bc00/0xfeec3c2dc5a475e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xfeec3c2dc5a475ee expref: -99 pid: 160159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.833048:0:167171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af10e24a400/0xfeec3c2dc5a47611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xfeec3c2dc5a47618 expref: -99 pid: 160159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191912.833055:0:167171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af10e24a400/0xfeec3c2dc5a47611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xfeec3c2dc5a47618 expref: -99 pid: 160159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191912.833060:0:167171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784191912.833063:0:167171:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784191912.833067:0:167171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af10e24a400/0xfeec3c2dc5a47611 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xfeec3c2dc5a47618 expref: -99 pid: 160159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.833076:0:167171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af10e24b200/0xfeec3c2dc5a47872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xfeec3c2dc5a47879 expref: -99 pid: 160976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191912.833082:0:167171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af10e24b200/0xfeec3c2dc5a47872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xfeec3c2dc5a47879 expref: -99 pid: 160976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191912.833086:0:167171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784191912.833089:0:167171:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784191912.833092:0:167171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af10e24b200/0xfeec3c2dc5a47872 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xfeec3c2dc5a47879 expref: -99 pid: 160976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.833100:0:167171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af10d532a00/0xfeec3c2dc5a4789c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xfeec3c2dc5a478a3 expref: -99 pid: 160976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191912.833106:0:167171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af10d532a00/0xfeec3c2dc5a4789c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xfeec3c2dc5a478a3 expref: -99 pid: 160976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191912.833121:0:167171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784191912.833125:0:167171:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784191912.833129:0:167171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af10d532a00/0xfeec3c2dc5a4789c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xfeec3c2dc5a478a3 expref: -99 pid: 160976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.833140:0:167171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af1019d5c00/0xfeec3c2dc5a4a93a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xfeec3c2dc5a4a941 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191912.833146:0:167171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af1019d5c00/0xfeec3c2dc5a4a93a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xfeec3c2dc5a4a941 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191912.833151:0:167171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784191912.833154:0:167171:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784191912.833167:0:167171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af1019d5c00/0xfeec3c2dc5a4a93a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xfeec3c2dc5a4a941 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.833176:0:167171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af1019d4000/0xfeec3c2dc5a4a9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xfeec3c2dc5a4a9fe expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191912.833182:0:167171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af1019d4000/0xfeec3c2dc5a4a9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xfeec3c2dc5a4a9fe expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191912.833187:0:167171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784191912.833190:0:167171:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784191912.833193:0:167171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af1019d4000/0xfeec3c2dc5a4a9f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xfeec3c2dc5a4a9fe expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.833204:0:167171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af110db2800/0xfeec3c2dc5a4abe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xfeec3c2dc5a4abef expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191912.833219:0:167171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af110db2800/0xfeec3c2dc5a4abe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xfeec3c2dc5a4abef expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191912.833223:0:167171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784191912.833226:0:167171:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784191912.833229:0:167171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af110db2800/0xfeec3c2dc5a4abe8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xfeec3c2dc5a4abef expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.833240:0:167171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af110db3200/0xfeec3c2dc5a4a92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xfeec3c2dc5a4a933 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191912.833246:0:167171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af110db3200/0xfeec3c2dc5a4a92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xfeec3c2dc5a4a933 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191912.833250:0:167171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1784191912.833254:0:167171:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784191912.833256:0:167171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af110db3200/0xfeec3c2dc5a4a92c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xfeec3c2dc5a4a933 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.833268:0:167171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af20341a000/0xfeec3c2dc5a47b43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xfeec3c2dc5a47b4a expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191912.833273:0:167171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af20341a000/0xfeec3c2dc5a47b43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xfeec3c2dc5a47b4a expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191912.833277:0:167171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784191912.833280:0:167171:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784191912.833283:0:167171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af20341a000/0xfeec3c2dc5a47b43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xfeec3c2dc5a47b4a expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.833301:0:167171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af242073e00/0xfeec3c2dc5a47b51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xfeec3c2dc5a47b58 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191912.833308:0:167171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af242073e00/0xfeec3c2dc5a47b51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xfeec3c2dc5a47b58 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191912.833313:0:167171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784191912.833316:0:167171:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784191912.833318:0:167171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af242073e00/0xfeec3c2dc5a47b51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xfeec3c2dc5a47b58 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.833326:0:167171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af10de3f200/0xfeec3c2dc5a4a9e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xfeec3c2dc5a4a9f0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191912.833332:0:167171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af10de3f200/0xfeec3c2dc5a4a9e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xfeec3c2dc5a4a9f0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191912.833337:0:167171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784191912.833340:0:167171:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784191912.833343:0:167171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af10de3f200/0xfeec3c2dc5a4a9e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xfeec3c2dc5a4a9f0 expref: -99 pid: 165480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784191912.833362:0:167171:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8af212f4c800 already not connected (conn 1, was 0): DISCONN 00000100:00080000:1.0:1784191912.833367:0:167171:0:(import.c:65:import_set_state_nolock()) ffff8af212f4c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784191912.833374:0:167171:0:(import.c:510:import_select_connection()) MGC192.168.204.116@tcp: connect to NID 0@lo last attempt 5241 00000100:00080000:1.0:1784191912.833381:0:167171:0:(import.c:624:import_select_connection()) MGC192.168.204.116@tcp: import ffff8af212f4c800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191912.833413:0:167171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af23e5b1180 x1870858827987328/t0(0) o250->MGC192.168.204.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784191912.833449:0:167171:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1784191912.833752:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106498:1870858827987328:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1784191912.833828:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191912.833906:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827987328 00000100:00100000:2.0:1784191912.833914:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827987328 00000100:00100000:2.0:1784191912.833952:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784191912.833959:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af206f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:106498:x1870858827987328:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1784191912.833985:0:167176:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from f7a68c78-a3ad-4338-9a3e-dc550a0e9642@0@lo t0 exp 0000000000000000 cur 5533 last 0 00000020:00000080:2.0:1784191912.834014:0:167176:0:(genops.c:1406:class_connect()) connect: client f7a68c78-a3ad-4338-9a3e-dc550a0e9642, cookie 0xfeec3c2dc5a4d134 00000100:00080000:2.0:1784191912.834145:0:167176:0:(import.c:65:import_set_state_nolock()) ffff8af10c3ac000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784191912.834212:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af206f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+5:106498:x1870858827987328:12345-0@lo:250:mount.lustre.0 Request processed in 251us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191912.834220:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784191912.834258:0:106498:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.116@tcp: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784191912.834266:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.116@tcp: connect to target with instance 0 00000100:00080000:2.0:1784191912.834273:0:106498:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1784191912.834277:0:106498:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1784191912.834280:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af212f4c800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1784191912.834289:0:106498:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1784191912.834306:0:106498:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1784191912.834312:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106498:1870858827987328:0@lo:250:mount.lustre.0 00000020:01000000:1.0:1784191912.834536:0:123300:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.116@tcp 10000000:01000000:1.0:1784191912.834552:0:123300:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1784191912.834555:0:123300:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784191912.834557:0:123300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784191912.834559:0:123300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784191912.834560:0:123300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784191912.834562:0:123300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784191912.834563:0:123300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784191912.834564:0:123300:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784191912.834566:0:123300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784191912.834567:0:123300:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784191912.834611:0:123300:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1784191912.834618:0:123300:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1784191912.834620:0:123300:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784191912.834621:0:123300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784191912.834622:0:123300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784191912.834623:0:123300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784191912.834624:0:123300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784191912.834625:0:123300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784191912.834626:0:123300:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784191912.834627:0:123300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784191912.834628:0:123300:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784191912.834640:0:123300:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1784191912.834644:0:123300:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1784191912.834646:0:123300:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784191912.834647:0:123300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784191912.834648:0:123300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784191912.834649:0:123300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784191912.834650:0:123300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784191912.834652:0:123300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784191912.834653:0:123300:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784191912.834654:0:123300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784191912.834655:0:123300:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784191912.834677:0:123300:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1784191912.834715:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784191912.834725:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827987712:0@lo:253:kworker.0 00000100:00100000:1.0:1784191912.834763:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784191912.834794:0:167171:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1784191912.834802:0:167171:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000100:00100000:2.0:1784191912.834932:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827987456:0@lo:253:kworker.0 00000100:00100000:2.0:1784191912.834965:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191912.834984:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784191912.834990:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827987584:0@lo:253:kworker.0 00000100:00100000:2.0:1784191912.835016:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191912.835042:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827987712 00000100:00100000:2.0:1784191912.835047:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827987712 00000100:00100000:2.0:1784191912.835068:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827987456 00000100:00100000:2.0:1784191912.835071:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827987456 00000100:00100000:2.0:1784191912.835081:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827987584 00000100:00100000:2.0:1784191912.835083:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827987584 00000100:00100000:2.0:1784191912.835093:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784191912.835099:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+7:106500:x1870858827987712:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1784191912.835134:0:167176:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:2.0:1784191912.835300:0:167180:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:1.0:1784191912.835544:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784191912.835551:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1014f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+7:106501:x1870858827987456:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1784191912.835566:0:167178:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000020:01000004:1.0:1784191912.835581:0:167171:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1784191912.835585:0:167171:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1784191912.835644:0:167171:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.116@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784191912.835675:0:167171:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.116@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1784191912.835678:0:167171:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784191912.835679:0:167171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784191912.835680:0:167171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784191912.835681:0:167171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784191912.835682:0:167171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784191912.835683:0:167171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784191912.835684:0:167171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 20000000:01000000:2.0:1784191912.835760:0:167176:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 37 00000020:01000004:1.0:1784191912.836392:0:167171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784191912.836396:0:167171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784191912.836397:0:167171:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784191912.836400:0:167171:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1784191912.836403:0:167171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784191912.836404:0:167171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784191912.836405:0:167171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784191912.836406:0:167171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784191912.836407:0:167171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784191912.836409:0:167171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784191912.836410:0:167171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784191912.836411:0:167171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784191912.836412:0:167171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784191912.836413:0:167171:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784191912.836448:0:167171:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1784191912.836462:0:167171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101684a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827987840:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784191912.836510:0:167171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191912.836553:0:167171:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af21fb973c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191912.836958:0:167179:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1784191912.836966:0:167179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1784191912.839034:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827987840 00000100:00100000:0.0:1784191912.839048:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827987840 00000100:00100000:3.0:1784191912.839811:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784191912.839823:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1014f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+8:106501:x1870858827987584:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1784191912.840036:0:167181:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784191912.843672:0:167182:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1784191912.843682:0:167182:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1784191912.843685:0:167182:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1784191912.843728:0:167182:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1784191912.844613:0:167182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1784191912.845138:0:167176:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784191912.845176:0:167176:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784191912.851282:0:167176:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784191912.851298:0:167176:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1784191912.853077:0:167180:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784191912.853086:0:167180:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:0.0:1784191912.853112:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+8:106500:x1870858827987712:12345-0@lo:253:kworker.0 Request processed in 18006us (18342us total) trans 0 rc 0/0 00010000:00010000:2.0:1784191912.853113:0:167180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8af1115b9c00/0xfeec3c2dc5a4d13b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191912.853125:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1784191912.853129:0:167180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af1115b9c00/0xfeec3c2dc5a4d13b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784191912.853152:0:167180:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000066470s 00010000:00010000:2.0:1784191912.853157:0:167180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af1115b9c00/0xfeec3c2dc5a4d13b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191912.853174:0:167180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af1115b9c00/0xfeec3c2dc5a4d13b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191912.853179:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1784191912.853181:0:167180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8af1115b9c00/0xfeec3c2dc5a4d13b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191912.853188:0:167180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8af1115b9c00/0xfeec3c2dc5a4d13b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191912.853190:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1014f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+7:167171:x1870858827987840:12345-0@lo:253:mount.lustre.0 00010000:00010000:2.0:1784191912.853195:0:167180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9c00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191912.853200:0:167180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8af1115b9c00/0xfeec3c2dc5a4d13b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191912.853207:0:167180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8af1115b9c00/0xfeec3c2dc5a4d13b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191912.853221:0:167180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8af1115b9c00/0xfeec3c2dc5a4d13b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191912.853228:0:167180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8af1115b9c00/0xfeec3c2dc5a4d13b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191912.853234:0:167180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af1115b9c00/0xfeec3c2dc5a4d13b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784191912.853252:0:167176:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784191912.853256:0:167176:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784191912.853259:0:167176:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1784191912.853266:0:167176:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1784191912.853719:0:167178:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000004:3.0:1784191912.854560:0:106500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1784191912.854565:0:106500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784191912.854567:0:106500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784191912.854568:0:106500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784191912.854569:0:106500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784191912.854571:0:106500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784191912.854572:0:106500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784191912.854574:0:106500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784191912.854575:0:106500:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1784191912.854580:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827987712:0@lo:253:kworker.0 00000100:00100000:0.0:1784191912.855049:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1014f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+7:167171:x1870858827987840:12345-0@lo:253:mount.lustre.0 Request processed in 1861us (18535us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191912.855058:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784191912.857435:0:167171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101684a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827987840:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784191912.857455:0:167171:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1784191912.857458:0:167171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784191912.857460:0:167171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784191912.857461:0:167171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784191912.857462:0:167171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784191912.857464:0:167171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784191912.857465:0:167171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784191912.857466:0:167171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784191912.857468:0:167171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784191912.857469:0:167171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784191912.857471:0:167171:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784191912.857505:0:167171:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8af109051000 from lustre-MDT0000 10000000:01000000:1.0:1784191912.857540:0:167171:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1784191912.857543:0:167171:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784191912.857553:0:167171:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8af109051000 10000000:01000000:1.0:1784191912.857557:0:167171:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784191912.857562:0:167171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8af109051000 10000000:01000000:1.0:1784191912.857565:0:167171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1784191912.857568:0:167171:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8af109051000 from 1 10000000:01000000:1.0:1784191912.857571:0:167171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784191912.857608:0:167171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10de3f200/0xfeec3c2dc5a4d142 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.857620:0:167171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af10de3f200/0xfeec3c2dc5a4d142 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.857630:0:167171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af10de3f200/0xfeec3c2dc5a4d142 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191912.857651:0:167171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101684a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827987968:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784191912.857774:0:167171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191912.857831:0:167171:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af21fb970c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191912.857961:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827987968 00000100:00100000:0.0:1784191912.857968:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827987968 00000100:00100000:0.0:1784191912.858009:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784191912.858018:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1014f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+7:167171:x1870858827987968:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784191912.858032:0:167179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191912.858048:0:167179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af20c0aa600/0xfeec3c2dc5a4d149 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d142 expref: -99 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191912.858071:0:167179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af20c0aa600/0xfeec3c2dc5a4d149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d142 expref: 8 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191912.858082:0:167179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af20c0aa600/0xfeec3c2dc5a4d149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d142 expref: 8 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191912.858091:0:167179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20c0aa600, rc 0) 00000100:00100000:0.0:1784191912.858137:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1014f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+8:167171:x1870858827987968:12345-0@lo:101:mount.lustre.0 Request processed in 121us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191912.858144:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784191912.858201:0:167171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101684a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827987968:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784191912.858225:0:167171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af10de3f200/0xfeec3c2dc5a4d142 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d149 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191912.858233:0:167171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af10de3f200/0xfeec3c2dc5a4d142 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d149 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784191912.858246:0:167171:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784191912.858265:0:167171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10de3f200/0xfeec3c2dc5a4d142 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d149 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191912.858273:0:167171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af10de3f200/0xfeec3c2dc5a4d142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d149 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784191912.858279:0:167171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784191912.858283:0:167171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784191912.858287:0:167171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8af109051000 10000000:01000000:2.0:1784191912.858291:0:167171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784191912.858295:0:167171:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1784191912.858297:0:167171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784191912.858314:0:167171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b9800/0xfeec3c2dc5a4d150 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191912.858321:0:167171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af1115b9800/0xfeec3c2dc5a4d150 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191912.858327:0:167171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af1115b9800/0xfeec3c2dc5a4d150 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191912.858354:0:167171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827988096:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784191912.858393:0:167171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191912.858483:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827988096 00000100:00100000:0.0:1784191912.858487:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827988096 00000100:00100000:0.0:1784191912.858505:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784191912.858511:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1017d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+8:167171:x1870858827988096:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784191912.858525:0:167179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191912.858535:0:167179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af20c0ab400/0xfeec3c2dc5a4d157 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d150 expref: -99 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191912.858547:0:167179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af20c0ab400/0xfeec3c2dc5a4d157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d150 expref: 9 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191912.858555:0:167179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af20c0ab400/0xfeec3c2dc5a4d157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d150 expref: 9 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191912.858561:0:167179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20c0ab400, rc 0) 00000100:00100000:0.0:1784191912.858585:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1017d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+9:167171:x1870858827988096:12345-0@lo:101:mount.lustre.0 Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191912.858591:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784191912.858598:0:167171:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af11171ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784191912.858612:0:167171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827988096:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784191912.858622:0:167171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af1115b9800/0xfeec3c2dc5a4d150 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d157 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191912.858630:0:167171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af1115b9800/0xfeec3c2dc5a4d150 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d157 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191912.858676:0:167171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827988224:0@lo:501:mount.lustre.0 20000000:01000000:0.0:1784191912.862561:0:167181:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784191912.862685:0:167178:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784191912.862717:0:167178:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1784191912.862772:0:167180:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784191912.862777:0:167180:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784191912.862797:0:167180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8af20c0aac00/0xfeec3c2dc5a4d15e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191912.862813:0:167180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af20c0aac00/0xfeec3c2dc5a4d15e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784191912.862823:0:167180:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000066470s 00010000:00010000:0.0:1784191912.862828:0:167180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af20c0aac00/0xfeec3c2dc5a4d15e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191912.862835:0:167180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af20c0aac00/0xfeec3c2dc5a4d15e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191912.862851:0:167180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8af20c0aac00/0xfeec3c2dc5a4d15e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191912.862869:0:167180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8af20c0aac00/0xfeec3c2dc5a4d15e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191912.862876:0:167180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20c0aac00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191912.862880:0:167180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8af20c0aac00/0xfeec3c2dc5a4d15e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191912.862887:0:167180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8af20c0aac00/0xfeec3c2dc5a4d15e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191912.862899:0:167180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8af20c0aac00/0xfeec3c2dc5a4d15e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191912.862907:0:167180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8af20c0aac00/0xfeec3c2dc5a4d15e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191912.862914:0:167180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af20c0aac00/0xfeec3c2dc5a4d15e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191912.865401:0:167171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191912.865494:0:167171:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af11171ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1784191912.865643:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827988224 00000100:00100000:1.0:1784191912.865653:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827988224 00000100:00100000:1.0:1784191912.865726:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784191912.865737:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+9:167171:x1870858827988224:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784191912.865912:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+10:167171:x1870858827988224:12345-0@lo:501:mount.lustre.0 Request processed in 176us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191912.865921:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784191912.866080:0:167171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827988224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784191912.866277:0:167171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827988352:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784191912.866509:0:167171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191912.866542:0:167171:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af11171ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191912.866611:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827988352 00000100:00100000:0.0:1784191912.866616:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827988352 00000100:00100000:0.0:1784191912.866653:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784191912.866661:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+10:167171:x1870858827988352:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784191912.870450:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1014f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+10:106501:x1870858827987456:12345-0@lo:253:kworker.0 Request processed in 34889us (35473us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191912.870467:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:0.0:1784191912.870679:0:106501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1784191912.870683:0:106501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784191912.870735:0:106501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784191912.870737:0:106501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784191912.870738:0:106501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784191912.870740:0:106501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784191912.870742:0:106501:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 20000000:01000000:2.0:1784191912.870743:0:167181:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00000020:01000004:0.0:1784191912.870744:0:106501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784191912.870754:0:106501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 20000000:01000000:2.0:1784191912.870765:0:167181:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1784191912.870898:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827987456:0@lo:253:kworker.0 20000000:01000000:1.0:1784191912.871125:0:167180:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784191912.871132:0:167180:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784191912.871155:0:167180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8af10de3f800/0xfeec3c2dc5a4d165 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.871180:0:167180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af10de3f800/0xfeec3c2dc5a4d165 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784191912.871189:0:167180:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000066470s 00010000:00010000:1.0:1784191912.871194:0:167180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af10de3f800/0xfeec3c2dc5a4d165 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.871201:0:167180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af10de3f800/0xfeec3c2dc5a4d165 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.871208:0:167180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8af10de3f800/0xfeec3c2dc5a4d165 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.871215:0:167180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8af10de3f800/0xfeec3c2dc5a4d165 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.871222:0:167180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3f800 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:1.0:1784191912.871234:0:167180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8af10de3f800/0xfeec3c2dc5a4d165 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.871243:0:167180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8af10de3f800/0xfeec3c2dc5a4d165 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.871257:0:167180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8af10de3f800/0xfeec3c2dc5a4d165 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.871266:0:167180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8af10de3f800/0xfeec3c2dc5a4d165 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191912.871273:0:167180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af10de3f800/0xfeec3c2dc5a4d165 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191912.872063:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1014f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+9:106501:x1870858827987584:12345-0@lo:253:kworker.0 Request processed in 32238us (37040us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191912.872074:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:1.0:1784191912.872194:0:106501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784191912.872197:0:106501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784191912.872198:0:106501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784191912.872200:0:106501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784191912.872201:0:106501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784191912.872202:0:106501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784191912.872204:0:106501:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784191912.872205:0:106501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784191912.872206:0:106501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784191912.872209:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858827987584:0@lo:253:kworker.0 00000100:00100000:0.0:1784191912.873944:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+8:167171:x1870858827988352:12345-0@lo:503:mount.lustre.0 Request processed in 7278us (7429us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191912.873956:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784191912.874236:0:167171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827988352:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784191912.881925:0:167183:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167183:1870858827988480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784191912.882022:0:167183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191912.882098:0:167183:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af11171e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191912.882146:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827988480 00000100:00100000:1.0:1784191912.882154:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827988480 00000100:00100000:1.0:1784191912.882246:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784191912.882257:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+8:167183:x1870858827988480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784191912.883589:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+8:167183:x1870858827988480:12345-0@lo:502:llog_process_th.0 Request processed in 1330us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191912.883601:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784191912.883800:0:167183:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167183:1870858827988480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784191912.883837:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784191912.883849:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784191912.883851:0:167183:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784191912.883858:0:167183:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1784191912.883861:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784191912.883876:0:167183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8af101753380) 00000020:00000080:2.0:1784191912.883901:0:167183:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1784191912.883907:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784191912.884040:0:167183:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784191912.884049:0:167183:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeec3c2dc5a4d173 00000020:00000080:2.0:1784191912.884272:0:167183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784191912.884276:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784191912.884280:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784191912.884282:0:167183:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784191912.884285:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784191912.884288:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784191912.884290:0:167183:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1784191912.884293:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784191912.884300:0:167183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8af101750000) 00000020:00000080:2.0:1784191912.884312:0:167183:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1784191912.884316:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784191912.884317:0:167183:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1784191912.884320:0:167183:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1784191912.884574:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784191912.884630:0:167183:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af109051000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1784191912.884644:0:167183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8af101754d40) 00000020:00000080:2.0:1784191912.884656:0:167183:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1784191912.885429:0:167183:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1784191912.885441:0:167183:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeec3c2dc5a4d188 00000020:00000080:3.0:1784191912.885570:0:167183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1784191912.885585:0:167183:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1784191912.885591:0:167183:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xfeec3c2dc5a4d18f 00080000:01000000:3.0:1784191912.885596:0:167183:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784191912.885600:0:167183:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeec3c2dc5a4d196 00010000:00010000:1.0:1784191913.037067:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191913.037430:0:167183:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1784191913.038981:0:167183:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 0 srv lr: 34359738630 lx: 0 gen 5 00000001:00080000:2.0:1784191913.039047:0:167183:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a idx: 1 lr: 0 srv lr: 34359738630 lx: 0 gen 4 00000001:00000004:2.0:1784191913.039094:0:167183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 9, last_transno is 34359738630 00000001:00080000:2.0:1784191913.039518:0:167183:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1784191913.039578:0:167183:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8af11171e000: xid 1870858827982720, transno 34359738836, client gen 5, slot idx 0 00000001:00080000:2.0:1784191913.039586:0:167183:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8af11171e600: xid 1870858827982976, transno 34359738837, client gen 5, slot idx 1 00000001:00080000:2.0:1784191913.039591:0:167183:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8af11171e480: xid 1870858812464768, transno 34359738827, client gen 4, slot idx 2 00000001:00080000:2.0:1784191913.039595:0:167183:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8af11171ec00: xid 1870858812435328, transno 34359738767, client gen 4, slot idx 3 00000020:00000080:2.0:1784191913.040062:0:167183:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8af107b74d40) 00000020:00000080:2.0:1784191913.040084:0:167183:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1784191913.040929:0:167183:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784191913.040946:0:167183:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeec3c2dc5a4d1b2 00000020:00000080:0.0:1784191913.041623:0:167183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1784191913.053988:0:167183:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xfeec3c2dc5a4d1b9 00000020:00000080:1.0:1784191913.059136:0:167183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1784191913.059152:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784191913.059171:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191913.059174:0:167183:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1784191913.059178:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784191913.059182:0:167183:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1784191913.059183:0:167183:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784191913.059185:0:167183:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784191913.059187:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784191913.059190:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191913.059192:0:167183:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784191913.059194:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784191913.059199:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191913.059200:0:167183:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1784191913.059205:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1784191913.059259:0:167183:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1784191913.059277:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784191913.059280:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191913.059282:0:167183:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1784191913.059284:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784191913.059287:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191913.059288:0:167183:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1784191913.059291:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784191913.059296:0:167183:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.116@tcp to nid 0x20000c0a8cc74 (192.168.204.116@tcp) 00000020:00000080:1.0:1784191913.059320:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784191913.059350:0:167183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8af10ca03380) 00000020:00000080:1.0:1784191913.059375:0:167183:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1784191913.059382:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784191913.059446:0:167183:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1784191913.059453:0:167183:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784191913.059459:0:167183:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeec3c2dc5a4d1c7 00010000:00080000:1.0:1784191913.059520:0:167183:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af202ccd800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.116@tcp at head 00010000:00010000:1.0:1784191913.062239:0:167183:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1784191913.063459:0:167183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784191913.063476:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1784191913.063515:0:167183:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784191913.063538:0:167183:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeec3c2dc5a4d1ce 00000100:00080000:2.0:1784191913.063551:0:167183:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784191913.063556:0:167183:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8af202ccd800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:2.0:1784191913.063597:0:167183:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af22dcfc380 x1870858827988608/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784191913.063627:0:167183:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1784191913.063729:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784191913.063734:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784191913.063736:0:167183:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1784191913.063739:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784191913.063741:0:167183:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1784191913.063743:0:167183:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784191913.063745:0:167183:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784191913.063746:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784191913.063749:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784191913.063758:0:167183:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784191913.063762:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784191913.063767:0:167183:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784191913.063771:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784191913.063772:0:167183:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1784191913.063775:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784191913.063778:0:167183:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.116@tcp to nid 0x20000c0a8cc74 (192.168.204.116@tcp) 00000020:01000000:2.0:1784191913.063804:0:167183:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784191913.063807:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784191913.063823:0:167183:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8af107b73380) 00000020:00000080:2.0:1784191913.063841:0:167183:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1784191913.063846:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784191913.063913:0:167183:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1784191913.063919:0:167183:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1784191913.063925:0:167183:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeec3c2dc5a4d1dc 00010000:00080000:2.0:1784191913.063960:0:167183:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af2029fa800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.116@tcp at head 00000100:00100000:0.0:1784191913.063974:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827988608:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784191913.064055:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784191913.064193:0:167183:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:3.0:1784191913.064334:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827988608 00000100:00100000:3.0:1784191913.064342:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827988608 00000100:00100000:3.0:1784191913.064389:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:3.0:1784191913.064397:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:106498:x1870858827988608:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1784191913.064425:0:158671:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 5533 last 0 00000020:00000080:3.0:1784191913.064458:0:158671:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeec3c2dc5a4d1e3 00000004:00100000:3.0:1784191913.064472:0:158671:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784191913.064558:0:158671:0:(import.c:65:import_set_state_nolock()) ffff8af109025000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1784191913.064579:0:123300:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784191913.064585:0:123300:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784191913.064588:0:123300:0:(import.c:65:import_set_state_nolock()) ffff8af23d85c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784191913.064594:0:123300:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5529 00000100:00080000:1.0:1784191913.064598:0:123300:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784191913.064603:0:123300:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8af23d85c000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191913.064625:0:123300:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af101684700 x1870858827988736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191913.064636:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:106498:x1870858827988608:12345-0@lo:38:llog_process_th.0 Request processed in 237us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191913.064645:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00080000:1.0:1784191913.064665:0:123300:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784191913.064669:0:123300:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784191913.064671:0:123300:0:(import.c:65:import_set_state_nolock()) ffff8af10c36a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784191913.064675:0:123300:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5529 00000100:00080000:1.0:1784191913.064678:0:123300:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784191913.064682:0:123300:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8af10c36a000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191913.064712:0:123300:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af101686a00 x1870858827988992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784191913.064737:0:123300:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784191913.064741:0:123300:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784191913.064742:0:123300:0:(import.c:65:import_set_state_nolock()) ffff8af1093a8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784191913.064746:0:123300:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5529 00000100:00080000:1.0:1784191913.064749:0:123300:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784191913.064753:0:123300:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8af1093a8800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191913.064764:0:123300:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af101685180 x1870858827989248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784191913.064798:0:123300:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784191913.064801:0:123300:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784191913.064803:0:123300:0:(import.c:65:import_set_state_nolock()) ffff8af23ea15000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784191913.064806:0:123300:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5529 00000100:00080000:1.0:1784191913.064809:0:123300:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784191913.064812:0:123300:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8af23ea15000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191913.064822:0:123300:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af101687480 x1870858827989632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784191913.064852:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858827988864:0@lo:400:kworker.0 00000100:00100000:1.0:1784191913.064888:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191913.064914:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784191913.064919:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827989504:0@lo:400:kworker.0 00000100:00100000:1.0:1784191913.064944:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191913.064982:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827988864 00000100:00100000:1.0:1784191913.064986:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827988864 00000100:00100000:1.0:1784191913.065026:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1784191913.065032:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858827988864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191913.065066:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858827988864:12345-0@lo:400:kworker.0 Request processed in 35us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191913.065072:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1784191913.065090:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827989504 00000100:00100000:1.0:1784191913.065093:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827989504 00000100:00100000:1.0:1784191913.065121:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1784191913.065128:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827989504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191913.065142:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827989120:0@lo:400:kworker.0 00000100:00100000:1.0:1784191913.065188:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827989504:12345-0@lo:400:kworker.0 Request processed in 60us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191913.065192:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191913.065204:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1784191913.065222:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784191913.065231:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827989376:0@lo:400:kworker.0 00000100:00100000:1.0:1784191913.065231:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827989120 00000100:00100000:1.0:1784191913.065237:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827989120 00000100:00100000:3.0:1784191913.065261:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191913.065273:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1784191913.065282:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827989120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191913.065300:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827989376 00000100:00100000:3.0:1784191913.065305:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827989376 00000100:00100000:1.0:1784191913.065324:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858827989120:12345-0@lo:400:kworker.0 Request processed in 43us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191913.065331:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1784191913.065342:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1784191913.065351:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827989376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191913.065381:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827989504:0@lo:400:kworker.0 00000100:00100000:3.0:1784191913.065388:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858827989376:12345-0@lo:400:kworker.0 Request processed in 38us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191913.065397:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1784191913.065398:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858827988864:0@lo:400:kworker.0 00000100:00100000:1.0:1784191913.065438:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827989376:0@lo:400:kworker.0 00000100:00100000:1.0:1784191913.065448:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858827989120:0@lo:400:kworker.0 00000100:00100000:2.0:1784191913.065627:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:106498:1870858827988736:0@lo:38:kworker.0 00000100:00080000:0.0:1784191913.065656:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784191913.065660:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784191913.065663:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784191913.065667:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784191913.065727:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:106498:1870858827988992:0@lo:38:kworker.0 00000100:00100000:2.0:1784191913.065753:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191913.065772:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858827989248:0@lo:38:kworker.0 00000100:00100000:2.0:1784191913.065793:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191913.065823:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:106498:1870858827989632:0@lo:38:kworker.0 00000100:00100000:3.0:1784191913.065844:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827988736 00000100:00100000:2.0:1784191913.065849:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191913.065851:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827988736 00000100:00100000:3.0:1784191913.065872:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827988992 00000100:00100000:3.0:1784191913.065875:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827988992 00000100:00100000:2.0:1784191913.065883:0:106498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1784191913.065890:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827989632 00000100:00080000:2.0:1784191913.065893:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 6 00000100:00100000:3.0:1784191913.065895:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827989632 00000100:00080000:2.0:1784191913.065902:0:106498:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00100000:3.0:1784191913.065908:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:3.0:1784191913.065917:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:106498:x1870858827988736:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1784191913.065918:0:106498:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1784191913.065924:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af202ccd800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784191913.065938:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827988608:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784191913.065982:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:106498:x1870858827988736:12345-0@lo:38:kworker.0 Request processed in 64us (322us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784191913.065990:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00080000:2.0:1784191913.065999:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23d85c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784191913.066006:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784191913.066008:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:2.0:1784191913.066012:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:106498:1870858827988736:0@lo:38:kworker.0 00000100:00100000:3.0:1784191913.066018:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:106498:x1870858827988992:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784191913.066060:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:106498:x1870858827988992:12345-0@lo:38:kworker.0 Request processed in 43us (306us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784191913.066066:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1784191913.066079:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:3.0:1784191913.066083:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:106498:x1870858827989632:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784191913.066110:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:106498:x1870858827989632:12345-0@lo:38:kworker.0 Request processed in 25us (262us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784191913.066115:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00100000:0.0:1784191913.067506:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827989248 00000100:00100000:0.0:1784191913.067517:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827989248 00000100:00100000:0.0:1784191913.067554:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:0.0:1784191913.067561:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:106498:x1870858827989248:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784191913.067627:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:106498:x1870858827989248:12345-0@lo:38:kworker.0 Request processed in 66us (1832us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784191913.067634:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1784191913.067966:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784191913.067982:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827989760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784191913.068047:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784191913.068732:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10c36a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784191913.068739:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784191913.068743:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:106498:1870858827988992:0@lo:38:kworker.0 00000100:00080000:2.0:1784191913.068756:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af1093a8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784191913.068759:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784191913.068762:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858827989248:0@lo:38:kworker.0 00000100:00080000:2.0:1784191913.068773:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23ea15000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784191913.068776:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784191913.068778:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:106498:1870858827989632:0@lo:38:kworker.0 00000100:00100000:3.0:1784191913.069446:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827989760 00000100:00100000:3.0:1784191913.069455:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827989760 00000100:00100000:3.0:1784191913.069522:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:3.0:1784191913.069532:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:106499:x1870858827989760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784191913.069572:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42676224 avail 36544512 00000100:00100000:3.0:1784191913.069661:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:106499:x1870858827989760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191913.069685:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:2.0:1784191913.074700:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858827989760:0@lo:41:osp-pre-1-0.0 00000040:01000000:1.0:1784191913.074947:0:167183:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784191913.075364:0:167183:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784191913.080089:0:167183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784191913.080286:0:167183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].9, 64 off8768 00000040:00080000:1.0:1784191913.091090:0:167183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x24:0x0].1, 64 off8256 00000040:00080000:1.0:1784191913.092628:0:167189:0:(llog.c:805:llog_process_thread()) index: 9, lh_last_idx: 9 synced_idx: 9 lgh_last_idx: 9 00000040:00080000:1.0:1784191913.092634:0:167189:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 9 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1784191913.101097:0:167183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784191913.101115:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784191913.101183:0:167183:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784191913.101204:0:167183:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeec3c2dc5a4d1ea 00000100:00080000:2.0:1784191913.101216:0:167183:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784191913.101222:0:167183:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8af2029fa800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:2.0:1784191913.101258:0:167183:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af22dcfc380 x1870858827989888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784191913.101305:0:167183:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1784191913.101377:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784191913.101382:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784191913.101383:0:167183:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1784191913.101386:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784191913.101389:0:167183:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1784191913.101390:0:167183:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784191913.101392:0:167183:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784191913.101393:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784191913.101395:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784191913.101397:0:167183:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784191913.101399:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784191913.101403:0:167183:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784191913.101407:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784191913.101409:0:167183:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1784191913.101411:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784191913.101415:0:167183:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.116@tcp to nid 0x20000c0a8cc74 (192.168.204.116@tcp) 00000020:01000000:2.0:1784191913.101442:0:167183:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784191913.101446:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784191913.101461:0:167183:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8af23e688000) 00000020:00000080:2.0:1784191913.101481:0:167183:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1784191913.101487:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784191913.101546:0:167183:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1784191913.101552:0:167183:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1784191913.101558:0:167183:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfeec3c2dc5a4d1f8 00010000:00080000:2.0:1784191913.101588:0:167183:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af2372e4800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.116@tcp at head 00010000:00010000:2.0:1784191913.101835:0:167183:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1784191913.101910:0:167183:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784191913.101925:0:167183:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1784191913.102523:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827989888:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1784191913.102609:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191913.102887:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827989888 00000100:00100000:2.0:1784191913.102895:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827989888 00000100:00100000:2.0:1784191913.103092:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1784191913.103100:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:106498:x1870858827989888:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1784191913.103132:0:162396:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 5533 last 0 00000020:00000080:2.0:1784191913.103190:0:162396:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeec3c2dc5a4d1ff 00002000:00100000:2.0:1784191913.103207:0:162396:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8af20d951800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1784191913.103212:0:162396:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1784191913.103215:0:162396:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784191913.103281:0:162396:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784191913.103308:0:162396:0:(import.c:65:import_set_state_nolock()) ffff8af20d952000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784191913.103444:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:106498:x1870858827989888:12345-0@lo:8:llog_process_th.0 Request processed in 338us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191913.103452:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000040:00080000:1.0:1784191913.104068:0:167183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784191913.104307:0:167183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].9, 64 off8768 00000040:00080000:1.0:1784191913.104466:0:167183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].1, 64 off8256 00000100:00100000:3.0:1784191913.115444:0:106498:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784191913.115466:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 5 00000100:00080000:3.0:1784191913.115477:0:106498:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784191913.115484:0:106498:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1784191913.115488:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784191913.115517:0:106498:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784191913.115529:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827989888:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1784191913.115595:0:167189:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000040:00080000:3.0:1784191913.115958:0:167191:0:(llog.c:805:llog_process_thread()) index: 9, lh_last_idx: 9 synced_idx: 9 lgh_last_idx: 9 00000040:00080000:3.0:1784191913.115963:0:167191:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 9 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1784191913.116118:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784191913.116136:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827990016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784191913.116239:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191913.116298:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827990016 00000100:00100000:0.0:1784191913.116307:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827990016 00000100:00100000:0.0:1784191913.116385:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1784191913.116398:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:106502:x1870858827990016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784191913.116438:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1585152 granted 59336640 pending 0 free 70430720 avail 63262720 00000100:00100000:0.0:1784191913.116494:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:106502:x1870858827990016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191913.116514:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1784191913.116523:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827990016:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784191913.116597:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1784191913.117097:0:167183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784191913.117115:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784191913.117176:0:167183:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784191913.117200:0:167183:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeec3c2dc5a4d206 00000100:00080000:3.0:1784191913.117210:0:167183:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784191913.117216:0:167183:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8af2372e4800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:3.0:1784191913.117246:0:167183:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af23310b800 x1870858827990144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784191913.117274:0:167183:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1784191913.117346:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784191913.117351:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784191913.117353:0:167183:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784191913.117356:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784191913.117359:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784191913.117361:0:167183:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784191913.117364:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784191913.117374:0:167183:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784191913.117377:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784191913.117380:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784191913.117382:0:167183:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784191913.117385:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784191913.117388:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784191913.117390:0:167183:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784191913.117393:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784191913.117401:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827990144:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1784191913.117430:0:167183:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167183:1870858827990272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784191913.117467:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191913.117486:0:167183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191913.117517:0:167183:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af20578b240 going to sleep for 11 seconds 00000100:00100000:0.0:1784191913.117531:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827990144 00000100:00100000:0.0:1784191913.117538:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827990144 00000100:00100000:0.0:1784191913.117582:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1784191913.117589:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1051f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:106498:x1870858827990144:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1784191913.117621:0:160166:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 5533 last 0 00000100:00100000:2.0:1784191913.117634:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827990272 00000020:00000080:0.0:1784191913.117650:0:160166:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfeec3c2dc5a4d20d 00000100:00100000:2.0:1784191913.117656:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827990272 00002000:00100000:0.0:1784191913.117668:0:160166:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8af2029ad000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784191913.117674:0:160166:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784191913.117678:0:160166:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1784191913.117715:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784191913.117723:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+8:167183:x1870858827990272:12345-0@lo:502:llog_process_th.0 00002000:00080000:0.0:1784191913.117799:0:160166:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784191913.117828:0:160166:0:(import.c:65:import_set_state_nolock()) ffff8af2029ae000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784191913.117879:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+8:167183:x1870858827990272:12345-0@lo:502:llog_process_th.0 Request processed in 155us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191913.117886:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1051f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:106498:x1870858827990144:12345-0@lo:8:llog_process_th.0 Request processed in 293us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191913.117893:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784191913.117899:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1784191913.118115:0:106498:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784191913.118123:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 4 00000100:00080000:0.0:1784191913.118131:0:106498:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784191913.118269:0:106498:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784191913.118273:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af2372e4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784191913.118297:0:106498:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784191913.118304:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858827990144:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1784191913.118535:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827990400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784191913.118584:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191913.118751:0:167183:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167183:1870858827990272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784191913.118789:0:167183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784191913.118795:0:167183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784191913.118797:0:167183:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784191913.118802:0:167183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000004:00080000:3.0:1784191913.119017:0:167191:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784191913.119088:0:167191:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 5533298398495ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784191913.119094:0:167191:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:0.0:1784191913.120500:0:167171:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1784191913.120533:0:167171:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000004:00080000:1.0:1784191913.121170:0:167189:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 5533300479847ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784191913.121179:0:167189:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:0.0:1784191913.121203:0:167171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b9800/0xfeec3c2dc5a4d150 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d157 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.121217:0:167171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af1115b9800/0xfeec3c2dc5a4d150 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d157 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191913.121500:0:167171:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8af109051000 from 1 10000000:01000000:1.0:1784191913.121504:0:167171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784191913.121541:0:167171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10de3f800/0xfeec3c2dc5a4d214 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191913.121551:0:167171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af10de3f800/0xfeec3c2dc5a4d214 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191913.121564:0:167171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af10de3f800/0xfeec3c2dc5a4d214 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191913.121591:0:167171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101687800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827990528:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784191913.121659:0:167171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191913.121722:0:167171:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2257ce9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191913.122071:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827990528 00000100:00100000:0.0:1784191913.122080:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827990528 00000100:00100000:0.0:1784191913.122133:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784191913.122143:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+8:167171:x1870858827990528:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784191913.122166:0:167178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191913.122181:0:167178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af20c0aa400/0xfeec3c2dc5a4d21b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d214 expref: -99 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.122208:0:167178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af20c0aa400/0xfeec3c2dc5a4d21b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d214 expref: 9 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.122220:0:167178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af20c0aa400/0xfeec3c2dc5a4d21b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d214 expref: 9 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.122230:0:167178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20c0aa400, rc 0) 00000100:00100000:0.0:1784191913.122285:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+9:167171:x1870858827990528:12345-0@lo:101:mount.lustre.0 Request processed in 143us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191913.122292:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784191913.123201:0:167171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101687800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827990528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784191913.123226:0:167171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af10de3f800/0xfeec3c2dc5a4d214 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d21b expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191913.123238:0:167171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af10de3f800/0xfeec3c2dc5a4d214 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d21b expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784191913.123625:0:167172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1784191913.127868:0:167171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101687800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827990656:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784191913.127962:0:167171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191913.128151:0:167171:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2257ce9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191913.128185:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827990656 00000100:00100000:3.0:1784191913.128193:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827990656 00000100:00100000:3.0:1784191913.128254:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784191913.128265:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+9:167171:x1870858827990656:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1784191913.128290:0:167181:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784191913.128310:0:167181:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784191913.128314:0:167181:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784191913.128332:0:167181:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784191913.128335:0:167181:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 40 00000100:00100000:3.0:1784191913.128456:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+9:167171:x1870858827990656:12345-0@lo:256:mount.lustre.0 Request processed in 192us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191913.128472:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784191913.128718:0:167171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101687800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827990656:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1784191913.129498:0:167171:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784191913.129640:0:167171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10de3f800/0xfeec3c2dc5a4d214 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d21b expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191913.129654:0:167171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af10de3f800/0xfeec3c2dc5a4d214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d21b expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191913.129664:0:167171:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af109051000 from 1 10000000:01000000:1.0:1784191913.129668:0:167171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00100000:2.0:1784191913.129710:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827990400 00000100:00100000:2.0:1784191913.129718:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827990400 00010000:00010000:1.0:1784191913.129724:0:167171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10de3e000/0xfeec3c2dc5a4d222 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191913.129734:0:167171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af10de3e000/0xfeec3c2dc5a4d222 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191913.129743:0:167171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af10de3e000/0xfeec3c2dc5a4d222 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191913.129766:0:167171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101687800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827990784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784191913.129784:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1784191913.129793:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:106502:x1870858827990400:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784191913.129818:0:167171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1784191913.129829:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3907584 granted 59635648 pending 0 free 70823936 avail 63655936 00000100:00100000:1.0:1784191913.129852:0:167171:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2257ce9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191913.129873:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827990784 00000100:00100000:2.0:1784191913.129878:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:106502:x1870858827990400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (11293us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191913.129880:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827990784 00000100:00100000:2.0:1784191913.129888:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1784191913.129916:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784191913.131032:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+9:167171:x1870858827990784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784191913.131047:0:167176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191913.131069:0:167176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af10de3e400/0xfeec3c2dc5a4d229 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d222 expref: -99 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191913.131094:0:167176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af10de3e400/0xfeec3c2dc5a4d229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d222 expref: 10 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191913.131121:0:167176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af10de3e400/0xfeec3c2dc5a4d229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d222 expref: 10 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191913.131129:0:167176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3e400, rc 0) 00000100:00100000:1.0:1784191913.131215:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+10:167171:x1870858827990784:12345-0@lo:101:mount.lustre.0 Request processed in 195us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191913.131222:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784191913.132111:0:167171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101687800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827990784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784191913.132134:0:167171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af10de3e000/0xfeec3c2dc5a4d222 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d229 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.132145:0:167171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af10de3e000/0xfeec3c2dc5a4d222 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d229 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191913.132272:0:167171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827990912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784191913.132367:0:167171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191913.132419:0:167171:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ea986c0 going to sleep for 11 seconds 00000004:00080000:2.0:1784191913.132493:0:167172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00080000:0.0:1784191913.132611:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784191913.132668:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858827990400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784191913.134340:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827990912 00000100:00100000:1.0:1784191913.134351:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827990912 00000100:00100000:1.0:1784191913.134420:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784191913.134430:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1074b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+10:167171:x1870858827990912:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784191913.134615:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1074b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+10:167171:x1870858827990912:12345-0@lo:501:mount.lustre.0 Request processed in 187us (2247us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191913.134622:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784191913.135246:0:167171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827990912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784191913.135308:0:167171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827991040:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784191913.135383:0:167171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191913.135427:0:167171:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ea986c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191913.137252:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827991040 00000100:00100000:0.0:1784191913.137270:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827991040 00000100:00100000:0.0:1784191913.137339:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784191913.137351:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1074b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+10:167171:x1870858827991040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784191913.137529:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1074b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+10:167171:x1870858827991040:12345-0@lo:503:mount.lustre.0 Request processed in 179us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191913.137538:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784191913.137636:0:167171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827991040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784191913.138123:0:167193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167193:1870858827991168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784191913.138189:0:167193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191913.138237:0:167193:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af20578b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191913.138638:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827991168 00000100:00100000:1.0:1784191913.138645:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827991168 00000100:00100000:1.0:1784191913.138728:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784191913.138737:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1074b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+10:167193:x1870858827991168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784191913.143415:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1074b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+10:167193:x1870858827991168:12345-0@lo:502:llog_process_th.0 Request processed in 4669us (5215us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191913.143430:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784191913.145837:0:167193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167193:1870858827991168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784191913.145890:0:167193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784191913.145904:0:167193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784191913.145907:0:167193:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784191913.145918:0:167193:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8af109051000 00000020:00000080:3.0:1784191913.145921:0:167193:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784191913.145932:0:167193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784191913.145934:0:167193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784191913.145935:0:167193:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784191913.145938:0:167193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784191913.145940:0:167193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784191913.145941:0:167193:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784191913.145944:0:167193:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8af109051000 00000020:00000080:3.0:1784191913.145946:0:167193:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784191913.146048:0:167193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167193:1870858827991296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784191913.146134:0:167193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191913.146209:0:167193:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af20578b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191913.146377:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827991296 00000100:00100000:1.0:1784191913.146386:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827991296 00000100:00100000:1.0:1784191913.146448:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784191913.146459:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+10:167193:x1870858827991296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784191913.146606:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+10:167193:x1870858827991296:12345-0@lo:502:llog_process_th.0 Request processed in 150us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191913.146614:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784191913.146733:0:167193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167193:1870858827991296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784191913.146755:0:167193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784191913.146761:0:167193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784191913.146763:0:167193:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1784191913.146768:0:167193:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784191913.149397:0:167171:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1784191913.149455:0:167171:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784191913.149482:0:167171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10de3e000/0xfeec3c2dc5a4d222 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d229 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.149504:0:167171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af10de3e000/0xfeec3c2dc5a4d222 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d229 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784191913.149577:0:167171:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784191913.149581:0:167171:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8af109051000 10000000:01000000:2.0:1784191913.149584:0:167171:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8af109051000 10000000:01000000:2.0:1784191913.149589:0:167171:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784191913.149595:0:167171:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8af109051000 from 1 10000000:01000000:2.0:1784191913.149597:0:167171:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784191913.149636:0:167171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b9c00/0xfeec3c2dc5a4d230 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.149644:0:167171:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af1115b9c00/0xfeec3c2dc5a4d230 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.149654:0:167171:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af1115b9c00/0xfeec3c2dc5a4d230 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191913.149680:0:167171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827991424:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784191913.149782:0:167171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191913.149819:0:167171:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2029ec780 going to sleep for 11 seconds 00000100:00100000:0.0:1784191913.152400:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827991424 00000100:00100000:0.0:1784191913.152413:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827991424 00000100:00100000:0.0:1784191913.152491:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784191913.152501:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+10:167171:x1870858827991424:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784191913.152519:0:167179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191913.152537:0:167179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af20c0aa200/0xfeec3c2dc5a4d237 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d230 expref: -99 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.152568:0:167179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af20c0aa200/0xfeec3c2dc5a4d237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d230 expref: 11 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.152582:0:167179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af20c0aa200/0xfeec3c2dc5a4d237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d230 expref: 11 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.152591:0:167179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20c0aa200, rc 0) 00000100:00100000:0.0:1784191913.152683:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+11:167171:x1870858827991424:12345-0@lo:101:mount.lustre.0 Request processed in 183us (2901us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191913.152710:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784191913.152795:0:167171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827991424:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784191913.152817:0:167171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af1115b9c00/0xfeec3c2dc5a4d230 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d237 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.152829:0:167171:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af1115b9c00/0xfeec3c2dc5a4d230 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d237 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191913.153048:0:167171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827991552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784191913.153087:0:167171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191913.154737:0:167171:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2029ec780 going to sleep for 11 seconds 00000100:00100000:3.0:1784191913.155095:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827991552 00000100:00100000:3.0:1784191913.155105:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827991552 00000100:00100000:3.0:1784191913.155196:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784191913.155207:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+11:167171:x1870858827991552:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784191913.155372:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+11:167171:x1870858827991552:12345-0@lo:501:mount.lustre.0 Request processed in 168us (2284us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191913.155390:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784191913.155590:0:167171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827991552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784191913.155642:0:167171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827991680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784191913.155759:0:167171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191913.155821:0:167171:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2029ec780 going to sleep for 11 seconds 00000100:00100000:3.0:1784191913.155960:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827991680 00000100:00100000:3.0:1784191913.156059:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827991680 00000100:00100000:2.0:1784191913.156168:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784191913.156177:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+11:167171:x1870858827991680:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784191913.156290:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+11:167171:x1870858827991680:12345-0@lo:503:mount.lustre.0 Request processed in 114us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191913.156297:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784191913.156348:0:167171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827991680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784191913.156596:0:167196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167196:1870858827991808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784191913.156634:0:167196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191913.156655:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827991808 00000100:00100000:2.0:1784191913.156659:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827991808 00000100:00100000:2.0:1784191913.156684:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784191913.156716:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+11:167196:x1870858827991808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784191913.156809:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+11:167196:x1870858827991808:12345-0@lo:502:llog_process_th.0 Request processed in 119us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191913.156815:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784191913.156852:0:167196:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2029ece40 going to sleep for 11 seconds 00000100:00100000:2.0:1784191913.156865:0:167196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167196:1870858827991808:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1784191913.157065:0:167196:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1784191913.157080:0:167196:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8af23e68b380) 00000020:00000080:2.0:1784191913.157114:0:167196:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1784191913.157829:0:167196:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af109051000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784191913.157836:0:167196:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af109051000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784191913.157839:0:167196:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af109051000 4 00010000:00080000:3.0:1784191913.158017:0:167196:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af10c3a8000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.116@tcp at head 00010000:00010000:3.0:1784191913.162520:0:167196:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1784191913.162637:0:167196:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1784191913.162685:0:167196:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784191913.162720:0:167196:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xfeec3c2dc5a4d245 00000100:00080000:3.0:1784191913.162731:0:167196:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784191913.162736:0:167196:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8af10c3a8000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:3.0:1784191913.162776:0:167196:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af233108000 x1870858827991936/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784191913.162807:0:167196:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784191913.163591:0:167196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167196:1870858827992064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784191913.163684:0:167196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191913.163752:0:167196:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af20578b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191913.163980:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:106498:1870858827991936:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784191913.164022:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191913.164067:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827992064 00000100:00100000:2.0:1784191913.164074:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827992064 00000100:00100000:2.0:1784191913.164115:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784191913.164124:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+11:167196:x1870858827992064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784191913.164264:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+11:167196:x1870858827992064:12345-0@lo:502:llog_process_th.0 Request processed in 140us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191913.164272:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784191913.164397:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827991936 00000100:00100000:3.0:1784191913.164401:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827991936 00000100:00100000:3.0:1784191913.164439:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:3.0:1784191913.164444:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:106498:x1870858827991936:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784191913.164494:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:106498:x1870858827991936:12345-0@lo:38:llog_process_th.0 Request processed in 48us (471us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784191913.164501:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00100000:3.0:1784191913.164543:0:106498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784191913.164557:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10c3a8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784191913.164561:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784191913.164566:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:106498:1870858827991936:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784191913.164596:0:167196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167196:1870858827992064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784191913.164638:0:167196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167196:1870858827992192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784191913.164677:0:167196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191913.164729:0:167196:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af20578b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191913.164741:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827992192 00000100:00100000:3.0:1784191913.164744:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827992192 00000100:00100000:3.0:1784191913.164771:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784191913.164777:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+11:167196:x1870858827992192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784191913.164853:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+11:167196:x1870858827992192:12345-0@lo:502:llog_process_th.0 Request processed in 76us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191913.164860:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784191913.164917:0:167196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167196:1870858827992192:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784191913.164937:0:167196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1784191913.165301:0:167171:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1784191913.165327:0:167171:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784191913.165349:0:167171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b9c00/0xfeec3c2dc5a4d230 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d237 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.165360:0:167171:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af1115b9c00/0xfeec3c2dc5a4d230 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d237 expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784191913.165818:0:167171:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784191913.165821:0:167171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784191913.165822:0:167171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784191913.165823:0:167171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784191913.165825:0:167171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784191913.165827:0:167171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784191913.165828:0:167171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784191913.165830:0:167171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784191913.165831:0:167171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784191913.165833:0:167171:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784191913.165838:0:167171:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1784191913.165841:0:167171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784191913.165842:0:167171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784191913.165850:0:167171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784191913.165851:0:167171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784191913.165852:0:167171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784191913.165853:0:167171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784191913.165854:0:167171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784191913.165855:0:167171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784191913.165856:0:167171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784191913.165858:0:167171:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784191913.165989:0:167171:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784191913.166005:0:167171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827992320:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784191913.166059:0:167171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191913.166098:0:167171:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2029ecd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784191913.166169:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827992320 00000100:00100000:3.0:1784191913.166174:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827992320 00000100:00100000:3.0:1784191913.166216:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784191913.166224:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+11:167171:x1870858827992320:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784191913.166250:0:167181:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784191913.166266:0:167181:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784191913.181931:0:167181:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784191913.181968:0:167181:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1784191913.182223:0:167180:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784191913.182229:0:167180:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784191913.182251:0:167180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8af20c0aae00/0xfeec3c2dc5a4d24c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.182272:0:167180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af20c0aa400/0xfeec3c2dc5a4d21b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d214 expref: 11 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.182281:0:167180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8af20c0aae00/0xfeec3c2dc5a4d24c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.182338:0:167180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af20c0aa400/0xfeec3c2dc5a4d21b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeec3c2dc5a4d214 expref: 11 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.182355:0:167180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af20c0aa400/0xfeec3c2dc5a4d21b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeec3c2dc5a4d214 expref: 11 pid: 167178 timeout: 5633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191913.182370:0:167180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:167180:1870858827992448:0@lo:104: 00000100:00100000:0.0:1784191913.182452:0:167180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191913.182498:0:167180:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af219b5e180 going to sleep for 11 seconds 00000100:00100000:2.0:1784191913.182627:0:158649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827992448 00000100:00100000:2.0:1784191913.182634:0:158649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827992448 00000100:00100000:2.0:1784191913.182713:0:158649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784191913.182723:0:158649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+3:167180:x1870858827992448:12345-0@lo:104: 00010000:00010000:2.0:1784191913.182735:0:158649:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.116@tcp lock: ffff8af10de3f800/0xfeec3c2dc5a4d214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeec3c2dc5a4d21b expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.182787:0:158649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784191913.182792:0:158649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+3:167180:x1870858827992448:12345-0@lo:104: Request processed in 72us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191913.182799:0:158649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:0.0:1784191913.183089:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191913.183097:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.116@tcp lock: ffff8af10de3f800/0xfeec3c2dc5a4d214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeec3c2dc5a4d21b expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.183105:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3f800 already unused, calling callback (ffffffffc1384c20) 10000000:00010000:0.0:1784191913.183109:0:158654:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.116@tcp lock: ffff8af10de3f800/0xfeec3c2dc5a4d214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeec3c2dc5a4d21b expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.183139:0:158654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af10de3f800/0xfeec3c2dc5a4d214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeec3c2dc5a4d21b expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784191913.183145:0:158654:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af10de3f800/0xfeec3c2dc5a4d214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeec3c2dc5a4d21b expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784191913.183150:0:158654:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784191913.183202:0:158654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.116@tcp lock: ffff8af10de3f800/0xfeec3c2dc5a4d214 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeec3c2dc5a4d21b expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.183209:0:158654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784191913.183230:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.116@tcp lock: ffff8af10de3f800/0xfeec3c2dc5a4d214 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeec3c2dc5a4d21b expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.183236:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af10de3f800/0xfeec3c2dc5a4d214 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeec3c2dc5a4d21b expref: -99 pid: 167171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.183252:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191913.183254:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191913.183255:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191913.183266:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827992576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191913.183301:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191913.183356:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827992576 00000100:00100000:0.0:1784191913.183361:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827992576 00010000:00010000:0.0:1784191913.183380:0:158652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af20c0aa400/0xfeec3c2dc5a4d21b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeec3c2dc5a4d214 expref: 12 pid: 167178 timeout: 5633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191913.183403:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1784191913.183409:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23b103c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+12:106499:x1870858827992576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784191913.183440:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784191913.183446:0:158652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af20c0aa400/0xfeec3c2dc5a4d21b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeec3c2dc5a4d214 expref: 12 pid: 167178 timeout: 5633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.183456:0:158652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af20c0aa400/0xfeec3c2dc5a4d21b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeec3c2dc5a4d214 expref: 12 pid: 167178 timeout: 5633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.183473:0:158652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8af20c0aae00/0xfeec3c2dc5a4d24c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.183480:0:158652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af20c0aae00/0xfeec3c2dc5a4d24c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784191913.183493:0:158652:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001264659s 00010000:00010000:0.0:1784191913.183497:0:158652:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af20c0aae00/0xfeec3c2dc5a4d24c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.183504:0:158652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af20c0aae00/0xfeec3c2dc5a4d24c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.183510:0:158652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8af20c0aae00/0xfeec3c2dc5a4d24c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.183515:0:158652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8af20c0aae00/0xfeec3c2dc5a4d24c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.183520:0:158652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20c0aae00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191913.183524:0:158652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8af20c0aae00/0xfeec3c2dc5a4d24c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.183530:0:158652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8af20c0aae00/0xfeec3c2dc5a4d24c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.183544:0:158652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8af20c0aae00/0xfeec3c2dc5a4d24c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.183554:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784191913.183585:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23b103c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+12:106499:x1870858827992576:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191913.183591:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1784191913.183667:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858827992576:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784191913.183717:0:167180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af20c0aa400/0xfeec3c2dc5a4d21b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeec3c2dc5a4d214 expref: 11 pid: 167178 timeout: 5633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191913.183727:0:167180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:167180:1870858827992448:0@lo:104: 00010000:00010000:0.0:1784191913.183739:0:167180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8af20c0aae00/0xfeec3c2dc5a4d24c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.183747:0:167180:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8af20c0aae00/0xfeec3c2dc5a4d24c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.183753:0:167180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8af20c0aae00/0xfeec3c2dc5a4d24c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.183758:0:167180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af20c0aae00/0xfeec3c2dc5a4d24c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191913.184221:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+10:167171:x1870858827992320:12345-0@lo:253:mount.lustre.0 Request processed in 17996us (18159us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191913.184238:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784191913.184329:0:167171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:167171:1870858827992320:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784191913.184340:0:167171:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784191913.184344:0:167171:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784191913.184346:0:167171:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784191913.184347:0:167171:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784191913.184348:0:167171:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784191913.184349:0:167171:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784191913.184351:0:167171:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784191913.184352:0:167171:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784191913.184353:0:167171:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784191913.184361:0:167171:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784191913.184363:0:167171:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784191913.184374:0:167171:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:1.0:1784191913.211086:0:167171:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 30064772368 00000040:01000000:1.0:1784191913.213096:0:167171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1784191913.215712:0:167202:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784191913.216088:0:167171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1784191913.217075:0:167203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101684e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827992704:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784191913.217168:0:167203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191913.217198:0:167203:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f82f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191913.217441:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827992704 00000100:00100000:0.0:1784191913.217450:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827992704 00000100:00100000:0.0:1784191913.217508:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:0.0:1784191913.217524:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827992704:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784191913.217601:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827992704:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 79us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191913.217609:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000040:01000000:0.0:1784191913.218205:0:167171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1784191913.218248:0:167171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1784191913.218676:0:167171:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1784191913.218683:0:167171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1784191913.218755:0:167171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784191913.219807:0:167203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101684e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827992704:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1784191913.219855:0:167203:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1784191913.219915:0:167203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101684e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827992832:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784191913.219986:0:167203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191913.220013:0:167203:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f82f540 going to sleep for 11 seconds 00000100:00100000:3.0:1784191913.220595:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827992832 00000100:00100000:3.0:1784191913.220602:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827992832 00000100:00100000:3.0:1784191913.220654:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:3.0:1784191913.220664:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827992832:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784191913.220832:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827992832:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 170us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191913.220840:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:1.0:1784191913.221557:0:167203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101684e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827992832:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784191913.221651:0:167203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101684e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827992960:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784191913.221708:0:167203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191913.221733:0:167203:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f82f540 going to sleep for 11 seconds 00000100:00100000:0.0:1784191913.224306:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827992960 00000100:00100000:0.0:1784191913.224343:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827992960 00000100:00100000:0.0:1784191913.224408:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:0.0:1784191913.224426:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827992960:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784191913.224555:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827992960:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 139us (2846us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191913.224563:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:1.0:1784191913.225199:0:167203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101684e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827992960:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784191913.225307:0:167203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101684e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827993088:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784191913.225380:0:167203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191913.225415:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827993088 00000100:00100000:1.0:1784191913.225419:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827993088 00000100:00100000:1.0:1784191913.225452:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:1.0:1784191913.225458:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827993088:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784191913.225582:0:167203:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f82f000 going to sleep for 11 seconds 00000020:00080000:2.0:1784191913.226918:0:167201:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 30064772368 00000020:00080000:2.0:1784191913.226927:0:167201:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064772368 00000040:00080000:0.0:1784191913.227816:0:167171:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784191913.234463:0:167171:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1784191913.234564:0:167171:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1784191913.234681:0:167171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1784191913.235224:0:167171:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x63:0x0] (8/32) registered 00000100:00100000:2.0:1784191913.240049:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827993088:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 14583us (14661us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191913.240064:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:1.0:1784191913.240343:0:167203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101684e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827993088:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1784191913.240396:0:167203:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x240000401:0x1:0x0] first idx 8, last_idx 10 00000100:00100000:1.0:1784191913.240546:0:167203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101684e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827993216:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784191913.240611:0:167203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191913.240646:0:167203:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f82f000 going to sleep for 11 seconds 00000100:00100000:2.0:1784191913.240968:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827993216 00000100:00100000:2.0:1784191913.240976:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827993216 00000100:00100000:2.0:1784191913.241016:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1784191913.241026:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827993216:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784191913.241624:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827993216:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 598us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191913.241632:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1784191913.242575:0:167203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101684e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827993216:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1784191913.242632:0:167203:0:(llog.c:805:llog_process_thread()) index: 9, lh_last_idx: 10 synced_idx: 0 lgh_last_idx: 10 00000040:00080000:1.0:1784191913.242637:0:167203:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x240002341:0x2:0x0] at index 9 of catalog [0x240000401:0x1:0x0] 00000100:00100000:1.0:1784191913.242723:0:167203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101684e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827993344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784191913.242765:0:167203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191913.242793:0:167203:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f82f540 going to sleep for 11 seconds 00000100:00100000:2.0:1784191913.243046:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827993344 00000100:00100000:2.0:1784191913.243053:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827993344 00000100:00100000:2.0:1784191913.243091:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1784191913.243098:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827993344:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784191913.243181:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827993344:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 83us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191913.243188:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:1.0:1784191913.244355:0:167203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101684e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827993344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784191913.244523:0:167203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101684e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827993472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784191913.244598:0:167203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191913.244669:0:167203:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f82f000 going to sleep for 11 seconds 00010000:00080000:0.0:1784191913.247757:0:167171:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 34359738837 00000040:00080000:2.0:1784191913.249684:0:167202:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784191913.249793:0:167202:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00010000:00080000:0.0:1784191913.251753:0:167204:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 167204 00010000:02000000:0.0:1784191913.251763:0:167204:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:1.0:1784191913.254408:0:167171:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784191913.254435:0:167171:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.116@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784191913.254458:0:167171:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1784191913.254483:0:167171:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1784191913.255420:0:167171:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784191913.255661:0:167171:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784191913.258359:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827993472 00000100:00100000:3.0:1784191913.258375:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827993472 00000100:00100000:3.0:1784191913.258433:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:3.0:1784191913.258443:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827993472:12345-0@lo:1000:lod0000_rec0001.0 00010000:00080000:0.0:1784191913.271515:0:167204:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1784191913.271522:0:167204:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1784191913.281045:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827993472:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 22596us (36439us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191913.281075:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:0.0:1784191913.284927:0:167203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101684e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827993472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784191913.285087:0:167203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827993600:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784191913.285162:0:167203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191913.285206:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827993600 00000100:00100000:0.0:1784191913.285212:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827993600 00000100:00100000:0.0:1784191913.285262:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:0.0:1784191913.285270:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827993600:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784191913.285359:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827993600:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 88us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191913.285367:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:0.0:1784191913.285391:0:167203:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10cb0ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191913.285403:0:167203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827993600:0@lo:1000:lod0000_rec0001.0 00000004:00080000:0.0:1784191913.285445:0:167203:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8af10cb0e540 with version 1 00000040:00080000:0.0:1784191913.285469:0:167203:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x240000401:0x1:0x0] first idx 9, last_idx 10 00000004:00080000:0.0:1784191913.285479:0:167203:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8af10cb0e9c0 with version 2 00000040:00080000:0.0:1784191913.285482:0:167203:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x240002341:0x2:0x0] at index 9 of catalog [0x240000401:0x1:0x0] 00000004:00080000:2.0:1784191913.289094:0:167187:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af227a6a600 version 1 rpc_version 1 00000020:00100000:2.0:1784191913.289167:0:167187:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784191913.289181:0:167187:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af22dcfea00 x1870858827993856/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784191913.289233:0:167187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:167187:1870858827993856:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1784191913.289312:0:167187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191913.291131:0:167187:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784191913.292166:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827993856 00000100:00100000:3.0:1784191913.292180:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827993856 00000100:00100000:3.0:1784191913.292240:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:3.0:1784191913.292250:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:167187:x1870858827993856:12345-0@lo:1000:osp_up1-0.0 00000001:00080000:3.0:1784191913.296172:0:165481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769803810 is committed 00000001:00100000:3.0:1784191913.296185:0:165481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1784191913.296749:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:167187:x1870858827993856:12345-0@lo:1000:osp_up1-0.0 Request processed in 4493us (7429us total) trans 25769803810 rc 0/0 00000100:00100000:0.0:1784191913.296778:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000004:00080000:0.0:1784191913.296841:0:167187:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803810 committed transno 25769803810 00000100:00100000:0.0:1784191913.296845:0:167187:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769803810 gen 2 00000100:00100000:0.0:1784191913.296863:0:167187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:167187:1870858827993856:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1784191913.296887:0:167187:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af227a6a600 version 2 rpc_version 2 00000020:00100000:0.0:1784191913.296926:0:167187:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784191913.296933:0:167187:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af10ec80380 x1870858827994112/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784191913.296955:0:167187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:167187:1870858827994112:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1784191913.297005:0:167187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191913.297028:0:167187:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10cb0e540 going to sleep for 11 seconds 00000100:00100000:0.0:1784191913.297047:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827994112 00000100:00100000:0.0:1784191913.297053:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827994112 00000100:00100000:0.0:1784191913.297088:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:0.0:1784191913.297097:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:167187:x1870858827994112:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1784191913.297294:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:167187:x1870858827994112:12345-0@lo:1000:osp_up1-0.0 Request processed in 198us (288us total) trans 25769803811 rc 0/0 00000100:00100000:0.0:1784191913.297301:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:0.0:1784191913.297343:0:167187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:167187:1870858827994112:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1784191913.297381:0:167203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827994240:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784191913.297445:0:167203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191913.297467:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827994240 00000100:00100000:0.0:1784191913.297470:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827994240 00000100:00100000:0.0:1784191913.297493:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:0.0:1784191913.297499:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af205711050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827994240:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784191913.297626:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af205711050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827994240:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 126us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191913.297633:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:0.0:1784191913.297980:0:167203:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10cb0ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1784191913.297998:0:167203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827994240:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1784191913.298039:0:167203:0:(llog.c:805:llog_process_thread()) index: 10, lh_last_idx: 10 synced_idx: 10 lgh_last_idx: 10 00000040:00080000:0.0:1784191913.298050:0:167203:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x240002341:0x3:0x0] at index 10 of catalog [0x240000401:0x1:0x0] 00000100:00100000:0.0:1784191913.298112:0:167203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827994368:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784191913.298141:0:167203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191913.298178:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827994368 00000100:00100000:0.0:1784191913.298181:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827994368 00000100:00100000:0.0:1784191913.298205:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:0.0:1784191913.298212:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827994368:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784191913.298264:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:167203:x1870858827994368:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 52us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191913.298271:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:0.0:1784191913.298288:0:167203:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10cb0eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784191913.298300:0:167203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:167203:1870858827994368:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1784191913.298333:0:167203:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1784191913.298372:0:167203:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8af10cb0e540 with version 3 00000004:00080000:0.0:1784191913.298384:0:167187:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af227a6a600 version 3 rpc_version 3 00000020:00100000:0.0:1784191913.298397:0:167187:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784191913.298404:0:167187:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af10ec81c00 x1870858827994624/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784191913.298417:0:167187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:167187:1870858827994624:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1784191913.298436:0:167187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191913.298447:0:167187:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10cb0ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1784191913.298459:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827994624 00000100:00100000:0.0:1784191913.298462:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827994624 00000100:00100000:0.0:1784191913.298480:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:0.0:1784191913.298484:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:167187:x1870858827994624:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1784191913.298643:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:167187:x1870858827994624:12345-0@lo:1000:osp_up1-0.0 Request processed in 157us (205us total) trans 25769803812 rc 0/0 00000100:00100000:0.0:1784191913.298655:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:0.0:1784191913.298684:0:167187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:167187:1870858827994624:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1784191913.298744:0:167203:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8af10cb0ee40 with version 4 00000040:00080000:0.0:1784191913.298751:0:167203:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x240002341:0x3:0x0] at index 10 of catalog [0x240000401:0x1:0x0] 00000040:00080000:0.0:1784191913.298765:0:167203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 10 count 1 00000004:00080000:0.0:1784191913.298834:0:167203:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1784191913.298838:0:167203:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:0.0:1784191913.298874:0:167187:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8af227a6a600 version 4 rpc_version 4 00000020:00100000:0.0:1784191913.298887:0:167187:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784191913.298893:0:167187:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8af10ec81f80 x1870858827994880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784191913.298907:0:167187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:167187:1870858827994880:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1784191913.298933:0:167187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191913.298946:0:167187:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10cb0e240 going to sleep for 11 seconds 00000100:00100000:0.0:1784191913.298957:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827994880 00000100:00100000:0.0:1784191913.298961:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827994880 00000100:00100000:0.0:1784191913.298981:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:0.0:1784191913.298987:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:167187:x1870858827994880:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1784191913.299071:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:167187:x1870858827994880:12345-0@lo:1000:osp_up1-0.0 Request processed in 84us (137us total) trans 25769803813 rc 0/0 00000100:00100000:0.0:1784191913.299078:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:0.0:1784191913.299108:0:167187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:167187:1870858827994880:0@lo:1000:osp_up1-0.0 00010000:00080000:0.0:1784191913.299122:0:167204:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1784191913.313432:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191913.313494:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812471680 00000100:00100000:0.0:1784191913.313513:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812471680 00002000:00100000:0.0:1784191913.313582:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x25b:0x0] (0->2128) req@ffff8af10ec80700 x1870858812471680/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:84/0 lens 2624/0 e 0 to 0 dl 1784191924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191913.313596:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10ec80700 with x1870858812471680 ext(0->2128) 00002000:00010000:0.0:1784191913.313603:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10ec80700 00000100:00100000:0.0:1784191913.313635:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 44 00000100:00100000:0.0:1784191913.313646:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:69111:x1870858812471680:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:0.0:1784191913.313952:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:0.0:1784191913.313957:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191913.313960:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:0.0:1784191913.313974:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191913.313977:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191913.313979:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00080000:0.0:1784191913.314253:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191913.329986:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191913.330126:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+46:69111:x1870858812471680:12345-192.168.204.16@tcp:4:cp.0 Request processed in 16480us (16708us total) trans 21474836570 rc 0/0 00000100:00100000:0.0:1784191913.330139:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 44 00002000:00100000:0.0:1784191913.330165:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x25b:0x0] (0->2128) req@ffff8af10ec80700 x1870858812471680/t21474836570(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:84/0 lens 2624/448 e 0 to 0 dl 1784191924 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191913.330176:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10ec80700 with x1870858812471680 ext(0->2128) 00002000:00010000:0.0:1784191913.330184:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10ec80700 00000100:00100000:1.0:1784191913.332481:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812471808 00000100:00100000:1.0:1784191913.332496:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812471808 00000100:00100000:1.0:1784191913.332562:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 412 00000100:00100000:1.0:1784191913.332572:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+46:69112:x1870858812471808:12345-192.168.204.16@tcp:16:kworker.0 00000001:00080000:1.0:1784191913.337373:0:160160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836570 is committed 00000001:00100000:1.0:1784191913.337391:0:160160:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1784191913.337615:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:69112:x1870858812471808:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 5037us (7634us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191913.337626:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 412 00000100:00100000:1.0:1784191913.357931:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191913.358010:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191913.358044:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812472064 00000100:00100000:1.0:1784191913.358054:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812472064 00000100:00100000:1.0:1784191913.358109:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 413 00000100:00100000:1.0:1784191913.358118:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69109:x1870858812472064:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:1.0:1784191913.358224:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69109:x1870858812472064:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 106us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191913.358232:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 413 00000100:00080000:1.0:1784191913.358256:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784191913.358822:0:166577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812471936 00000100:00100000:3.0:1784191913.358828:0:166577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812471936 00002000:00100000:3.0:1784191913.358855:0:166577:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1d8:0x0] (0->158095) req@ffff8af101685180 x1870858812471936/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:84/0 lens 488/0 e 0 to 0 dl 1784191924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191913.358867:0:166577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af101685180 with x1870858812471936 ext(0->158095) 00002000:00010000:3.0:1784191913.358881:0:166577:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af101685180 00000100:00100000:3.0:1784191913.358909:0:166577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 45 00000100:00100000:3.0:1784191913.358917:0:166577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69109:x1870858812471936:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:0.0:1784191913.396668:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00080000:00000400:0.0:1784191913.396910:0:166577:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:0.0:1784191913.396915:0:166577:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191913.396918:0:166577:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:0.0:1784191913.396920:0:166577:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191913.396932:0:166577:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191913.396934:0:166577:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191913.397071:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191913.397102:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812472320 00000100:00100000:2.0:1784191913.397111:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812472320 00000100:00100000:2.0:1784191913.397165:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 414 00000100:00100000:2.0:1784191913.397176:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:69112:x1870858812472320:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:3.0:1784191913.398237:0:166572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812472192 00000100:00100000:3.0:1784191913.398247:0:166572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812472192 00002000:00100000:3.0:1784191913.398286:0:166572:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x25c:0x0] (0->37841) req@ffff8af22dcfd880 x1870858812472192/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:84/0 lens 488/0 e 0 to 0 dl 1784191924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191913.398298:0:166572:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af22dcfd880 with x1870858812472192 ext(0->37841) 00002000:00010000:3.0:1784191913.398304:0:166572:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af22dcfd880 00000100:00100000:3.0:1784191913.399174:0:166572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 46 00000100:00100000:3.0:1784191913.399187:0:166572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+45:69112:x1870858812472192:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:2.0:1784191913.399504:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+45:69112:x1870858812472320:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 2325us (2841us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191913.399515:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 414 00000100:00100000:0.0:1784191913.402901:0:166577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+45:69109:x1870858812471936:12345-192.168.204.16@tcp:4:cp.0 Request processed in 43974us (44970us total) trans 17179869261 rc 0/0 00000100:00100000:0.0:1784191913.402916:0:166577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 45 00002000:00100000:0.0:1784191913.402932:0:166577:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1d8:0x0] (0->158095) req@ffff8af101685180 x1870858812471936/t17179869261(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:84/0 lens 488/448 e 0 to 0 dl 1784191924 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191913.402942:0:166577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af101685180 with x1870858812471936 ext(0->158095) 00002000:00010000:0.0:1784191913.402949:0:166577:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af101685180 00000100:00100000:0.0:1784191913.409279:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191913.409334:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191913.409371:0:166576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812472448 00000100:00100000:0.0:1784191913.409380:0:166576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812472448 00002000:00100000:0.0:1784191913.409422:0:166576:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1d9:0x0] (0->422) req@ffff8af10fb61f80 x1870858812472448/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:84/0 lens 912/0 e 0 to 0 dl 1784191924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191913.409433:0:166576:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10fb61f80 with x1870858812472448 ext(0->422) 00002000:00010000:0.0:1784191913.409439:0:166576:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af10fb61f80 00000100:00100000:0.0:1784191913.409466:0:166576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 47 00000100:00100000:0.0:1784191913.409476:0:166576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+45:69109:x1870858812472448:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:0.0:1784191913.409721:0:166576:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191913.409726:0:166576:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191913.409728:0:166576:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191913.409730:0:166576:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191913.409733:0:166576:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191913.409734:0:166576:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191913.410193:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812472576 00000100:00100000:2.0:1784191913.410199:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812472576 00000100:00100000:2.0:1784191913.410232:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 415 00000100:00100000:2.0:1784191913.410241:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+48:69110:x1870858812472576:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:0.0:1784191913.411045:0:166576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+48:69109:x1870858812472448:12345-192.168.204.16@tcp:4:cp.0 Request processed in 1566us (1706us total) trans 17179869262 rc 0/0 00000100:00100000:0.0:1784191913.411064:0:166576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 47 00002000:00100000:0.0:1784191913.411074:0:166576:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1d9:0x0] (0->422) req@ffff8af10fb61f80 x1870858812472448/t17179869262(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:84/0 lens 912/448 e 0 to 0 dl 1784191924 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191913.411084:0:166576:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10fb61f80 with x1870858812472448 ext(0->422) 00002000:00010000:0.0:1784191913.411089:0:166576:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af10fb61f80 00080000:00000400:0.0:1784191913.417054:0:166572:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:0.0:1784191913.417063:0:166572:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191913.417066:0:166572:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:0.0:1784191913.417068:0:166572:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191913.417070:0:166572:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191913.417072:0:166572:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000001:00080000:3.0:1784191913.419163:0:160977:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869262 is committed 00000001:00100000:3.0:1784191913.419183:0:160977:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1784191913.419427:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69110:x1870858812472576:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 9180us (10153us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191913.419439:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 415 00000100:00100000:0.0:1784191913.419846:0:166572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+46:69112:x1870858812472192:12345-192.168.204.16@tcp:4:cp.0 Request processed in 20661us (22774us total) trans 21474836571 rc 0/0 00000100:00100000:0.0:1784191913.419855:0:166572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 46 00002000:00100000:0.0:1784191913.419868:0:166572:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x25c:0x0] (0->37841) req@ffff8af22dcfd880 x1870858812472192/t21474836571(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:84/0 lens 488/448 e 0 to 0 dl 1784191924 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191913.419878:0:166572:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af22dcfd880 with x1870858812472192 ext(0->37841) 00002000:00010000:0.0:1784191913.419884:0:166572:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af22dcfd880 00000100:00100000:1.0:1784191913.483825:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827995008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784191913.483909:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191913.484179:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827995008 00000100:00100000:0.0:1784191913.484188:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827995008 00000100:00100000:0.0:1784191913.484246:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1784191913.484256:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827995008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784191913.484289:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1236992 granted 60233664 pending 65536 free 70426624 avail 63258624 00000100:00100000:0.0:1784191913.484355:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858827995008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191913.484362:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1784191913.484388:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784191913.484397:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827995136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784191913.484437:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191913.484488:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858827995008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784191913.484514:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827995136 00000100:00100000:0.0:1784191913.484518:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827995136 00000100:00100000:0.0:1784191913.484556:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1784191913.484563:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827995136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784191913.484575:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3444736 granted 60348352 pending 0 free 70664192 avail 63283200 00000100:00100000:0.0:1784191913.484609:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858827995136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191913.484615:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1784191913.484655:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858827995136:0@lo:13:osp-pre-1-1.0 10000000:01000000:2.0:1784191913.932127:0:158662:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784191913.932151:0:158662:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8af109051000 from 41 10000000:01000000:2.0:1784191913.932158:0:158662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784191913.932238:0:158662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b9a00/0xfeec3c2dc5a4d253 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.932254:0:158662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af1115b9a00/0xfeec3c2dc5a4d253 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.932269:0:158662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af1115b9a00/0xfeec3c2dc5a4d253 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191913.932464:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827995264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784191913.932568:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191913.932628:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e2840 going to sleep for 11 seconds 00000100:00100000:3.0:1784191913.932732:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827995264 00000100:00100000:3.0:1784191913.932742:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827995264 00000100:00100000:3.0:1784191913.932824:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784191913.932836:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+10:158662:x1870858827995264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784191913.932855:0:167176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191913.932877:0:167176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af10d08f600/0xfeec3c2dc5a4d25a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d253 expref: -99 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.932922:0:167176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af10d08f600/0xfeec3c2dc5a4d25a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d253 expref: 11 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.932935:0:167176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af10d08f600/0xfeec3c2dc5a4d25a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d253 expref: 11 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.932959:0:167176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d08f600, rc 0) 00000100:00100000:3.0:1784191913.933027:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+11:158662:x1870858827995264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191913.933035:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784191913.933610:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827995264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784191913.933633:0:158662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af1115b9a00/0xfeec3c2dc5a4d253 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d25a expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.933645:0:158662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af1115b9a00/0xfeec3c2dc5a4d253 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d25a expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191913.933758:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827995392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784191913.933811:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191913.933859:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e2840 going to sleep for 11 seconds 00000100:00100000:3.0:1784191913.934418:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827995392 00000100:00100000:3.0:1784191913.934427:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827995392 00000100:00100000:3.0:1784191913.934487:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784191913.934498:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1098c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+11:158662:x1870858827995392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784191913.934525:0:167178:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784191913.934544:0:167178:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784191913.934548:0:167178:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 41 00000100:00100000:3.0:1784191913.934677:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1098c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+11:158662:x1870858827995392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 180us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191913.934719:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784191913.934774:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827995392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784191913.934852:0:158662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784191913.934863:0:158662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b9a00/0xfeec3c2dc5a4d253 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d25a expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.934874:0:158662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af1115b9a00/0xfeec3c2dc5a4d253 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d25a expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784191913.934884:0:158662:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784191913.934887:0:158662:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8af22dcd8000 from 52 10000000:01000000:3.0:1784191913.934890:0:158662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784191913.935870:0:158662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d08ec00/0xfeec3c2dc5a4d261 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.935900:0:158662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af10d08ec00/0xfeec3c2dc5a4d261 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.935927:0:158662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af10d08ec00/0xfeec3c2dc5a4d261 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191913.935957:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827995520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784191913.936027:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191913.936162:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af20578b300 going to sleep for 11 seconds 00000100:00100000:2.0:1784191913.939498:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827995520 00000100:00100000:2.0:1784191913.939520:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827995520 00000100:00100000:2.0:1784191913.939611:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784191913.939623:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1098c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+11:158662:x1870858827995520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784191913.939647:0:167176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191913.939673:0:167176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af1115b8400/0xfeec3c2dc5a4d268 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d261 expref: -99 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.939730:0:167176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af1115b8400/0xfeec3c2dc5a4d268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d261 expref: 12 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.939743:0:167176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af1115b8400/0xfeec3c2dc5a4d268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d261 expref: 12 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.939776:0:167176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8400, rc 0) 00000100:00100000:2.0:1784191913.939870:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1098c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+12:158662:x1870858827995520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 248us (3842us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191913.939877:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784191913.943132:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827995520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784191913.943184:0:158662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af10d08ec00/0xfeec3c2dc5a4d261 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d268 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.943200:0:158662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af10d08ec00/0xfeec3c2dc5a4d261 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d268 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191913.943337:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827995648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784191913.943417:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191913.943472:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af20578b300 going to sleep for 11 seconds 00000100:00100000:3.0:1784191913.943496:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827995648 00000100:00100000:3.0:1784191913.943503:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827995648 00000100:00100000:3.0:1784191913.943560:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784191913.943569:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1098c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+12:158662:x1870858827995648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784191913.943780:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1098c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+12:158662:x1870858827995648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 211us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191913.943788:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784191913.943846:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827995648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784191913.943874:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827995776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784191913.943929:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191913.943948:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ea98300 going to sleep for 11 seconds 00000100:00100000:3.0:1784191913.943963:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827995776 00000100:00100000:3.0:1784191913.943968:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827995776 00000100:00100000:3.0:1784191913.943993:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784191913.943999:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cfd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+12:158662:x1870858827995776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784191913.944091:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cfd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+12:158662:x1870858827995776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191913.944099:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784191913.944154:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827995776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784191913.944885:0:167227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784191913.944967:0:158662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784191913.944993:0:158662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784191913.945005:0:158662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d08ec00/0xfeec3c2dc5a4d261 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d268 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.945017:0:158662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af10d08ec00/0xfeec3c2dc5a4d261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d268 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784191913.945028:0:158662:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784191913.945031:0:158662:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8af22dcd8000 from 38 10000000:01000000:3.0:1784191913.945034:0:158662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784191913.945069:0:158662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d08f800/0xfeec3c2dc5a4d26f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.945090:0:158662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af10d08f800/0xfeec3c2dc5a4d26f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.945101:0:158662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af10d08f800/0xfeec3c2dc5a4d26f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191913.945121:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827995904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784191913.945177:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191913.945199:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2029ec480 going to sleep for 11 seconds 00000100:00100000:3.0:1784191913.945216:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827995904 00000100:00100000:3.0:1784191913.945221:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827995904 00000100:00100000:3.0:1784191913.945257:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784191913.945265:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cfd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+12:158662:x1870858827995904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784191913.945277:0:167178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191913.945293:0:167178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af10d08ea00/0xfeec3c2dc5a4d276 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d26f expref: -99 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.945317:0:167178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af10d08ea00/0xfeec3c2dc5a4d276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d26f expref: 13 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.945329:0:167178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af10d08ea00/0xfeec3c2dc5a4d276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d26f expref: 13 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.945338:0:167178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d08ea00, rc 0) 00000100:00100000:3.0:1784191913.945374:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cfd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+13:158662:x1870858827995904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191913.945380:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784191913.945427:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827995904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784191913.945440:0:158662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af10d08f800/0xfeec3c2dc5a4d26f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d276 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.945450:0:158662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af10d08f800/0xfeec3c2dc5a4d26f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d276 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191913.945499:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827996032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784191913.945532:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191913.945548:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2029ec480 going to sleep for 11 seconds 00000100:00100000:3.0:1784191913.945561:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827996032 00000100:00100000:3.0:1784191913.945564:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827996032 00000100:00100000:3.0:1784191913.945584:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784191913.945589:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cfd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+13:158662:x1870858827996032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784191913.945604:0:167176:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784191913.945624:0:167176:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784191913.945628:0:167176:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1784191913.945631:0:167176:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1784191913.945633:0:167176:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1784191913.945636:0:167176:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 41 00000100:00100000:3.0:1784191913.945738:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cfd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+13:158662:x1870858827996032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 147us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191913.945745:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784191913.945773:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827996032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784191913.945848:0:158662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784191913.945854:0:158662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d08f800/0xfeec3c2dc5a4d26f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d276 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.945871:0:158662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af10d08f800/0xfeec3c2dc5a4d26f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d276 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784191913.945879:0:158662:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1784191913.945880:0:158662:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1784191913.945882:0:158662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1784191913.945895:0:158662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d08fe00/0xfeec3c2dc5a4d27d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.945903:0:158662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af10d08fe00/0xfeec3c2dc5a4d27d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.945911:0:158662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af10d08fe00/0xfeec3c2dc5a4d27d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191913.945922:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827996160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784191913.945947:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191913.945961:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2029ec480 going to sleep for 11 seconds 00000100:00100000:3.0:1784191913.945973:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827996160 00000100:00100000:3.0:1784191913.945975:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827996160 00000100:00100000:3.0:1784191913.945996:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784191913.946002:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+13:158662:x1870858827996160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784191913.946009:0:167178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191913.946019:0:167178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af10d08ee00/0xfeec3c2dc5a4d284 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d27d expref: -99 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.946033:0:167178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af10d08ee00/0xfeec3c2dc5a4d284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d27d expref: 14 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.946052:0:167178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af10d08ee00/0xfeec3c2dc5a4d284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d27d expref: 14 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.946060:0:167178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d08ee00, rc 0) 00000100:00100000:3.0:1784191913.946091:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+14:158662:x1870858827996160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191913.946097:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784191913.946128:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827996160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784191913.956214:0:158662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af10d08fe00/0xfeec3c2dc5a4d27d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d284 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.956252:0:158662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af10d08fe00/0xfeec3c2dc5a4d27d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d284 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191913.958887:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827996288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784191913.959005:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191913.959618:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2029ec480 going to sleep for 11 seconds 00000100:00100000:2.0:1784191913.971531:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827996288 00000100:00100000:2.0:1784191913.971551:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827996288 00000100:00100000:2.0:1784191913.971630:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784191913.971642:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+14:158662:x1870858827996288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784191913.971947:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+14:158662:x1870858827996288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (12937us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191913.971956:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784191913.972034:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827996288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784191913.972118:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827996416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784191913.972194:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191913.972230:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784191913.972244:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827996416 00000100:00100000:2.0:1784191913.972247:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827996416 00000100:00100000:2.0:1784191913.972271:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784191913.972277:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+14:158662:x1870858827996416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784191913.978920:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+14:158662:x1870858827996416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6617us (6701us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191913.978941:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784191913.980639:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827996416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784191913.981909:0:167229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1784191913.982332:0:158662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1784191913.982370:0:158662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1784191913.982385:0:158662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d08fe00/0xfeec3c2dc5a4d27d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d284 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191913.982400:0:158662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af10d08fe00/0xfeec3c2dc5a4d27d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d284 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191913.982411:0:158662:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1784191913.982414:0:158662:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8af22dcd8000 from 1 10000000:01000000:1.0:1784191913.982418:0:158662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784191913.982496:0:158662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10de3ec00/0xfeec3c2dc5a4d28b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191913.982506:0:158662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af10de3ec00/0xfeec3c2dc5a4d28b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191913.982519:0:158662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af10de3ec00/0xfeec3c2dc5a4d28b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191913.982551:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827996544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784191913.982649:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191913.982727:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f82f480 going to sleep for 11 seconds 00000100:00100000:2.0:1784191913.982851:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827996544 00000100:00100000:2.0:1784191913.982861:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827996544 00000100:00100000:2.0:1784191913.982943:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784191913.982954:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+14:158662:x1870858827996544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784191913.982971:0:167176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191913.982986:0:167176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af1115b9000/0xfeec3c2dc5a4d292 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d28b expref: -99 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.983018:0:167176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af1115b9000/0xfeec3c2dc5a4d292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d28b expref: 15 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.983030:0:167176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af1115b9000/0xfeec3c2dc5a4d292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d28b expref: 15 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.983040:0:167176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b9000, rc 0) 00000100:00100000:2.0:1784191913.983111:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+15:158662:x1870858827996544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191913.983118:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784191913.983194:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827996544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784191913.983210:0:158662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af10de3ec00/0xfeec3c2dc5a4d28b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d292 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.983220:0:158662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af10de3ec00/0xfeec3c2dc5a4d28b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d292 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784191913.983244:0:158662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784191913.983249:0:158662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10de3ec00/0xfeec3c2dc5a4d28b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d292 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.983256:0:158662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af10de3ec00/0xfeec3c2dc5a4d28b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d292 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784191913.983271:0:158662:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784191913.983273:0:158662:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af22dcd8000 from 7 10000000:01000000:2.0:1784191913.983276:0:158662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784191913.983294:0:158662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b8000/0xfeec3c2dc5a4d299 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.983301:0:158662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af1115b8000/0xfeec3c2dc5a4d299 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.983321:0:158662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af1115b8000/0xfeec3c2dc5a4d299 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191913.983337:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827996672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784191913.983366:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191913.983391:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827996672 00000100:00100000:2.0:1784191913.983395:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827996672 00000100:00100000:2.0:1784191913.983422:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784191913.983429:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+15:158662:x1870858827996672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784191913.983436:0:167181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191913.983446:0:167181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af1115b8600/0xfeec3c2dc5a4d2a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d299 expref: -99 pid: 167181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.983460:0:167181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af1115b8600/0xfeec3c2dc5a4d2a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d299 expref: 16 pid: 167181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.983469:0:167181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af1115b8600/0xfeec3c2dc5a4d2a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d299 expref: 16 pid: 167181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.983489:0:167181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8600, rc 0) 00000100:00100000:2.0:1784191913.983512:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+16:158662:x1870858827996672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191913.983518:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784191913.983550:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784191913.983565:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827996672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784191913.983575:0:158662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af1115b8000/0xfeec3c2dc5a4d299 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2a0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191913.983583:0:158662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af1115b8000/0xfeec3c2dc5a4d299 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d2a0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191913.983648:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827996800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784191913.983674:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191913.983714:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784191913.983728:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827996800 00000100:00100000:2.0:1784191913.983731:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827996800 00000100:00100000:2.0:1784191913.983751:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784191913.983758:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+16:158662:x1870858827996800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784191913.983887:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+16:158662:x1870858827996800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191913.983894:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784191913.983925:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827996800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784191913.983953:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827996928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784191913.984002:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191913.984016:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af110e63900 going to sleep for 11 seconds 00000100:00100000:2.0:1784191913.984029:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827996928 00000100:00100000:2.0:1784191913.984032:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827996928 00000100:00100000:2.0:1784191913.984055:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784191913.984061:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+16:158662:x1870858827996928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784191913.984158:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+16:158662:x1870858827996928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191913.984165:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784191913.984209:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827996928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784191913.996813:0:167230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784191913.997207:0:158662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784191913.997243:0:158662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784191913.997259:0:158662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b8000/0xfeec3c2dc5a4d299 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2a0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.997275:0:158662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af1115b8000/0xfeec3c2dc5a4d299 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2a0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784191913.997288:0:158662:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784191913.997292:0:158662:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8af107838800 from 52 10000000:01000000:3.0:1784191913.997332:0:158662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784191913.997391:0:158662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d08f200/0xfeec3c2dc5a4d2a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.997399:0:158662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af10d08f200/0xfeec3c2dc5a4d2a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.997413:0:158662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af10d08f200/0xfeec3c2dc5a4d2a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191913.997446:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827997056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784191913.997538:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191913.997610:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2029ec0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191913.997769:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827997056 00000100:00100000:0.0:1784191913.997779:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827997056 00000100:00100000:0.0:1784191913.997850:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784191913.997862:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+16:158662:x1870858827997056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784191913.997880:0:167181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191913.997897:0:167181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af20c0ab200/0xfeec3c2dc5a4d2ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d2a7 expref: -99 pid: 167181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.997937:0:167181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af20c0ab200/0xfeec3c2dc5a4d2ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d2a7 expref: 17 pid: 167181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.997950:0:167181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af20c0ab200/0xfeec3c2dc5a4d2ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d2a7 expref: 17 pid: 167181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191913.997962:0:167181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20c0ab200, rc 0) 00000100:00100000:0.0:1784191913.998014:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+17:158662:x1870858827997056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191913.998022:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784191913.998202:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827997056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784191913.998221:0:158662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af10d08f200/0xfeec3c2dc5a4d2a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2ae expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191913.998232:0:158662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af10d08f200/0xfeec3c2dc5a4d2a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d2ae expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191913.998325:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827997184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784191913.998360:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191913.998394:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827997184 00000100:00100000:3.0:1784191913.998397:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827997184 00000100:00100000:3.0:1784191913.998438:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784191913.998444:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+17:158662:x1870858827997184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784191913.998589:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+17:158662:x1870858827997184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191913.998609:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784191913.998635:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2029ec0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191913.998648:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827997184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784191913.998681:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827997312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784191913.998755:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191913.999339:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2029ec0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191914.003210:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827997312 00000100:00100000:0.0:1784191914.003234:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827997312 00000100:00100000:0.0:1784191914.003323:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784191914.003337:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+17:158662:x1870858827997312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784191914.003578:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+17:158662:x1870858827997312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (4822us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191914.003588:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784191914.003728:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827997312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784191914.008045:0:167232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1784191914.008915:0:158662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1784191914.008975:0:158662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784191914.008993:0:158662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d08f200/0xfeec3c2dc5a4d2a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2ae expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191914.009009:0:158662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af10d08f200/0xfeec3c2dc5a4d2a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2ae expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784191914.009022:0:158662:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1784191914.009025:0:158662:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1784191914.009029:0:158662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784191914.009099:0:158662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b9400/0xfeec3c2dc5a4d2b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191914.009109:0:158662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af1115b9400/0xfeec3c2dc5a4d2b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191914.009127:0:158662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af1115b9400/0xfeec3c2dc5a4d2b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191914.009188:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827997440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784191914.009295:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191914.010488:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af110e63900 going to sleep for 11 seconds 00000100:00100000:0.0:1784191914.011211:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827997440 00000100:00100000:0.0:1784191914.011224:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827997440 00000100:00100000:0.0:1784191914.011383:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784191914.011398:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+17:158662:x1870858827997440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784191914.011420:0:167176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191914.011443:0:167176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af20c0ab800/0xfeec3c2dc5a4d2bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d2b5 expref: -99 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191914.011499:0:167176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af20c0ab800/0xfeec3c2dc5a4d2bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d2b5 expref: 18 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191914.011513:0:167176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af20c0ab800/0xfeec3c2dc5a4d2bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d2b5 expref: 18 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191914.011523:0:167176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20c0ab800, rc 0) 00000100:00100000:0.0:1784191914.011612:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+18:158662:x1870858827997440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191914.011620:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784191914.011717:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827997440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784191914.011738:0:158662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af1115b9400/0xfeec3c2dc5a4d2b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2bc expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191914.011749:0:158662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af1115b9400/0xfeec3c2dc5a4d2b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d2bc expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191914.011852:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827997568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784191914.011895:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191914.011917:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23f592c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191914.011934:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827997568 00000100:00100000:0.0:1784191914.011937:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827997568 00000100:00100000:0.0:1784191914.011963:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784191914.011971:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+18:158662:x1870858827997568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784191914.014147:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+18:158662:x1870858827997568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2155us (2230us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191914.014178:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784191914.016424:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827997568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784191914.016522:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827997696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784191914.016626:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191914.016678:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af110e63240 going to sleep for 11 seconds 00000100:00100000:2.0:1784191914.016736:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827997696 00000100:00100000:2.0:1784191914.016744:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827997696 00000100:00100000:2.0:1784191914.016810:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784191914.016820:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+18:158662:x1870858827997696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784191914.018405:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+18:158662:x1870858827997696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1578us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191914.018422:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784191914.021097:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827997696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784191914.024584:0:167233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1784191914.024901:0:158662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1784191914.024947:0:158662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784191914.024965:0:158662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b9400/0xfeec3c2dc5a4d2b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2bc expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191914.024979:0:158662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af1115b9400/0xfeec3c2dc5a4d2b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2bc expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784191914.024990:0:158662:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784191914.024994:0:158662:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af107838800 from 7 10000000:01000000:2.0:1784191914.024997:0:158662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784191914.025049:0:158662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4d2c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191914.025085:0:158662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4d2c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191914.025098:0:158662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4d2c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191914.025131:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827997824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784191914.025234:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191914.025291:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af110e63cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191914.025454:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827997824 00000100:00100000:1.0:1784191914.025465:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827997824 00000100:00100000:1.0:1784191914.025525:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784191914.025537:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+18:158662:x1870858827997824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784191914.025554:0:167178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191914.025573:0:167178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af10de3fe00/0xfeec3c2dc5a4d2ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d2c3 expref: -99 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191914.025602:0:167178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af10de3fe00/0xfeec3c2dc5a4d2ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d2c3 expref: 19 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191914.025615:0:167178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af10de3fe00/0xfeec3c2dc5a4d2ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d2c3 expref: 19 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191914.025625:0:167178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3fe00, rc 0) 00000100:00100000:1.0:1784191914.025719:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+19:158662:x1870858827997824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191914.025728:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784191914.025830:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827997824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784191914.025846:0:158662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4d2c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2ca expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191914.025857:0:158662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4d2c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d2ca expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191914.025931:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827997952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784191914.025960:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191914.025994:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af110e63cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191914.026229:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827997952 00000100:00100000:1.0:1784191914.026234:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827997952 00000100:00100000:1.0:1784191914.026270:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784191914.026278:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+19:158662:x1870858827997952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784191914.026544:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+19:158662:x1870858827997952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191914.026551:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784191914.026619:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827997952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784191914.026655:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827998080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784191914.026741:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191914.026757:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af110e63cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784191914.026841:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827998080 00000100:00100000:1.0:1784191914.026845:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827998080 00000100:00100000:1.0:1784191914.026876:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784191914.026882:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+19:158662:x1870858827998080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784191914.027298:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+19:158662:x1870858827998080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 413us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191914.027306:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784191914.032404:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827998080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784191914.033609:0:167234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784191914.034201:0:158662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784191914.034241:0:158662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784191914.034258:0:158662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4d2c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2ca expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191914.034274:0:158662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af1115b9e00/0xfeec3c2dc5a4d2c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2ca expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784191914.034286:0:158662:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784191914.034289:0:158662:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8af10c3af800 from 52 10000000:01000000:3.0:1784191914.034293:0:158662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784191914.034366:0:158662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d08fc00/0xfeec3c2dc5a4d2d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191914.034377:0:158662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af10d08fc00/0xfeec3c2dc5a4d2d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191914.034388:0:158662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af10d08fc00/0xfeec3c2dc5a4d2d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191914.034423:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827998208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784191914.034518:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191914.034597:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2029ec0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191914.034770:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827998208 00000100:00100000:2.0:1784191914.034789:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827998208 00000100:00100000:2.0:1784191914.034866:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784191914.034878:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+19:158662:x1870858827998208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784191914.034898:0:167179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191914.034942:0:167179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af1115b8800/0xfeec3c2dc5a4d2d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d2d1 expref: -99 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191914.034976:0:167179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af1115b8800/0xfeec3c2dc5a4d2d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d2d1 expref: 20 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191914.034990:0:167179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af1115b8800/0xfeec3c2dc5a4d2d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d2d1 expref: 20 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191914.035004:0:167179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8800, rc 0) 00000100:00100000:2.0:1784191914.035502:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+20:158662:x1870858827998208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 624us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191914.035512:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784191914.035607:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827998208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784191914.035628:0:158662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af10d08fc00/0xfeec3c2dc5a4d2d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2d8 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191914.035641:0:158662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af10d08fc00/0xfeec3c2dc5a4d2d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d2d8 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191914.035770:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827998336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784191914.035816:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191914.035840:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af110e63600 going to sleep for 11 seconds 00000100:00100000:2.0:1784191914.035861:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827998336 00000100:00100000:2.0:1784191914.035876:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827998336 00000100:00100000:2.0:1784191914.035918:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784191914.035925:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+20:158662:x1870858827998336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784191914.036531:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+20:158662:x1870858827998336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 604us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191914.036541:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784191914.036762:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827998336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784191914.036808:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827998464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784191914.036862:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191914.036889:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2029ecd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784191914.037170:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827998464 00000100:00100000:2.0:1784191914.037177:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827998464 00000100:00100000:2.0:1784191914.037216:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784191914.037224:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+20:158662:x1870858827998464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784191914.037524:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+20:158662:x1870858827998464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 300us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191914.037532:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784191914.037614:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827998464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784191914.043654:0:167235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1784191914.044171:0:158662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1784191914.044212:0:158662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784191914.044227:0:158662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d08fc00/0xfeec3c2dc5a4d2d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2d8 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191914.044243:0:158662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af10d08fc00/0xfeec3c2dc5a4d2d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2d8 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784191914.044254:0:158662:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1784191914.044257:0:158662:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1784191914.044260:0:158662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784191914.045173:0:158662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af20c0aaa00/0xfeec3c2dc5a4d2df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191914.045191:0:158662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af20c0aaa00/0xfeec3c2dc5a4d2df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191914.045206:0:158662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af20c0aaa00/0xfeec3c2dc5a4d2df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191914.046573:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827998592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784191914.046714:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191914.046767:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ecac480 going to sleep for 11 seconds 00000100:00100000:2.0:1784191914.046923:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827998592 00000100:00100000:2.0:1784191914.046935:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827998592 00000100:00100000:2.0:1784191914.047014:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784191914.047026:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+20:158662:x1870858827998592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784191914.047049:0:167176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191914.047721:0:167176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af20c0aba00/0xfeec3c2dc5a4d2e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d2df expref: -99 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191914.047765:0:167176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af20c0aba00/0xfeec3c2dc5a4d2e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d2df expref: 21 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191914.047781:0:167176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af20c0aba00/0xfeec3c2dc5a4d2e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d2df expref: 21 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191914.047815:0:167176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20c0aba00, rc 0) 00000100:00100000:0.0:1784191914.047894:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:158662:x1870858827998592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 868us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191914.047901:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784191914.048191:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827998592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784191914.048214:0:158662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af20c0aaa00/0xfeec3c2dc5a4d2df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2e6 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191914.048225:0:158662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af20c0aaa00/0xfeec3c2dc5a4d2df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d2e6 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191914.048364:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827998720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784191914.048409:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191914.048485:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ecac480 going to sleep for 11 seconds 00000100:00100000:2.0:1784191914.048580:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827998720 00000100:00100000:2.0:1784191914.048587:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827998720 00000100:00100000:2.0:1784191914.048664:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784191914.048674:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:158662:x1870858827998720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784191914.048899:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:158662:x1870858827998720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191914.048907:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784191914.048993:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827998720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784191914.049036:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827998848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784191914.049098:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191914.049434:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23f592b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784191914.049490:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827998848 00000100:00100000:1.0:1784191914.049496:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827998848 00000100:00100000:1.0:1784191914.049564:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784191914.049574:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:158662:x1870858827998848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784191914.050671:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:158662:x1870858827998848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1091us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191914.050684:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784191914.050999:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827998848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784191914.053840:0:167236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1784191914.054176:0:158662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1784191914.054214:0:158662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784191914.054230:0:158662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af20c0aaa00/0xfeec3c2dc5a4d2df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2e6 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191914.054246:0:158662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af20c0aaa00/0xfeec3c2dc5a4d2df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2e6 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191914.054259:0:158662:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784191914.054263:0:158662:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af10c3af800 from 7 10000000:01000000:1.0:1784191914.054267:0:158662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784191914.054337:0:158662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10de3fa00/0xfeec3c2dc5a4d2ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191914.054347:0:158662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af10de3fa00/0xfeec3c2dc5a4d2ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191914.054375:0:158662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af10de3fa00/0xfeec3c2dc5a4d2ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191914.054413:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101684700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827998976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784191914.054516:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191914.054582:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10ecac300 going to sleep for 11 seconds 00000100:00100000:0.0:1784191914.054736:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827998976 00000100:00100000:0.0:1784191914.054747:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827998976 00000100:00100000:0.0:1784191914.054817:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784191914.054831:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:158662:x1870858827998976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784191914.054850:0:167176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191914.054870:0:167176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af20c0aa400/0xfeec3c2dc5a4d2f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d2ed expref: -99 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191914.054904:0:167176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af20c0aa400/0xfeec3c2dc5a4d2f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d2ed expref: 22 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191914.054919:0:167176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af20c0aa400/0xfeec3c2dc5a4d2f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d2ed expref: 22 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191914.054938:0:167176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20c0aa400, rc 0) 00000100:00100000:0.0:1784191914.055008:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:158662:x1870858827998976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191914.055016:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784191914.055217:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101684700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827998976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784191914.055237:0:158662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af10de3fa00/0xfeec3c2dc5a4d2ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2f4 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191914.055248:0:158662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af10de3fa00/0xfeec3c2dc5a4d2ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d2f4 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191914.055410:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827999104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784191914.055453:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191914.055529:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2029ec480 going to sleep for 11 seconds 00000100:00100000:0.0:1784191914.055626:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827999104 00000100:00100000:0.0:1784191914.055631:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827999104 00000100:00100000:0.0:1784191914.055667:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784191914.055676:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10efef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:158662:x1870858827999104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784191914.055882:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10efef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:158662:x1870858827999104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191914.055891:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784191914.056010:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827999104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784191914.056045:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827999232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784191914.056190:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191914.056218:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2029ec480 going to sleep for 11 seconds 00000100:00100000:0.0:1784191914.056284:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827999232 00000100:00100000:0.0:1784191914.056288:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827999232 00000100:00100000:0.0:1784191914.056417:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784191914.056427:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10efecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:158662:x1870858827999232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784191914.056533:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10efecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:158662:x1870858827999232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191914.056541:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784191914.056797:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827999232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784191914.057948:0:167237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784191914.058288:0:158662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784191914.058420:0:158662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784191914.058435:0:158662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10de3fa00/0xfeec3c2dc5a4d2ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2f4 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191914.058449:0:158662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af10de3fa00/0xfeec3c2dc5a4d2ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2f4 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784191914.058461:0:158662:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784191914.058464:0:158662:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8af107b719c0 from 1 10000000:01000000:3.0:1784191914.058467:0:158662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784191914.058517:0:158662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d08fa00/0xfeec3c2dc5a4d2fb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191914.058527:0:158662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af10d08fa00/0xfeec3c2dc5a4d2fb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191914.058539:0:158662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af10d08fa00/0xfeec3c2dc5a4d2fb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191914.058571:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827999360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784191914.061397:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191914.061469:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827999360 00000100:00100000:3.0:1784191914.061480:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827999360 00000100:00100000:3.0:1784191914.061553:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784191914.061565:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10efec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:158662:x1870858827999360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784191914.061588:0:167181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191914.061615:0:167181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af10d08e200/0xfeec3c2dc5a4d302 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d2fb expref: -99 pid: 167181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191914.061999:0:167181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af10d08e200/0xfeec3c2dc5a4d302 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d2fb expref: 23 pid: 167181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191914.062037:0:167181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af10d08e200/0xfeec3c2dc5a4d302 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d2fb expref: 23 pid: 167181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191914.062051:0:167181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d08e200, rc 0) 00000100:00100000:3.0:1784191914.062212:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10efec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:158662:x1870858827999360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 648us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191914.062222:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784191914.062316:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2029ec480 going to sleep for 11 seconds 00000100:00100000:3.0:1784191914.062351:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827999360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784191914.062372:0:158662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af10d08fa00/0xfeec3c2dc5a4d2fb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d302 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191914.062384:0:158662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af10d08fa00/0xfeec3c2dc5a4d2fb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d302 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784191914.062413:0:158662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784191914.062421:0:158662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d08fa00/0xfeec3c2dc5a4d2fb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d302 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191914.062430:0:158662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af10d08fa00/0xfeec3c2dc5a4d2fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d302 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784191914.062441:0:158662:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784191914.062444:0:158662:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8af107b719c0 from 1 10000000:01000000:3.0:1784191914.062448:0:158662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784191914.062481:0:158662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d08e000/0xfeec3c2dc5a4d309 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191914.062502:0:158662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af10d08e000/0xfeec3c2dc5a4d309 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191914.062512:0:158662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af10d08e000/0xfeec3c2dc5a4d309 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191914.062541:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827999488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784191914.062582:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191914.062724:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af2029ec480 going to sleep for 11 seconds 00000100:00100000:1.0:1784191914.063013:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827999488 00000100:00100000:1.0:1784191914.063022:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827999488 00000100:00100000:1.0:1784191914.063227:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784191914.063238:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10efec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:158662:x1870858827999488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784191914.063253:0:167178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191914.063271:0:167178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af10de3f800/0xfeec3c2dc5a4d310 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d309 expref: -99 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191914.063293:0:167178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af10de3f800/0xfeec3c2dc5a4d310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d309 expref: 24 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191914.063406:0:167178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af10de3f800/0xfeec3c2dc5a4d310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d309 expref: 24 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191914.063419:0:167178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3f800, rc 0) 00000100:00100000:1.0:1784191914.063484:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10efec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:158662:x1870858827999488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 248us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191914.063491:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784191914.063599:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827999488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784191914.063616:0:158662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af10d08e000/0xfeec3c2dc5a4d309 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d310 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191914.063626:0:158662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af10d08e000/0xfeec3c2dc5a4d309 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d310 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191914.063748:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827999616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784191914.063789:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191914.063822:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23392a780 going to sleep for 11 seconds 00000100:00100000:1.0:1784191914.063898:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827999616 00000100:00100000:1.0:1784191914.063903:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827999616 00000100:00100000:1.0:1784191914.063942:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784191914.063948:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10efee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:158662:x1870858827999616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784191914.064034:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10efee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:158662:x1870858827999616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (245us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784191914.064041:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784191914.064177:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858827999616:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1784191914.064216:0:158662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784191914.064231:0:158662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d08e000/0xfeec3c2dc5a4d309 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d310 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191914.064240:0:158662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af10d08e000/0xfeec3c2dc5a4d309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d310 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191914.064479:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191914.835434:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191914.835494:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191914.835539:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191914.835596:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812473088 00000100:00100000:3.0:1784191914.835608:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812473088 00000100:00100000:3.0:1784191914.835666:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812473216 00000100:00100000:3.0:1784191914.835670:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812473216 00000100:00100000:3.0:1784191914.835723:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 194 00000100:00100000:3.0:1784191914.835737:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+46:69109:x1870858812473088:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191914.835833:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+46:69109:x1870858812473088:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 98us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191914.835841:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 194 00000100:00100000:3.0:1784191914.835862:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 195 00000100:00100000:3.0:1784191914.835869:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69109:x1870858812473216:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191914.835896:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69109:x1870858812473216:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 28us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191914.835919:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 195 00000100:00100000:2.0:1784191914.836310:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812472832 00000100:00100000:2.0:1784191914.836323:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812472832 00000100:00100000:2.0:1784191914.836359:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 787 00000100:00100000:2.0:1784191914.836366:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:69108:x1870858812472832:12345-192.168.204.16@tcp:38:kworker.0 00010000:00080000:2.0:1784191914.836402:0:158667:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '62ac9b09-d016-4ae6-b1b1-fe120a3abe0a' at ffff8af206bcc800, cookie 0xfeec3c2dc5a4d1a4 00010000:00080000:2.0:1784191914.836409:0:158667:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp recovering/t0 exp ffff8af206bcc800 cur 5535 last 1784191913 00010000:02000400:2.0:1784191914.836420:0:158667:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00100000:3.0:1784191914.837408:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191914.837456:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191914.837483:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812472960 00000100:00100000:3.0:1784191914.837490:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812472960 00000100:00100000:3.0:1784191914.837553:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 376 00000100:00100000:3.0:1784191914.837562:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812472960:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191914.837671:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812472704 00000100:00100000:0.0:1784191914.837677:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812472704 00000100:00100000:0.0:1784191914.837734:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 60 00000100:00100000:0.0:1784191914.837740:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2028c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:69112:x1870858812472704:12345-192.168.204.16@tcp:400:kworker.0 00000020:00080000:0.0:1784191914.837748:0:167179:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.16@tcp 00000100:00100000:0.0:1784191914.837816:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2028c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:69112:x1870858812472704:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 74us (358us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784191914.837825:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 60 00000100:00100000:3.0:1784191914.838862:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812472960:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 1290us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191914.838874:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 376 00000100:00080000:3.0:1784191914.838908:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1784191914.847606:0:158667:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1784191914.848962:0:158667:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784191914.849223:0:158667:0:(import.c:65:import_set_state_nolock()) ffff8af10c368000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784191914.849363:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69108:x1870858812472832:12345-192.168.204.16@tcp:38:kworker.0 Request processed in 12994us (13943us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191914.849380:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 787 00000100:00100000:0.0:1784191914.873828:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191914.873930:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812473344 00000100:00100000:3.0:1784191914.873944:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812473344 00000100:00100000:3.0:1784191914.873996:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 61 00000100:00100000:3.0:1784191914.874006:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2028c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:69108:x1870858812473344:12345-192.168.204.16@tcp:250:ptlrpcd_00_03.0 00010000:00080000:3.0:1784191914.874045:0:167176:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 9424fd8d-001c-4ed5-89e0-95e0bf2d2c97@192.168.204.16@tcp t0 exp 0000000000000000 cur 5535 last 0 00000020:00000080:3.0:1784191914.874089:0:167176:0:(genops.c:1406:class_connect()) connect: client 9424fd8d-001c-4ed5-89e0-95e0bf2d2c97, cookie 0xfeec3c2dc5a4d317 00000100:00080000:3.0:1784191914.874422:0:167176:0:(import.c:65:import_set_state_nolock()) ffff8af1093ac800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784191914.874521:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2028c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+5:69108:x1870858812473344:12345-192.168.204.16@tcp:250:ptlrpcd_00_03.0 Request processed in 515us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191914.874530:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 61 00000100:00100000:3.0:1784191914.880307:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191914.880418:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812473472 00000100:00100000:0.0:1784191914.880432:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812473472 00000100:00100000:0.0:1784191914.880508:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 788 00000100:00100000:0.0:1784191914.880521:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69108:x1870858812473472:12345-192.168.204.16@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1784191914.880559:0:164531:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8af23310b100 x1870858812473472/t0(0) o101->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:85/0 lens 328/0 e 0 to 0 dl 1784191925 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784191914.880599:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69108:x1870858812473472:12345-192.168.204.16@tcp:101:ldlm_lock_repla.0 Request processed in 82us (310us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784191914.880619:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 788 00010000:00080000:1.0:1784191914.880711:0:167204:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:1.0:1784191915.086308:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191915.997939:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191915.998047:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812473600 00000100:00100000:1.0:1784191915.998061:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812473600 00000100:00100000:1.0:1784191915.998158:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 62 00000100:00100000:1.0:1784191915.998172:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10138c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+5:122642:x1870858812473600:12345-192.168.204.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784191915.998202:0:167179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191915.998231:0:167179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af10de3f600/0xfeec3c2dc5a4d31e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c3a5 expref: -99 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191915.998282:0:167179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af10de3f600/0xfeec3c2dc5a4d31e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3a5 expref: 6 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191915.998295:0:167179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af10de3f600/0xfeec3c2dc5a4d31e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3a5 expref: 6 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191915.998305:0:167179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3f600, rc 0) 00000100:00100000:1.0:1784191915.998387:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10138c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+6:122642:x1870858812473600:12345-192.168.204.16@tcp:101:ll_cfg_requeue.0 Request processed in 218us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191915.998395:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 62 00000100:00100000:3.0:1784191916.000768:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191916.001078:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812473728 00000100:00100000:2.0:1784191916.001107:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812473728 00000100:00100000:2.0:1784191916.001188:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 63 00000100:00100000:2.0:1784191916.001205:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10138d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+6:122642:x1870858812473728:12345-192.168.204.16@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784191916.001238:0:167181:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1784191916.001271:0:167181:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784191916.001275:0:167181:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1784191916.001278:0:167181:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1784191916.001281:0:167181:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1784191916.001284:0:167181:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 41 00000100:00100000:2.0:1784191916.004358:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10138d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+6:122642:x1870858812473728:12345-192.168.204.16@tcp:256:ll_cfg_requeue.0 Request processed in 3127us (3578us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191916.004384:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 63 00000100:00100000:0.0:1784191916.015488:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191916.015741:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812473856 00000100:00100000:2.0:1784191916.015759:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812473856 00000100:00100000:2.0:1784191916.015892:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 64 00000100:00100000:2.0:1784191916.015904:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af206f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+6:122642:x1870858812473856:12345-192.168.204.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784191916.015926:0:167179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191916.015955:0:167179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af1115b8e00/0xfeec3c2dc5a4d325 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c3ac expref: -99 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191916.016006:0:167179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af1115b8e00/0xfeec3c2dc5a4d325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3ac expref: 7 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191916.016027:0:167179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af1115b8e00/0xfeec3c2dc5a4d325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3ac expref: 7 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191916.016038:0:167179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8e00, rc 0) 00000100:00100000:2.0:1784191916.016183:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af206f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+7:122642:x1870858812473856:12345-192.168.204.16@tcp:101:ll_cfg_requeue.0 Request processed in 279us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191916.016192:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 64 00000100:00100000:3.0:1784191916.042568:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191916.042676:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812473984 00000100:00100000:1.0:1784191916.042715:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812473984 00000100:00100000:1.0:1784191916.042797:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 65 00000100:00100000:1.0:1784191916.042826:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+7:122642:x1870858812473984:12345-192.168.204.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784191916.043061:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+8:122642:x1870858812473984:12345-192.168.204.16@tcp:501:ll_cfg_requeue.0 Request processed in 238us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191916.043070:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 65 00000100:00100000:3.0:1784191916.055825:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191916.057349:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812474112 00000100:00100000:2.0:1784191916.057374:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812474112 00000100:00100000:2.0:1784191916.057479:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 66 00000100:00100000:2.0:1784191916.057494:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1014f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+8:122642:x1870858812474112:12345-192.168.204.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784191916.057758:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1014f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+8:122642:x1870858812474112:12345-192.168.204.16@tcp:503:ll_cfg_requeue.0 Request processed in 265us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191916.057778:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 66 00000100:00100000:3.0:1784191916.064241:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191916.064588:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812474240 00000100:00100000:1.0:1784191916.064604:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812474240 00000100:00100000:1.0:1784191916.064684:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 67 00000100:00100000:1.0:1784191916.064723:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1014f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+8:122642:x1870858812474240:12345-192.168.204.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784191916.064748:0:167176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191916.064895:0:167176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af10de3ea00/0xfeec3c2dc5a4d32c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c3b3 expref: -99 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191916.064940:0:167176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af10de3ea00/0xfeec3c2dc5a4d32c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3b3 expref: 9 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191916.064955:0:167176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af10de3ea00/0xfeec3c2dc5a4d32c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3b3 expref: 9 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191916.064967:0:167176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3ea00, rc 0) 00000100:00100000:1.0:1784191916.065054:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1014f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+9:122642:x1870858812474240:12345-192.168.204.16@tcp:101:ll_cfg_requeue.0 Request processed in 333us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191916.065061:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 67 00000100:00100000:3.0:1784191916.074893:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191916.075459:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812474368 00000100:00100000:1.0:1784191916.075487:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812474368 00000100:00100000:1.0:1784191916.075584:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 68 00000100:00100000:1.0:1784191916.075724:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1017d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+9:122642:x1870858812474368:12345-192.168.204.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784191916.075994:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1017d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+9:122642:x1870858812474368:12345-192.168.204.16@tcp:501:ll_cfg_requeue.0 Request processed in 273us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191916.081906:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191916.082107:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 68 00000100:00100000:1.0:1784191916.082182:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812474496 00000100:00100000:1.0:1784191916.082194:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812474496 00000100:00100000:1.0:1784191916.082252:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 69 00000100:00100000:1.0:1784191916.082265:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+9:122642:x1870858812474496:12345-192.168.204.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784191916.082559:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+9:122642:x1870858812474496:12345-192.168.204.16@tcp:503:ll_cfg_requeue.0 Request processed in 295us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191916.082568:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 69 00000100:00100000:0.0:1784191916.089118:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191916.089416:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812474624 00000100:00100000:3.0:1784191916.089432:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812474624 00000100:00100000:3.0:1784191916.089514:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 70 00000100:00100000:3.0:1784191916.089527:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1014f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+9:122642:x1870858812474624:12345-192.168.204.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784191916.089550:0:167178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191916.089580:0:167178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af10d08e400/0xfeec3c2dc5a4d333 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c3ba expref: -99 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191916.089623:0:167178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af10d08e400/0xfeec3c2dc5a4d333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3ba expref: 10 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191916.089637:0:167178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af10d08e400/0xfeec3c2dc5a4d333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3ba expref: 10 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191916.089649:0:167178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d08e400, rc 0) 00000100:00100000:3.0:1784191916.089786:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1014f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:122642:x1870858812474624:12345-192.168.204.16@tcp:101:ll_cfg_requeue.0 Request processed in 261us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191916.089794:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 70 00000100:00100000:1.0:1784191916.092417:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191916.092548:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812474752 00000100:00100000:3.0:1784191916.092564:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812474752 00000100:00100000:3.0:1784191916.092650:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 71 00000100:00100000:3.0:1784191916.092664:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1014f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:122642:x1870858812474752:12345-192.168.204.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784191916.092978:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1014f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:122642:x1870858812474752:12345-192.168.204.16@tcp:501:ll_cfg_requeue.0 Request processed in 316us (578us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784191916.092988:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 71 00010000:00010000:0.0:1784191916.108191:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191917.133876:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191918.095657:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784191918.095723:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827999744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784191918.095841:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191918.098388:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827999744 00000100:00100000:0.0:1784191918.098412:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827999744 00000100:00100000:0.0:1784191918.098522:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:0.0:1784191918.098535:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:106501:x1870858827999744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784191918.101764:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:0.0:1784191918.101932:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:106501:x1870858827999744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3393us (6084us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191918.101947:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:1.0:1784191918.108398:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858827999744:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784191918.156092:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784191918.604216:0:123300:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784191918.604226:0:123300:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784191918.604230:0:123300:0:(import.c:65:import_set_state_nolock()) ffff8af23d85c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784191918.604246:0:123300:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8af23d85c000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:3.0:1784191918.604275:0:123300:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af233109500 x1870858828000000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784191918.604302:0:123300:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784191918.604305:0:123300:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784191918.604307:0:123300:0:(import.c:65:import_set_state_nolock()) ffff8af10c36a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784191918.604312:0:123300:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8af10c36a000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:3.0:1784191918.604324:0:123300:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af233108000 x1870858828000256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784191918.604352:0:123300:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784191918.604356:0:123300:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784191918.604358:0:123300:0:(import.c:65:import_set_state_nolock()) ffff8af1093a8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784191918.604364:0:123300:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8af1093a8800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:3.0:1784191918.604378:0:123300:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af104c7bb80 x1870858828000512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784191918.604403:0:123300:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784191918.604406:0:123300:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784191918.604408:0:123300:0:(import.c:65:import_set_state_nolock()) ffff8af23ea15000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784191918.604413:0:123300:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8af23ea15000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:3.0:1784191918.604424:0:123300:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af10db4c380 x1870858828000896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784191918.604460:0:123300:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784191918.604463:0:123300:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784191918.604465:0:123300:0:(import.c:65:import_set_state_nolock()) ffff8af10c3a8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784191918.604471:0:123300:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8af10c3a8000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:3.0:1784191918.604481:0:123300:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af10db4ce00 x1870858828001280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784191918.604522:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858828000128:0@lo:400:kworker.0 00000100:00100000:3.0:1784191918.604630:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191918.604785:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828001024:0@lo:400:kworker.0 00000100:00100000:3.0:1784191918.604820:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191918.604858:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784191918.604864:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827999872:0@lo:400:kworker.0 00000100:00100000:3.0:1784191918.604899:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191918.604921:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828000768:0@lo:400:kworker.0 00000100:00100000:3.0:1784191918.604944:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191918.604977:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:106498:1870858828000000:0@lo:38:kworker.0 00000100:00100000:3.0:1784191918.605005:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191918.605024:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:106498:1870858828000256:0@lo:38:kworker.0 00000100:00100000:3.0:1784191918.605045:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191918.605076:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828000512:0@lo:38:kworker.0 00000100:00100000:3.0:1784191918.605105:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191918.605125:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:106498:1870858828000896:0@lo:38:kworker.0 00000100:00100000:3.0:1784191918.605147:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191918.605178:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:106498:1870858828001280:0@lo:38:kworker.0 00000100:00100000:3.0:1784191918.605202:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191918.605234:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828000640:0@lo:400:kworker.0 00000100:00100000:3.0:1784191918.605260:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191918.605280:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784191918.605287:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858828000384:0@lo:400:kworker.0 00000100:00100000:3.0:1784191918.605312:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191918.605324:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828001152:0@lo:400:kworker.0 00000100:00100000:3.0:1784191918.605352:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191918.605389:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828000128 00000100:00100000:3.0:1784191918.605399:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828000128 00000100:00100000:3.0:1784191918.605460:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828000000 00000100:00100000:3.0:1784191918.605463:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828000000 00000100:00100000:3.0:1784191918.605474:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828000256 00000100:00100000:3.0:1784191918.605477:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828000256 00000100:00100000:3.0:1784191918.605484:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828000896 00000100:00100000:3.0:1784191918.605486:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828000896 00000100:00100000:3.0:1784191918.605495:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828001280 00000100:00100000:3.0:1784191918.605497:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828001280 00000100:00100000:3.0:1784191918.605507:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828000384 00000100:00100000:3.0:1784191918.605509:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828000384 00000100:00100000:3.0:1784191918.605531:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1784191918.605541:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858828000128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191918.605611:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858828000128:12345-0@lo:400:kworker.0 Request processed in 70us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191918.605619:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1784191918.605639:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1784191918.605645:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858828000384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191918.605718:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858828000384:12345-0@lo:400:kworker.0 Request processed in 42us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191918.606020:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1784191918.606038:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:3.0:1784191918.606043:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:106498:x1870858828000000:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784191918.606084:0:158666:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 5538 last 0 00000020:00000080:3.0:1784191918.606135:0:158666:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xfeec3c2dc5a4d33a 00000004:00100000:3.0:1784191918.606154:0:158666:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784191918.606320:0:158666:0:(import.c:65:import_set_state_nolock()) ffff8af1093af800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784191918.606375:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106498:x1870858828000000:12345-0@lo:38:kworker.0 Request processed in 331us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191918.606382:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00100000:3.0:1784191918.606396:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:3.0:1784191918.606401:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:106498:x1870858828000256:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784191918.606414:0:158666:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 5538 last 0 00000020:00000080:3.0:1784191918.606443:0:158666:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xfeec3c2dc5a4d341 00000004:00100000:3.0:1784191918.606449:0:158666:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784191918.606467:0:158666:0:(import.c:65:import_set_state_nolock()) ffff8af20d956800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784191918.606495:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:106498:x1870858828000256:12345-0@lo:38:kworker.0 Request processed in 93us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191918.606502:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:3.0:1784191918.606514:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:3.0:1784191918.606518:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:106498:x1870858828000896:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784191918.606530:0:158666:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 5538 last 0 00000020:00000080:3.0:1784191918.606566:0:158666:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xfeec3c2dc5a4d348 00000004:00100000:3.0:1784191918.606572:0:158666:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784191918.606586:0:158666:0:(import.c:65:import_set_state_nolock()) ffff8af10c3ae000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784191918.606614:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106498:x1870858828000896:12345-0@lo:38:kworker.0 Request processed in 94us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191918.606621:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:3.0:1784191918.606633:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:3.0:1784191918.606637:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:106498:x1870858828001280:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784191918.606649:0:158666:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 5538 last 0 00000020:00000080:3.0:1784191918.606674:0:158666:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xfeec3c2dc5a4d34f 00000004:00100000:3.0:1784191918.606680:0:158666:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784191918.606865:0:158666:0:(import.c:65:import_set_state_nolock()) ffff8af10f799000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784191918.606899:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106498:x1870858828001280:12345-0@lo:38:kworker.0 Request processed in 259us (1694us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191918.606906:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:3.0:1784191918.606942:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828001024 00000100:00100000:3.0:1784191918.606948:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828001024 00000100:00100000:3.0:1784191918.606988:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828000768 00000100:00100000:3.0:1784191918.606992:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828000768 00000100:00100000:3.0:1784191918.607010:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828000640 00000100:00100000:3.0:1784191918.607014:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828000640 00000100:00100000:3.0:1784191918.607041:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828001152 00000100:00100000:3.0:1784191918.607044:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828001152 00000100:00100000:3.0:1784191918.607076:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1784191918.607082:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828001024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191918.607122:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828001024:12345-0@lo:400:kworker.0 Request processed in 40us (2302us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191918.607139:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1784191918.607153:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1784191918.607159:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828000768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191918.607191:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828000768:12345-0@lo:400:kworker.0 Request processed in 33us (2246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191918.607197:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1784191918.607210:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1784191918.607219:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828000640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191918.607246:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828000640:12345-0@lo:400:kworker.0 Request processed in 30us (1986us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191918.607251:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1784191918.607261:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1784191918.607268:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828001152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191918.607296:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828001152:12345-0@lo:400:kworker.0 Request processed in 28us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191918.607302:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1784191918.607327:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827999872 00000100:00100000:3.0:1784191918.607331:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827999872 00000100:00100000:3.0:1784191918.607362:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784191918.607369:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106500:x1870858827999872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191918.607404:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106500:x1870858827999872:12345-0@lo:400:kworker.0 Request processed in 35us (2504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191918.607409:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784191918.607465:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828000512 00000100:00100000:3.0:1784191918.607470:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828000512 00000100:00100000:3.0:1784191918.607509:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:3.0:1784191918.607514:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:106498:x1870858828000512:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784191918.607531:0:158670:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8af202ccb800, cookie 0xfeec3c2dc5a4d19d 00010000:00080000:3.0:1784191918.607536:0:158670:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t34359738828 exp ffff8af202ccb800 cur 5538 last 1784191913 00000004:00100000:3.0:1784191918.607548:0:158670:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784191918.607569:0:158670:0:(import.c:65:import_set_state_nolock()) ffff8af10f79c000 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1784191918.608080:0:167204:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1784191918.608087:0:167204:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 34359738838 00000020:00080000:1.0:1784191918.608093:0:167204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784191918.608097:0:167204:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 34359738838 00000020:00080000:1.0:1784191918.608101:0:167204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784191918.608103:0:167204:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 34359738838 00000100:00100000:1.0:1784191918.608121:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784191918.608137:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828001408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784191918.608192:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191918.608304:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828001408 00000100:00100000:1.0:1784191918.608310:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828001408 00000100:00100000:1.0:1784191918.608346:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1784191918.608353:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828001408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784191918.608380:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1236992 granted 60233664 pending 65536 free 70385664 avail 63217664 00000100:00100000:1.0:1784191918.608420:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828001408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191918.608427:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1784191918.608576:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828001408:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1784191918.609346:0:160160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836571 is committed 00000100:00100000:3.0:1784191918.612828:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106498:x1870858828000512:12345-0@lo:38:kworker.0 Request processed in 5297us (7707us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191918.612848:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00080000:3.0:1784191918.612926:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784191918.612933:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784191918.612939:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191918.614877:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858828000384:0@lo:400:kworker.0 00000100:00100000:3.0:1784191918.614904:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828001152:0@lo:400:kworker.0 00000100:00100000:3.0:1784191918.614919:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828000640:0@lo:400:kworker.0 00010000:00080000:3.0:1784191918.615010:0:106498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af233109500 x1870858828000000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784191938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784191918.615032:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 9 00000100:00080000:3.0:1784191918.615957:0:106498:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8af233109500 x1870858828000000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784191938 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784191918.615970:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23d85c000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1784191918.615978:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23d85c000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784191918.615983:0:106498:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1784191918.616456:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828001536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191918.616558:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191918.616725:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828001536 00000100:00100000:1.0:1784191918.616736:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828001536 00000100:00100000:1.0:1784191918.616810:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1784191918.616823:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828001536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784191918.617036:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3444736 granted 60348352 pending 0 free 70660096 avail 63492096 00000100:00100000:1.0:1784191918.617111:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828001536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 290us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191918.617120:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1784191918.617193:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828001536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784191918.617371:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858827999872:0@lo:400:kworker.0 00000100:00100000:2.0:1784191918.617388:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828000768:0@lo:400:kworker.0 00000100:00100000:2.0:1784191918.617404:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858828000128:0@lo:400:kworker.0 00000100:00100000:2.0:1784191918.617418:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828001024:0@lo:400:kworker.0 00000100:00100000:3.0:1784191918.633749:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:106498:1870858828000000:0@lo:38:kworker.0 00000001:00080000:3.0:1784191918.634915:0:165481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769803813 is committed 00010000:00080000:3.0:1784191918.635504:0:106498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af233108000 x1870858828000256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784191938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784191918.635531:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 9 00000100:00080000:3.0:1784191918.638504:0:106498:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8af233108000 x1870858828000256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784191938 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784191918.638524:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10c36a000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1784191918.638533:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10c36a000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784191918.638539:0:106498:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1784191918.638549:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:106498:1870858828000256:0@lo:38:kworker.0 00000100:00100000:3.0:1784191918.638608:0:106498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 34359738837 gen 2 00000004:00080000:3.0:1784191918.638615:0:106498:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738828 committed transno 34359738837 00000004:00080000:3.0:1784191918.638646:0:106498:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738829 committed transno 34359738837 00000004:00080000:3.0:1784191918.639129:0:106498:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738830 committed transno 34359738837 00000004:00080000:3.0:1784191918.639142:0:106498:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738831 committed transno 34359738837 00000004:00080000:3.0:1784191918.639164:0:106498:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738832 committed transno 34359738837 00000004:00080000:3.0:1784191918.639182:0:106498:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738833 committed transno 34359738837 00000004:00080000:3.0:1784191918.639196:0:106498:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738834 committed transno 34359738837 00000004:00080000:3.0:1784191918.639207:0:106498:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738835 committed transno 34359738837 00000004:00080000:3.0:1784191918.639218:0:106498:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738836 committed transno 34359738837 00000004:00080000:3.0:1784191918.639228:0:106498:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 34359738837 committed transno 34359738837 00000100:00080000:3.0:1784191918.639260:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 9 00000100:00080000:3.0:1784191918.639276:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af1093a8800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1784191918.639282:0:106498:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1784191918.639285:0:106498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 34359738837 gen 2 00000100:00080000:3.0:1784191918.639290:0:106498:0:(recover.c:53:ptlrpc_replay_next()) import ffff8af1093a8800 from lustre-MDT0000_UUID committed 34359738837 last 0 00000100:00080000:3.0:1784191918.639310:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af1093a8800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1784191918.641010:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828000512:0@lo:38:kworker.0 00010000:00080000:0.0:1784191918.641077:0:106498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10db4c380 x1870858828000896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784191938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784191918.641097:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 9 00010000:00080000:3.0:1784191918.641131:0:167399:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1784191918.641138:0:167399:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1784191918.641147:0:167399:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1784191918.643404:0:106498:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8af10db4c380 x1870858828000896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784191938 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784191918.643424:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23ea15000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784191918.643432:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23ea15000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784191918.643438:0:106498:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784191918.643446:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:106498:1870858828000896:0@lo:38:kworker.0 00010000:00080000:0.0:1784191918.643544:0:106498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10db4ce00 x1870858828001280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784191928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784191918.643567:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 9 00000100:00080000:0.0:1784191918.643582:0:106498:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784191918.643590:0:106498:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784191918.643593:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10c3a8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784191918.643598:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:106498:1870858828001280:0@lo:38:kworker.0 00000100:00080000:3.0:1784191918.643903:0:167399:0:(import.c:65:import_set_state_nolock()) ffff8af1093a8800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1784191918.644310:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828001664:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1784191918.644417:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191918.644744:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828001664 00000100:00100000:2.0:1784191918.644755:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828001664 00000100:00100000:2.0:1784191918.644988:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:2.0:1784191918.645001:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106498:x1870858828001664:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1784191918.645038:0:161739:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff8af10f4ec000 x1870858828001664/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:89/0 lens 224/0 e 0 to 0 dl 1784191929 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784191918.645076:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106498:x1870858828001664:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 77us (660us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784191918.645084:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000020:00080000:0.0:1784191918.645151:0:167204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784191918.645156:0:167204:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 34359738838 00010000:00080000:0.0:1784191918.645161:0:167204:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1784191918.645166:0:167204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784191918.645176:0:167204:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1784191918.645179:0:167204:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1784191918.645189:0:167204:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.16@tcp: req@ffff8af23310b100 x1870858812473472/t0(0) o101->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:85/0 lens 328/0 e 0 to 0 dl 1784191925 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784191918.645211:0:167204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191918.645257:0:167204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d356 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8b8b5 expref: -99 pid: 167204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.645293:0:167204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d356 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8b5 expref: 7 pid: 167204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.645317:0:167204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d356 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8b5 expref: 7 pid: 167204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.645341:0:167204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20c0aae00, rc 0) 00010000:00080000:0.0:1784191918.645428:0:167204:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00010000:00080000:0.0:1784191918.645444:0:167204:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1784191918.652973:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191918.653189:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812474880 00000100:00100000:0.0:1784191918.653205:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812474880 00000100:00100000:0.0:1784191918.653298:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 379 00000100:00100000:0.0:1784191918.653312:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69108:x1870858812474880:12345-192.168.204.16@tcp:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1784191918.653341:0:158666:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff8af10db4ce00 x1870858812474880/t0(0) o400->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 224/0 e 0 to 0 dl 1784191929 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784191918.653369:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69108:x1870858812474880:12345-192.168.204.16@tcp:400:ptlrpcd_rcv.0 Request processed in 60us (412us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784191918.653377:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 379 00010000:00080000:1.0:1784191918.653436:0:167204:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1784191918.654775:0:167204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 9, last_transno is 38654705664 00000001:00100000:1.0:1784191918.667022:0:167172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000001:00100000:1.0:1784191918.667037:0:167172:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1784191918.667229:0:167204:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1784191918.667304:0:167204:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1784191918.667325:0:167204:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8af10f4ec000 x1870858828001664/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:89/0 lens 224/0 e 0 to 0 dl 1784191929 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1784191918.667499:0:167204:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.16@tcp: req@ffff8af10db4ce00 x1870858812474880/t0(0) o400->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 224/0 e 0 to 0 dl 1784191929 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1784191918.667582:0:167204:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1784191918.667756:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af1093a8800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1784191918.667777:0:106498:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff8af10db4d180 x1870858828001664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784191934 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784191918.667787:0:106498:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8af10db4d180 x1870858828001664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784191934 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784191918.667806:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af1093a8800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784191918.667822:0:106498:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1784191918.667830:0:106498:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000002af8f478): req@ffff8af22dcff800 x1870858827984384/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784191919 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784191918.667987:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828001664:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1784191918.668103:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191918.668161:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858827984384 00000100:00100000:1.0:1784191918.668171:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858827984384 00000100:00100000:1.0:1784191918.668235:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:1.0:1784191918.668249:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827984384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784191918.668291:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:1.0:1784191918.668345:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858827984384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191918.668355:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:1.0:1784191918.668406:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858827984384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191918.669223:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784191918.669243:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828001792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191918.669300:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191918.669348:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828001792 00000100:00100000:2.0:1784191918.669355:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828001792 00000100:00100000:2.0:1784191918.669400:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:2.0:1784191918.669410:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828001792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784191918.669437:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:2.0:1784191918.669484:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828001792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191918.669492:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:2.0:1784191918.669546:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828001792:0@lo:41:osp-pre-0-1.0 00000004:00000080:1.0:1784191918.742664:0:167204:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb46d0f4d3e10 00100000:10000000:1.0:1784191918.742683:0:167204:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1784191918.743944:0:167192:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x1e8:0x0] 00000100:00100000:0.0:1784191918.744030:0:167192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4edf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:167192:1870858828001920:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784191918.744141:0:167192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1784191918.744170:0:167190:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x26c:0x0] 00000100:00100000:0.0:1784191918.744192:0:167192:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10c281900 going to sleep for 11 seconds 00000100:00100000:1.0:1784191918.744193:0:167190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101687100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:167190:1870858828002048:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1784191918.744299:0:167190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191918.744317:0:167190:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784191918.744432:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828001920 00000100:00100000:2.0:1784191918.744444:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828001920 00000100:00100000:2.0:1784191918.744527:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828002048 00000100:00100000:2.0:1784191918.744531:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828002048 00000100:00100000:2.0:1784191918.744633:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1784191918.744646:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:167192:x1870858828001920:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1784191918.744706:0:162398:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 513 -> diff = -25 00002000:02000040:2.0:1784191918.744720:0:162398:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:489 to 0x2c0000401:513) 00000100:00100000:0.0:1784191918.746502:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1784191918.746525:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:167190:x1870858828002048:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1784191918.746569:0:160165:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 641 -> diff = -21 00002000:02000040:0.0:1784191918.746575:0:160165:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:621 to 0x280000401:641) 00002000:00010000:2.0:1784191918.761541:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x201:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.761560:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d35d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.761585:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x201:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.761591:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x201:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.761600:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d35d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.761619:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d35d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.761631:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d35d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.761639:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d35d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.761677:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784191918.768963:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x200:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.768978:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d364 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.769003:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x200:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.769009:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x200:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.769017:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d364 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.769061:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d364 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.769076:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d364 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.769085:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d364 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.769111:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784191918.769125:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784191918.769134:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d35d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.769143:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4600 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191918.769149:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d35d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.769161:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d35d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.769184:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d35d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.769192:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d35d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.769223:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191918.769227:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d364 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.769233:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5000 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191918.769236:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d364 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.769244:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d364 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.769254:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d364 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.769261:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d364 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.769272:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.769273:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.769275:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.771968:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784191918.772040:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x281:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.772066:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d36b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.772090:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x281:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.772096:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x281:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.772105:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d36b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.772125:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d36b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.772137:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d36b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.772146:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d36b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.772179:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784191918.772190:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191918.772196:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d36b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.772392:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20c0ab600 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191918.772399:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d36b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.772410:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d36b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.772430:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d36b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.772438:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d36b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.772461:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.772463:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.772465:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784191918.772574:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x280:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1784191918.772579:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.772580:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a07e3ed4/0xfeec3c2dc5a4d372 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.772593:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083040df4/0xfeec3c2dc5a4d379 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.772594:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x280:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.772601:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x280:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.772610:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a07e3ed4/0xfeec3c2dc5a4d372 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.772613:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ff:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.772622:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a07e3ed4/0xfeec3c2dc5a4d372 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.772627:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.772634:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083040df4/0xfeec3c2dc5a4d379 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.772642:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a07e3ed4/0xfeec3c2dc5a4d372 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.772651:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a07e3ed4/0xfeec3c2dc5a4d372 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.772666:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083040df4/0xfeec3c2dc5a4d379 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.772675:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083040df4/0xfeec3c2dc5a4d379 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.772676:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191918.772706:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083040df4/0xfeec3c2dc5a4d379 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.772729:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784191918.772737:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784191918.772743:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a07e3ed4/0xfeec3c2dc5a4d372 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.772752:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b6a00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191918.772757:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a07e3ed4/0xfeec3c2dc5a4d372 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191918.772766:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.772767:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a07e3ed4/0xfeec3c2dc5a4d372 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.772774:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d380 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.772785:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27f:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.772786:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a07e3ed4/0xfeec3c2dc5a4d372 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.772790:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.772800:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d380 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.772805:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784191918.772817:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083040df4/0xfeec3c2dc5a4d379 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.772821:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a07e3ed4/0xfeec3c2dc5a4d372 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.772835:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4000 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191918.772848:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083040df4/0xfeec3c2dc5a4d379 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.772857:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.772859:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083040df4/0xfeec3c2dc5a4d379 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.772861:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.772865:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.772878:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083040df4/0xfeec3c2dc5a4d379 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.772888:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083040df4/0xfeec3c2dc5a4d379 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.772923:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.772925:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191918.772927:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784191918.772928:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.772934:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006122c98a/0xfeec3c2dc5a4d387 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.772946:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1fe:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.772950:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.772954:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006122c98a/0xfeec3c2dc5a4d387 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.772964:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006122c98a/0xfeec3c2dc5a4d387 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.772973:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006122c98a/0xfeec3c2dc5a4d387 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.772981:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006122c98a/0xfeec3c2dc5a4d387 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.773002:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784191918.773067:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.773073:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030be1520/0xfeec3c2dc5a4d38e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.773082:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1fd:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.773085:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.773089:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030be1520/0xfeec3c2dc5a4d38e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.773098:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030be1520/0xfeec3c2dc5a4d38e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.773107:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030be1520/0xfeec3c2dc5a4d38e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.773115:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030be1520/0xfeec3c2dc5a4d38e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.773129:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784191918.773136:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784191918.773140:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006122c98a/0xfeec3c2dc5a4d387 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.773148:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5e00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191918.773149:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191918.773154:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006122c98a/0xfeec3c2dc5a4d387 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.773157:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030be1520/0xfeec3c2dc5a4d38e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.773173:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5800 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191918.773178:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030be1520/0xfeec3c2dc5a4d38e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.773198:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006122c98a/0xfeec3c2dc5a4d387 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.773199:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030be1520/0xfeec3c2dc5a4d38e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.773224:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006122c98a/0xfeec3c2dc5a4d387 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.773227:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030be1520/0xfeec3c2dc5a4d38e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.773242:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006122c98a/0xfeec3c2dc5a4d387 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.773246:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030be1520/0xfeec3c2dc5a4d38e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.773274:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.773276:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.773278:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.773280:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.773282:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.773285:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.773681:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d380 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.773710:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d380 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.773718:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d380 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.773749:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784191918.773761:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191918.773765:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d380 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.773772:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b7400 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191918.773776:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d380 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.773784:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d380 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.773797:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d380 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.773805:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d380 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.773834:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.773836:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.773838:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784191918.773932:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.773938:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea371b36/0xfeec3c2dc5a4d395 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.773947:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27e:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.773957:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.773963:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea371b36/0xfeec3c2dc5a4d395 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.773973:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea371b36/0xfeec3c2dc5a4d395 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.773981:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea371b36/0xfeec3c2dc5a4d395 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.773989:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea371b36/0xfeec3c2dc5a4d395 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774008:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784191918.774063:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.774068:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7490b64/0xfeec3c2dc5a4d39c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774076:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27d:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.774080:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.774084:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7490b64/0xfeec3c2dc5a4d39c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774093:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7490b64/0xfeec3c2dc5a4d39c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774101:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7490b64/0xfeec3c2dc5a4d39c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774116:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7490b64/0xfeec3c2dc5a4d39c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774131:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784191918.774138:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784191918.774142:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea371b36/0xfeec3c2dc5a4d395 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774160:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b7c00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191918.774164:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea371b36/0xfeec3c2dc5a4d395 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774172:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea371b36/0xfeec3c2dc5a4d395 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774184:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea371b36/0xfeec3c2dc5a4d395 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774193:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea371b36/0xfeec3c2dc5a4d395 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774216:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191918.774229:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7490b64/0xfeec3c2dc5a4d39c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774249:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b7e00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191918.774252:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7490b64/0xfeec3c2dc5a4d39c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774261:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7490b64/0xfeec3c2dc5a4d39c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774274:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7490b64/0xfeec3c2dc5a4d39c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774282:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7490b64/0xfeec3c2dc5a4d39c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774306:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.774309:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.774311:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784191918.774359:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.774365:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005115a7ae/0xfeec3c2dc5a4d3a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774374:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27c:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.774377:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.774382:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005115a7ae/0xfeec3c2dc5a4d3a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774392:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005115a7ae/0xfeec3c2dc5a4d3a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774419:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005115a7ae/0xfeec3c2dc5a4d3a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774428:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005115a7ae/0xfeec3c2dc5a4d3a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774443:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784191918.774450:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191918.774455:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005115a7ae/0xfeec3c2dc5a4d3a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774464:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b6000 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191918.774468:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005115a7ae/0xfeec3c2dc5a4d3a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774476:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005115a7ae/0xfeec3c2dc5a4d3a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774488:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005115a7ae/0xfeec3c2dc5a4d3a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774497:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005115a7ae/0xfeec3c2dc5a4d3a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774516:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.774526:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.774529:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784191918.774583:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.774586:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.774589:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002207fb42/0xfeec3c2dc5a4d3aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774600:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27b:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.774604:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.774609:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002207fb42/0xfeec3c2dc5a4d3aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774618:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002207fb42/0xfeec3c2dc5a4d3aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774627:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002207fb42/0xfeec3c2dc5a4d3aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774635:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002207fb42/0xfeec3c2dc5a4d3aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774650:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784191918.774674:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191918.774679:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002207fb42/0xfeec3c2dc5a4d3aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774687:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b6400 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191918.774716:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002207fb42/0xfeec3c2dc5a4d3aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774737:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002207fb42/0xfeec3c2dc5a4d3aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774750:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002207fb42/0xfeec3c2dc5a4d3aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774758:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002207fb42/0xfeec3c2dc5a4d3aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191918.774769:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.774773:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.774776:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.774778:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.774781:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4d3b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.774795:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1fc:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.774799:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.774805:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4d3b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.774817:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4d3b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.774826:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4d3b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191918.774836:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.774843:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdd73c5e/0xfeec3c2dc5a4d3b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774852:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27a:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.774856:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.774861:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd73c5e/0xfeec3c2dc5a4d3b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774870:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdd73c5e/0xfeec3c2dc5a4d3b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774879:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdd73c5e/0xfeec3c2dc5a4d3b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774898:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd73c5e/0xfeec3c2dc5a4d3b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.774905:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4d3b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774916:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191918.774932:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784191918.774935:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784191918.774940:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdd73c5e/0xfeec3c2dc5a4d3b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.774946:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191918.774949:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b6e00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191918.774955:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4d3b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774955:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdd73c5e/0xfeec3c2dc5a4d3b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774976:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdd73c5e/0xfeec3c2dc5a4d3b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.774982:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5c00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191918.774991:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4d3b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.774994:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdd73c5e/0xfeec3c2dc5a4d3b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.775007:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4d3b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775009:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdd73c5e/0xfeec3c2dc5a4d3b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.775034:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4d3b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775061:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.775064:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.775066:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784191918.775118:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x279:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.775130:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d3bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775139:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x279:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.775142:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x279:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.775147:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d3bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775156:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d3bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775165:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d3bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775173:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d3bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775188:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784191918.775196:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191918.775200:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d3bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775207:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b6800 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191918.775211:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d3bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775219:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d3bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775237:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d3bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775245:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d3bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775260:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.775261:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.775263:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784191918.775313:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x278:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.775318:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d3c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775326:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x278:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.775330:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x278:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.775334:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d3c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775345:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d3c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775353:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d3c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775359:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d3c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775379:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784191918.775387:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191918.775390:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d3c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775398:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b7600 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191918.775401:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d3c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775410:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d3c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775422:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d3c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775431:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d3c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775446:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.775449:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.775451:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784191918.775497:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x277:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.775503:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d3cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775511:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x277:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.775521:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x277:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.775526:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d3cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775538:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d3cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775546:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d3cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775554:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d3cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775567:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784191918.775575:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191918.775578:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d3cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775586:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b6c00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191918.775589:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d3cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775598:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d3cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775609:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d3cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775629:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d3cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775644:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.775646:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.775648:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784191918.775727:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x276:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.775733:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d3d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775742:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x276:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.775745:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x276:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.775749:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d3d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775759:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d3d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775767:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d3d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775783:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d3d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.775787:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000693d3bc3/0xfeec3c2dc5a4d3b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775801:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784191918.775816:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191918.775821:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d3d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.775824:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.775830:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.775831:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b7000 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191918.775837:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d3d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775847:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d3d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.775848:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.775863:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d3d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775872:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d3d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775888:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.775890:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.775892:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191918.775931:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.775951:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4d3db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784191918.775951:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x275:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.775962:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092b0318c/0xfeec3c2dc5a4d3e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.775968:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1fb:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.775976:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x275:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.775978:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.775982:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x275:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.775988:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4d3db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.775990:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092b0318c/0xfeec3c2dc5a4d3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.776014:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4d3db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.776028:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092b0318c/0xfeec3c2dc5a4d3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.776030:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4d3db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.776063:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4d3db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.776084:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191918.776092:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191918.776097:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4d3db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.776105:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4a00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191918.776109:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4d3db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.776117:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4d3db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.776650:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4d3db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.776661:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078ed5c04/0xfeec3c2dc5a4d3db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.776683:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.776685:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.776687:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191918.776832:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.776839:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062d35918/0xfeec3c2dc5a4d3e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.776849:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1fa:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.776853:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.776858:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062d35918/0xfeec3c2dc5a4d3e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.776869:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062d35918/0xfeec3c2dc5a4d3e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.776877:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062d35918/0xfeec3c2dc5a4d3e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.776885:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062d35918/0xfeec3c2dc5a4d3e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.777537:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092b0318c/0xfeec3c2dc5a4d3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.777549:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092b0318c/0xfeec3c2dc5a4d3e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.777586:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1784191918.777659:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.777664:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4d3f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.777675:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f9:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.777678:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.777681:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4d3f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.777709:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4d3f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.777719:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4d3f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.777726:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4d3f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.778745:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1784191918.778803:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784191918.778875:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062d35918/0xfeec3c2dc5a4d3e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.778891:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4200 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191918.778896:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062d35918/0xfeec3c2dc5a4d3e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.778907:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062d35918/0xfeec3c2dc5a4d3e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.778927:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062d35918/0xfeec3c2dc5a4d3e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.778935:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062d35918/0xfeec3c2dc5a4d3e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.778973:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784191918.778978:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092b0318c/0xfeec3c2dc5a4d3e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.778985:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b6200 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191918.778988:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092b0318c/0xfeec3c2dc5a4d3e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.778996:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092b0318c/0xfeec3c2dc5a4d3e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.779008:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092b0318c/0xfeec3c2dc5a4d3e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.779015:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092b0318c/0xfeec3c2dc5a4d3e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.779034:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191918.779039:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4d3f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.779056:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4c00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191918.779060:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4d3f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.779082:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4d3f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.779964:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784191918.779991:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191918.780147:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.780155:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d3f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780171:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f8:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.780187:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.780194:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d3f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780210:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d3f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780222:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d3f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780231:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d3f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780248:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191918.780256:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191918.780261:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d3f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780270:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5000 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191918.780274:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d3f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780283:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d3f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780311:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d3f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780332:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d93fdd3e/0xfeec3c2dc5a4d3f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780351:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.780353:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.780356:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191918.780403:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.780409:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d3fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780417:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f7:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.780420:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.780424:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d3fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780434:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d3fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780442:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d3fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780450:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d3fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780463:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191918.780476:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191918.780480:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d3fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780487:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e4600 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191918.780491:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d3fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780499:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d3fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780512:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d3fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780520:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000db73f8b/0xfeec3c2dc5a4d3fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780533:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.780535:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.780537:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191918.780585:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.780590:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4d405 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780599:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f6:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.780602:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.780606:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4d405 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780630:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4d405 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780638:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4d405 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780646:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4d405 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780659:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191918.780666:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191918.780670:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4d405 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780677:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5a00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191918.780681:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4d405 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780718:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4d405 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780730:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4d405 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780739:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebdea2fb/0xfeec3c2dc5a4d405 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780760:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.780762:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.780764:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191918.780814:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.780820:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4d40c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780828:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f5:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.780832:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.780849:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4d40c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780860:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4d40c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780869:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4d40c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780877:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4d40c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780891:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191918.780897:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191918.780901:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4d40c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780921:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10b5e5200 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191918.780925:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4d40c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780933:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4d40c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780945:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4d40c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780953:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f763fd8/0xfeec3c2dc5a4d40c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.780969:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.780971:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.780972:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191918.781026:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.781031:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ab0aac/0xfeec3c2dc5a4d413 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781040:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f4:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.781042:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.781060:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028ab0aac/0xfeec3c2dc5a4d413 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781071:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028ab0aac/0xfeec3c2dc5a4d413 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781086:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ab0aac/0xfeec3c2dc5a4d413 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781094:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028ab0aac/0xfeec3c2dc5a4d413 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781107:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191918.781114:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191918.781118:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028ab0aac/0xfeec3c2dc5a4d413 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781126:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d532a00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191918.781129:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ab0aac/0xfeec3c2dc5a4d413 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781137:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ab0aac/0xfeec3c2dc5a4d413 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781149:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028ab0aac/0xfeec3c2dc5a4d413 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781157:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028ab0aac/0xfeec3c2dc5a4d413 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781172:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.781179:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.781181:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191918.781227:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.781232:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9f51f08/0xfeec3c2dc5a4d41a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781240:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f3:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.781244:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.781248:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9f51f08/0xfeec3c2dc5a4d41a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781258:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9f51f08/0xfeec3c2dc5a4d41a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781265:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9f51f08/0xfeec3c2dc5a4d41a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781272:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9f51f08/0xfeec3c2dc5a4d41a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781285:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191918.781291:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191918.781295:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9f51f08/0xfeec3c2dc5a4d41a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781302:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533000 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191918.781305:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9f51f08/0xfeec3c2dc5a4d41a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781324:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9f51f08/0xfeec3c2dc5a4d41a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781335:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9f51f08/0xfeec3c2dc5a4d41a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781343:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9f51f08/0xfeec3c2dc5a4d41a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781358:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.781359:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.781362:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191918.781407:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.781412:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000972fe141/0xfeec3c2dc5a4d421 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781421:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f2:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.781423:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.781427:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000972fe141/0xfeec3c2dc5a4d421 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781435:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000972fe141/0xfeec3c2dc5a4d421 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781443:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000972fe141/0xfeec3c2dc5a4d421 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781457:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000972fe141/0xfeec3c2dc5a4d421 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781470:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191918.781477:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191918.781481:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000972fe141/0xfeec3c2dc5a4d421 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781488:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533c00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191918.781491:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000972fe141/0xfeec3c2dc5a4d421 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781499:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000972fe141/0xfeec3c2dc5a4d421 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781511:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000972fe141/0xfeec3c2dc5a4d421 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781519:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000972fe141/0xfeec3c2dc5a4d421 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781533:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.781535:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.781537:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191918.781581:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.781592:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039e67264/0xfeec3c2dc5a4d428 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781601:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f1:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.781604:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.781608:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039e67264/0xfeec3c2dc5a4d428 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781617:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039e67264/0xfeec3c2dc5a4d428 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781624:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039e67264/0xfeec3c2dc5a4d428 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781632:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039e67264/0xfeec3c2dc5a4d428 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781645:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191918.781652:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191918.781655:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039e67264/0xfeec3c2dc5a4d428 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781663:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533600 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191918.781666:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039e67264/0xfeec3c2dc5a4d428 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781673:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039e67264/0xfeec3c2dc5a4d428 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781730:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039e67264/0xfeec3c2dc5a4d428 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781737:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039e67264/0xfeec3c2dc5a4d428 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781750:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.781752:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.781754:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191918.781800:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.781805:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004058a912/0xfeec3c2dc5a4d42f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781814:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f0:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.781818:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.781822:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004058a912/0xfeec3c2dc5a4d42f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781833:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004058a912/0xfeec3c2dc5a4d42f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781842:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004058a912/0xfeec3c2dc5a4d42f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781849:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004058a912/0xfeec3c2dc5a4d42f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781874:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191918.781884:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191918.781889:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004058a912/0xfeec3c2dc5a4d42f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781896:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d532c00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191918.781900:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004058a912/0xfeec3c2dc5a4d42f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781909:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004058a912/0xfeec3c2dc5a4d42f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781921:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004058a912/0xfeec3c2dc5a4d42f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781929:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004058a912/0xfeec3c2dc5a4d42f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.781945:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.781947:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.781949:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191918.781993:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.781998:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4d436 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782006:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ef:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.782014:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.782019:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4d436 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782030:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4d436 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782039:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4d436 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782059:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4d436 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782074:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191918.782084:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191918.782088:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4d436 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782095:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533200 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191918.782099:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4d436 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782107:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4d436 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782119:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4d436 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782141:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000858d4fec/0xfeec3c2dc5a4d436 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782154:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.782156:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.782158:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191918.782209:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.782215:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007da78f5f/0xfeec3c2dc5a4d43d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782223:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ee:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.782227:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.782231:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007da78f5f/0xfeec3c2dc5a4d43d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782240:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007da78f5f/0xfeec3c2dc5a4d43d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782248:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007da78f5f/0xfeec3c2dc5a4d43d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782257:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007da78f5f/0xfeec3c2dc5a4d43d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782271:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191918.782285:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191918.782290:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007da78f5f/0xfeec3c2dc5a4d43d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782298:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d533400 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191918.782301:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007da78f5f/0xfeec3c2dc5a4d43d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782310:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007da78f5f/0xfeec3c2dc5a4d43d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782323:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007da78f5f/0xfeec3c2dc5a4d43d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782330:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007da78f5f/0xfeec3c2dc5a4d43d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782344:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.782346:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.782348:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191918.782395:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.782401:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005444fd6d/0xfeec3c2dc5a4d444 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782409:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ed:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.782413:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.782417:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005444fd6d/0xfeec3c2dc5a4d444 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782441:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005444fd6d/0xfeec3c2dc5a4d444 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782449:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005444fd6d/0xfeec3c2dc5a4d444 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782457:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005444fd6d/0xfeec3c2dc5a4d444 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782468:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784191918.782524:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.782531:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000de5678c/0xfeec3c2dc5a4d44b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782539:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ec:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.782542:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.782547:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000de5678c/0xfeec3c2dc5a4d44b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.782552:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191918.782557:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000de5678c/0xfeec3c2dc5a4d44b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.782562:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005444fd6d/0xfeec3c2dc5a4d444 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782567:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000de5678c/0xfeec3c2dc5a4d44b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.782582:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127400 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191918.782588:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005444fd6d/0xfeec3c2dc5a4d444 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782601:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000de5678c/0xfeec3c2dc5a4d44b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782620:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784191918.782621:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005444fd6d/0xfeec3c2dc5a4d444 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782628:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784191918.782644:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005444fd6d/0xfeec3c2dc5a4d444 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.782655:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005444fd6d/0xfeec3c2dc5a4d444 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.782683:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.782686:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.782706:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191918.782816:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.782821:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000887b1e7e/0xfeec3c2dc5a4d452 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782830:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1eb:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.782833:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.782837:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000887b1e7e/0xfeec3c2dc5a4d452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782846:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000887b1e7e/0xfeec3c2dc5a4d452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782854:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000887b1e7e/0xfeec3c2dc5a4d452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782862:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000887b1e7e/0xfeec3c2dc5a4d452 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782877:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784191918.782883:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784191918.782893:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000887b1e7e/0xfeec3c2dc5a4d452 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782900:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233126000 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:2.0:1784191918.782903:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000887b1e7e/0xfeec3c2dc5a4d452 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782911:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000887b1e7e/0xfeec3c2dc5a4d452 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782924:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000887b1e7e/0xfeec3c2dc5a4d452 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782932:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000887b1e7e/0xfeec3c2dc5a4d452 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.782948:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.782950:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191918.782951:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784191918.782996:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191918.783002:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4d459 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.783011:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ea:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:2.0:1784191918.783015:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191918.783019:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4d459 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.783043:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4d459 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783480:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4d3f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783489:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080082b14/0xfeec3c2dc5a4d3f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783507:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.783508:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.783512:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784191918.783603:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x274:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.783609:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d460 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783619:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x274:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.783622:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x274:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.783627:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d460 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783638:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d460 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783646:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d460 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783660:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d460 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783682:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784191918.783740:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x273:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.783745:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059bae985/0xfeec3c2dc5a4d467 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783753:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x273:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.783757:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x273:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.783761:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059bae985/0xfeec3c2dc5a4d467 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783769:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059bae985/0xfeec3c2dc5a4d467 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783776:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059bae985/0xfeec3c2dc5a4d467 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783783:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059bae985/0xfeec3c2dc5a4d467 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783798:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784191918.783805:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784191918.783809:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d460 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783824:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b7400 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191918.783828:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d460 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783835:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d460 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783847:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d460 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783855:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000306af8be/0xfeec3c2dc5a4d460 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783870:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191918.783873:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059bae985/0xfeec3c2dc5a4d467 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783880:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b6600 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191918.783884:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059bae985/0xfeec3c2dc5a4d467 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783891:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059bae985/0xfeec3c2dc5a4d467 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783900:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059bae985/0xfeec3c2dc5a4d467 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783914:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059bae985/0xfeec3c2dc5a4d467 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783929:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.783931:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.783933:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784191918.783979:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x272:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.783985:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec984b02/0xfeec3c2dc5a4d46e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.783994:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x272:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.783997:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x272:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.784002:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec984b02/0xfeec3c2dc5a4d46e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.784011:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.784012:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec984b02/0xfeec3c2dc5a4d46e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.784022:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec984b02/0xfeec3c2dc5a4d46e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.784029:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec984b02/0xfeec3c2dc5a4d46e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.784059:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784191918.784109:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x271:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.784115:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d475 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.784123:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x271:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.784126:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x271:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.784130:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.784140:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.784148:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.784157:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d475 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.784171:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784191918.784178:0:158654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784191918.784182:0:158654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec984b02/0xfeec3c2dc5a4d46e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.784190:0:158654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b7800 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191918.784194:0:158654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec984b02/0xfeec3c2dc5a4d46e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.784233:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191918.784235:0:158654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec984b02/0xfeec3c2dc5a4d46e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.784241:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d475 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.784251:0:158654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec984b02/0xfeec3c2dc5a4d46e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.784253:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20c0ab600 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191918.784259:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d475 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.784266:0:158654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec984b02/0xfeec3c2dc5a4d46e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.784274:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d475 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.784284:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.784287:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.784289:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.784291:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d475 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.784309:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000450665f6/0xfeec3c2dc5a4d475 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.784562:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.784565:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.784566:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.785118:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.785128:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000de5678c/0xfeec3c2dc5a4d44b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.785139:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127600 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191918.785143:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000de5678c/0xfeec3c2dc5a4d44b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.785267:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000de5678c/0xfeec3c2dc5a4d44b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.785284:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000de5678c/0xfeec3c2dc5a4d44b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.785293:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000de5678c/0xfeec3c2dc5a4d44b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.785316:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.785385:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.785397:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.785403:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.785405:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784191918.786463:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x270:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.786476:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d47c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786493:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x270:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.786498:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x270:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.786505:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d47c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786521:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d47c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786532:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d47c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786548:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d47c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786580:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784191918.786632:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.786638:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d483 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786647:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26f:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.786650:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.786654:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d483 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786664:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d483 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786672:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d483 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786680:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d483 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786734:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784191918.786748:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784191918.786754:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d47c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786769:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b7000 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191918.786774:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d47c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786783:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d47c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786798:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d47c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786807:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e214c23/0xfeec3c2dc5a4d47c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786824:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191918.786828:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d483 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786835:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b6c00 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191918.786838:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d483 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786846:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d483 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786855:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d483 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786868:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009499c9fa/0xfeec3c2dc5a4d483 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786880:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.786881:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.786884:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784191918.786929:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.786934:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d48a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786943:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26e:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.786947:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.786951:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d48a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786960:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d48a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786969:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d48a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786976:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d48a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.786990:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784191918.787005:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784191918.787009:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d48a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.787017:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b7600 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:0.0:1784191918.787021:0:158653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d48a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.787030:0:158653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d48a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.787042:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d48a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.787043:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.787069:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc73bfa7/0xfeec3c2dc5a4d48a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.787083:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.787085:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191918.787087:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784191918.787133:0:160165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784191918.787138:0:160165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d491 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.787146:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26d:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:0.0:1784191918.787150:0:160165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784191918.787154:0:160165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d491 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.787176:0:160165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d491 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.787184:0:160165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d491 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.787191:0:160165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d491 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191918.787213:0:160165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1784191918.787255:0:160165:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:620 00010000:00010000:3.0:1784191918.787311:0:167403:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784191918.787398:0:167403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d491 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.787419:0:167403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b6800 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:3.0:1784191918.787423:0:167403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d491 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.787431:0:167403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d491 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.787445:0:167403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d491 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.787452:0:167403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b014278/0xfeec3c2dc5a4d491 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.787469:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.787471:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.787473:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191918.789406:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:167190:x1870858828002048:12345-0@lo:5:osp-pre-0-0.0 Request processed in 42876us (45092us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191918.789428:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1784191918.789439:0:167190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101687100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:167190:1870858828002048:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1784191918.789465:0:167190:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x281:0x0] from OST, last_created [0x280000401:0x281:0x0]last_used is [0x280000401:0x26c:0x0] 00000100:00100000:3.0:1784191918.789733:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784191918.789757:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828002176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784191918.789770:0:167190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101687800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:167190:1870858828002304:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1784191918.790140:0:167190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191918.790171:0:167190:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23d0e2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191918.791198:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191918.791281:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828002304 00000100:00100000:3.0:1784191918.791303:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828002304 00000100:00100000:3.0:1784191918.791384:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1784191918.791397:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:167190:x1870858828002304:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1784191918.791472:0:160163:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 642 00010000:00010000:2.0:1784191918.791536:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4d459 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191918.791551:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4d459 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191918.791768:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828002176 00000100:00100000:2.0:1784191918.791776:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828002176 00000100:00100000:2.0:1784191918.791827:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1784191918.792119:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:106502:x1870858828002176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784191918.792146:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1236992 granted 60168128 pending 896 free 70385664 avail 63217664 00000100:00100000:2.0:1784191918.792310:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:106502:x1870858828002176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 473us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191918.792320:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00002000:00080000:3.0:1784191918.793806:0:160163:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 650 00000001:00080000:3.0:1784191918.795985:0:160163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836572 00002000:00080000:3.0:1784191918.796041:0:160163:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 658 00000001:00080000:3.0:1784191918.798563:0:160163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836573 00002000:00080000:3.0:1784191918.798644:0:160163:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x280000401 at 666 00000001:00080000:3.0:1784191918.799145:0:160163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836574 00000100:00100000:3.0:1784191918.799335:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:167190:x1870858828002304:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7932us (9187us total) trans 21474836575 rc 0/0 00000100:00100000:3.0:1784191918.799352:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000020:00080000:3.0:1784191918.799362:0:160163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00000100:00100000:3.0:1784191918.799450:0:167190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101687800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:167190:1870858828002304:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784191918.799473:0:167190:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x281:0x0]-[0x280000401:0x2a1:0x0] 00010000:00010000:3.0:1784191918.799565:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784191918.799685:0:162398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784191918.799758:0:162398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f4cc236/0xfeec3c2dc5a4d498 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.799778:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e9:0x0].0x0 since=5538s v=(0 0) 00010000:00010000:3.0:1784191918.799784:0:162398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191918.799793:0:162398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f4cc236/0xfeec3c2dc5a4d498 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.799812:0:162398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f4cc236/0xfeec3c2dc5a4d498 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.799837:0:162398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f4cc236/0xfeec3c2dc5a4d498 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191918.799846:0:162398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f4cc236/0xfeec3c2dc5a4d498 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191918.799856:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784191918.799865:0:162398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784191918.800043:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4d459 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191918.800065:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127800 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:1.0:1784191918.800071:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4d459 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191918.800083:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4d459 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191918.800112:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4d459 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191918.800121:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4716ae3/0xfeec3c2dc5a4d459 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191918.800145:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191918.800149:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f4cc236/0xfeec3c2dc5a4d498 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191918.800168:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d08f400 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:1.0:1784191918.800171:0:160901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f4cc236/0xfeec3c2dc5a4d498 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191918.800179:0:160901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f4cc236/0xfeec3c2dc5a4d498 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191918.800192:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f4cc236/0xfeec3c2dc5a4d498 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191918.800199:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f4cc236/0xfeec3c2dc5a4d498 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191918.800220:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191918.800223:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191918.800226:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191918.802360:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191918.802434:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828002176:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1784191918.802504:0:162398:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:488 00000100:00100000:3.0:1784191918.802634:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:167192:x1870858828001920:12345-0@lo:5:osp-pre-1-0.0 Request processed in 57989us (58491us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191918.802649:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1784191918.803222:0:167192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4edf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:167192:1870858828001920:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784191918.803242:0:167192:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x201:0x0] from OST, last_created [0x2c0000401:0x201:0x0]last_used is [0x2c0000401:0x1e8:0x0] 00000100:00100000:0.0:1784191918.803352:0:167192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:167192:1870858828002560:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784191918.803403:0:167192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191918.803432:0:167192:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10c281900 going to sleep for 11 seconds 00000100:00100000:0.0:1784191918.803460:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828002560 00000100:00100000:0.0:1784191918.803468:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828002560 00000100:00100000:0.0:1784191918.803523:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1784191918.803533:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:167192:x1870858828002560:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1784191918.803599:0:161232:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 514 00000100:00100000:3.0:1784191918.803642:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828002432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191918.803725:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191918.803789:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828002432 00000100:00100000:3.0:1784191918.803794:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828002432 00000100:00100000:3.0:1784191918.803843:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1784191918.803853:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:106502:x1870858828002432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784191918.803871:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3444736 granted 60348352 pending 896 free 70660096 avail 63492096 00000100:00100000:3.0:1784191918.803918:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:106502:x1870858828002432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191918.803925:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1784191918.803988:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828002432:0@lo:13:osp-pre-1-0.0 00002000:00080000:0.0:1784191918.804299:0:161232:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 522 00000001:00080000:0.0:1784191918.804663:0:161232:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869263 00002000:00080000:0.0:1784191918.804682:0:161232:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 530 00000001:00080000:0.0:1784191918.805209:0:161232:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869264 00002000:00080000:0.0:1784191918.805229:0:161232:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x2c0000401 at 538 00000001:00080000:0.0:1784191918.805566:0:161232:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869265 00000100:00100000:0.0:1784191918.805759:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:167192:x1870858828002560:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2220us (2348us total) trans 17179869266 rc 0/0 00000100:00100000:0.0:1784191918.805775:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000020:00080000:0.0:1784191918.805783:0:161232:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00000100:00100000:0.0:1784191918.805857:0:167192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:167192:1870858828002560:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784191918.805877:0:167192:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x201:0x0]-[0x2c0000401:0x221:0x0] 00000100:00100000:3.0:1784191918.947029:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191918.947126:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191918.947149:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191918.947169:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191918.947189:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191918.947210:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191918.947233:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191918.947255:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191918.947272:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191918.947286:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191918.947504:0:160171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812476160 00000100:00100000:2.0:1784191918.947518:0:160171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812476160 00002000:00100000:2.0:1784191918.947599:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x1de:0x0] (0->116977) req@ffff8af10db4f100 x1870858812476160/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 488/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191918.947611:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10db4f100 with x1870858812476160 ext(0->116977) 00002000:00010000:2.0:1784191918.947617:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af10db4f100 00000100:00100000:2.0:1784191918.947636:0:160171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812475008 00000100:00100000:2.0:1784191918.947638:0:160171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812475008 00002000:00100000:2.0:1784191918.947665:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x25d:0x0] (0->1341) req@ffff8af10db4e300 x1870858812475008/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 1832/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784191918.948517:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191918.948580:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191918.948606:0:166577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812476288 00000100:00100000:3.0:1784191918.948614:0:166577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812476288 00002000:00100000:3.0:1784191918.948652:0:166577:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x262:0x0] (0->143466) req@ffff8af10db4d180 x1870858812476288/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 488/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191918.948664:0:166577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10db4d180 with x1870858812476288 ext(0->143466) 00002000:00100000:2.0:1784191918.948785:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10db4e300 with x1870858812475008 ext(0->1341) 00002000:00010000:2.0:1784191918.948790:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10db4e300 00000100:00100000:2.0:1784191918.948962:0:160171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812475136 00000100:00100000:2.0:1784191918.948968:0:160171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812475136 00002000:00100000:2.0:1784191918.948991:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x1da:0x0] (0->1658) req@ffff8af10f4edf80 x1870858812475136/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 2152/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191918.948999:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10f4edf80 with x1870858812475136 ext(0->1658) 00002000:00010000:2.0:1784191918.949003:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af10f4edf80 00000100:00100000:2.0:1784191918.949013:0:160171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812476416 00000100:00100000:2.0:1784191918.949016:0:160171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812476416 00002000:00100000:2.0:1784191918.949031:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x1df:0x0] (0->171097) req@ffff8af10fb61c00 x1870858812476416/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 488/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191918.949039:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10fb61c00 with x1870858812476416 ext(0->171097) 00002000:00010000:2.0:1784191918.949052:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af10fb61c00 00000100:00100000:2.0:1784191918.949062:0:160171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812475264 00000100:00100000:2.0:1784191918.949065:0:160171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812475264 00002000:00100000:2.0:1784191918.949081:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x25e:0x0] (0->1752) req@ffff8af10fb62d80 x1870858812475264/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 2248/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191918.949089:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10fb62d80 with x1870858812475264 ext(0->1752) 00002000:00010000:2.0:1784191918.949093:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10fb62d80 00000100:00100000:2.0:1784191918.949101:0:160171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812475392 00000100:00100000:2.0:1784191918.949103:0:160171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812475392 00002000:00100000:2.0:1784191918.949117:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x1db:0x0] (0->1407) req@ffff8af104c7bb80 x1870858812475392/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 1896/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191918.949142:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af104c7bb80 with x1870858812475392 ext(0->1407) 00002000:00010000:2.0:1784191918.949147:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af104c7bb80 00000100:00100000:2.0:1784191918.949156:0:160171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812475904 00000100:00100000:2.0:1784191918.949160:0:160171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812475904 00002000:00100000:2.0:1784191918.949177:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x1dd:0x0] (0->4749) req@ffff8af104c7a300 x1870858812475904/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 5240/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191918.949183:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af104c7a300 with x1870858812475904 ext(0->4749) 00002000:00010000:2.0:1784191918.949187:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af104c7a300 00000100:00100000:2.0:1784191918.949194:0:160171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812475776 00000100:00100000:2.0:1784191918.949197:0:160171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812475776 00002000:00100000:2.0:1784191918.949209:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x260:0x0] (0->6547) req@ffff8af233108000 x1870858812475776/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 7040/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191918.949216:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233108000 with x1870858812475776 ext(0->6547) 00002000:00010000:2.0:1784191918.949219:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af233108000 00000100:00100000:2.0:1784191918.949226:0:160171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812475520 00000100:00100000:2.0:1784191918.949229:0:160171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812475520 00002000:00100000:2.0:1784191918.949240:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x25f:0x0] (0->854) req@ffff8af233109500 x1870858812475520/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 1344/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191918.949247:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233109500 with x1870858812475520 ext(0->854) 00002000:00010000:2.0:1784191918.949251:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af233109500 00000100:00100000:2.0:1784191918.949257:0:160171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812476032 00000100:00100000:2.0:1784191918.949259:0:160171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812476032 00002000:00100000:2.0:1784191918.949271:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x261:0x0] (0->6820) req@ffff8af23310a680 x1870858812476032/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 7312/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191918.949279:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af23310a680 with x1870858812476032 ext(0->6820) 00002000:00010000:2.0:1784191918.949289:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af23310a680 00002000:00010000:3.0:1784191918.949901:0:166577:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10db4d180 00000100:00100000:3.0:1784191918.949922:0:166577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812475648 00000100:00100000:3.0:1784191918.949927:0:166577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812475648 00002000:00100000:3.0:1784191918.949953:0:166577:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1dc:0x0] (0->1653) req@ffff8af233108a80 x1870858812475648/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 2144/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191918.949961:0:166577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233108a80 with x1870858812475648 ext(0->1653) 00002000:00010000:3.0:1784191918.949965:0:166577:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233108a80 00000100:00100000:3.0:1784191918.949980:0:166577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 48 00000100:00100000:3.0:1784191918.949992:0:166577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+48:69112:x1870858812476160:12345-192.168.204.16@tcp:4:cp.0 00000100:00080000:0.0:1784191918.953201:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784191918.953217:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784191918.957076:0:166438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 49 00000100:00100000:3.0:1784191918.957112:0:166438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+49:69111:x1870858812475008:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:3.0:1784191918.957980:0:166438:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:3.0:1784191918.957990:0:166438:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:3.0:1784191918.957992:0:166438:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:3.0:1784191918.957995:0:166438:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:3.0:1784191918.957997:0:166438:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:3.0:1784191918.957999:0:166438:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191918.958458:0:160171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 50 00000100:00100000:2.0:1784191918.958476:0:160171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+49:69112:x1870858812475136:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:2.0:1784191918.958651:0:160171:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:2.0:1784191918.958655:0:160171:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191918.958657:0:160171:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:2.0:1784191918.958659:0:160171:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191918.958662:0:160171:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191918.958663:0:160171:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:3.0:1784191918.959434:0:166576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 51 00000100:00100000:3.0:1784191918.959448:0:166576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+51:69110:x1870858812476416:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:0.0:1784191918.960745:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191918.960927:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191918.960966:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812476672 00000100:00100000:0.0:1784191918.960977:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812476672 00002000:00100000:0.0:1784191918.961038:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1e0:0x0] (0->215292) req@ffff8af210f4e680 x1870858812476672/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 488/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191918.961061:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af210f4e680 with x1870858812476672 ext(0->215292) 00002000:00010000:0.0:1784191918.961069:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af210f4e680 00000100:00100000:0.0:1784191918.961090:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812476544 00000100:00100000:0.0:1784191918.961094:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812476544 00002000:00100000:0.0:1784191918.961113:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x263:0x0] (0->31710) req@ffff8af1010baa00 x1870858812476544/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 488/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191918.961135:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af1010baa00 with x1870858812476544 ext(0->31710) 00002000:00010000:0.0:1784191918.961140:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af1010baa00 00000100:00100000:0.0:1784191918.961156:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 52 00000100:00100000:0.0:1784191918.961168:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+52:69109:x1870858812475264:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:0.0:1784191918.961929:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191918.961939:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191918.961941:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191918.961943:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191918.961945:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191918.961947:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191918.962620:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+54:69109:x1870858812475264:12345-192.168.204.16@tcp:4:cp.0 Request processed in 1446us (15400us total) trans 21474836577 rc 0/0 00000100:00100000:0.0:1784191918.962634:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 52 00002000:00100000:0.0:1784191918.962645:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x25e:0x0] (0->1752) req@ffff8af10fb62d80 x1870858812475264/t21474836577(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 2248/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191918.962655:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10fb62d80 with x1870858812475264 ext(0->1752) 00002000:00010000:0.0:1784191918.962661:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10fb62d80 00000100:00100000:0.0:1784191918.962789:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 53 00000100:00100000:0.0:1784191918.962801:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+53:69110:x1870858812475392:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:0.0:1784191918.963025:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191918.963029:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191918.963031:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191918.963033:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191918.963036:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191918.963037:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:1.0:1784191918.969588:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+55:69110:x1870858812475392:12345-192.168.204.16@tcp:4:cp.0 Request processed in 6771us (22335us total) trans 17179869268 rc 0/0 00000100:00100000:1.0:1784191918.969607:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 53 00002000:00100000:1.0:1784191918.969628:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1db:0x0] (0->1407) req@ffff8af104c7bb80 x1870858812475392/t17179869268(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 1896/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191918.969640:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af104c7bb80 with x1870858812475392 ext(0->1407) 00002000:00010000:1.0:1784191918.969649:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af104c7bb80 00000100:00100000:1.0:1784191918.969940:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 54 00000100:00100000:1.0:1784191918.969967:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+54:69110:x1870858812475904:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:1.0:1784191918.970759:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:1.0:1784191918.970767:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:1.0:1784191918.970770:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:1.0:1784191918.970773:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:1.0:1784191918.970775:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:1.0:1784191918.970778:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:3.0:1784191918.971645:0:166438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+53:69111:x1870858812475008:12345-192.168.204.16@tcp:4:cp.0 Request processed in 14532us (24505us total) trans 21474836576 rc 0/0 00000100:00100000:3.0:1784191918.971660:0:166438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 49 00000100:00100000:2.0:1784191918.972656:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191918.972873:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191918.973005:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191918.973028:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191918.973053:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191918.973101:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812476928 00000100:00100000:2.0:1784191918.973114:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812476928 00002000:00100000:2.0:1784191918.973164:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1e1:0x0] (0->10933) req@ffff8af22dcff800 x1870858812476928/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 11424/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191918.973179:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af22dcff800 with x1870858812476928 ext(0->10933) 00002000:00010000:2.0:1784191918.973186:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af22dcff800 00000100:00100000:2.0:1784191918.973205:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812476800 00000100:00100000:2.0:1784191918.973208:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812476800 00002000:00100000:2.0:1784191918.973225:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x264:0x0] (0->196400) req@ffff8af22dcffb80 x1870858812476800/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 488/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191918.973234:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af22dcffb80 with x1870858812476800 ext(0->196400) 00002000:00010000:2.0:1784191918.973238:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af22dcffb80 00000100:00100000:2.0:1784191918.973243:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812477056 00000100:00100000:2.0:1784191918.973254:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812477056 00002000:00100000:2.0:1784191918.973267:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x265:0x0] (0->227515) req@ffff8af22dcfc380 x1870858812477056/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 488/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191918.973276:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af22dcfc380 with x1870858812477056 ext(0->227515) 00002000:00010000:2.0:1784191918.973279:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af22dcfc380 00000100:00100000:2.0:1784191918.973285:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812477184 00000100:00100000:2.0:1784191918.973286:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812477184 00002000:00100000:3.0:1784191918.974201:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x25d:0x0] (0->1341) req@ffff8af10db4e300 x1870858812475008/t21474836576(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 1832/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191918.974216:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10db4e300 with x1870858812475008 ext(0->1341) 00002000:00010000:3.0:1784191918.974222:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10db4e300 00000100:00100000:3.0:1784191918.974260:0:166438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 55 00000100:00100000:3.0:1784191918.974275:0:166438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+54:69110:x1870858812475776:12345-192.168.204.16@tcp:4:cp.0 00002000:00100000:2.0:1784191918.974418:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1e2:0x0] (0->159677) req@ffff8af22dcfc700 x1870858812477184/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 488/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191918.974428:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af22dcfc700 with x1870858812477184 ext(0->159677) 00002000:00010000:2.0:1784191918.974432:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af22dcfc700 00000100:00100000:2.0:1784191918.974542:0:160171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+58:69112:x1870858812475136:12345-192.168.204.16@tcp:4:cp.0 Request processed in 16073us (27371us total) trans 17179869267 rc 0/0 00000100:00100000:2.0:1784191918.974551:0:160171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 50 00002000:00100000:2.0:1784191918.974558:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x1da:0x0] (0->1658) req@ffff8af10f4edf80 x1870858812475136/t17179869267(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 2152/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191918.974567:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10f4edf80 with x1870858812475136 ext(0->1658) 00002000:00010000:2.0:1784191918.974571:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af10f4edf80 00000100:00100000:2.0:1784191918.974584:0:160171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 56 00000100:00100000:2.0:1784191918.974592:0:160171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+54:69111:x1870858812475520:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:1.0:1784191918.974788:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+57:69110:x1870858812475904:12345-192.168.204.16@tcp:4:cp.0 Request processed in 4828us (27530us total) trans 17179869269 rc 0/0 00000100:00100000:1.0:1784191918.974797:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 54 00002000:00100000:1.0:1784191918.974803:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1dd:0x0] (0->4749) req@ffff8af104c7a300 x1870858812475904/t17179869269(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 5240/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191918.975126:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af104c7a300 with x1870858812475904 ext(0->4749) 00002000:00010000:1.0:1784191918.975130:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af104c7a300 00000100:00100000:1.0:1784191918.975149:0:160170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 57 00000100:00100000:1.0:1784191918.975157:0:160170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+54:69109:x1870858812476288:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:3.0:1784191918.975653:0:166438:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:3.0:1784191918.975660:0:166438:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:3.0:1784191918.975662:0:166438:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:3.0:1784191918.975665:0:166438:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00000100:00100000:2.0:1784191918.977604:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812477312 00000100:00100000:2.0:1784191918.977627:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812477312 00000100:00100000:2.0:1784191918.977933:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 420 00000100:00100000:2.0:1784191918.977948:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+56:69109:x1870858812477312:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:2.0:1784191918.978971:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+56:69109:x1870858812477312:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 1017us (5955us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191918.978990:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 420 00080000:00000400:3.0:1784191918.983534:0:166438:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:3.0:1784191918.983550:0:166438:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191918.987440:0:160171:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:3.0:1784191918.987458:0:160171:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:3.0:1784191918.987470:0:160171:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:3.0:1784191918.987472:0:160171:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:3.0:1784191918.987474:0:160171:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:3.0:1784191918.987477:0:160171:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191918.988315:0:166438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+59:69110:x1870858812475776:12345-192.168.204.16@tcp:4:cp.0 Request processed in 14032us (41027us total) trans 21474836578 rc 0/0 00000100:00100000:0.0:1784191918.988333:0:166438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 55 00002000:00100000:0.0:1784191918.988352:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x260:0x0] (0->6547) req@ffff8af233108000 x1870858812475776/t21474836578(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 7040/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191918.988365:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233108000 with x1870858812475776 ext(0->6547) 00002000:00010000:0.0:1784191918.988373:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af233108000 00000100:00100000:0.0:1784191918.988422:0:166438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 58 00000100:00100000:0.0:1784191918.988437:0:166438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+56:69111:x1870858812475648:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:0.0:1784191918.988684:0:166438:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191918.988725:0:166438:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191918.988728:0:166438:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191918.988730:0:166438:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191918.988732:0:166438:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191918.988734:0:166438:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191918.989957:0:166438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+58:69111:x1870858812475648:12345-192.168.204.16@tcp:4:cp.0 Request processed in 1514us (41365us total) trans 17179869270 rc 0/0 00000100:00100000:0.0:1784191918.989973:0:166438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 58 00002000:00100000:0.0:1784191918.989986:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1dc:0x0] (0->1653) req@ffff8af233108a80 x1870858812475648/t17179869270(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 2144/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191918.989997:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233108a80 with x1870858812475648 ext(0->1653) 00002000:00010000:0.0:1784191918.990003:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af233108a80 00000100:00100000:0.0:1784191918.990052:0:166438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 59 00000100:00100000:0.0:1784191918.990065:0:166438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+58:69111:x1870858812476032:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:2.0:1784191918.991519:0:166577:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:2.0:1784191918.991533:0:166577:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191918.991536:0:166577:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:2.0:1784191918.991539:0:166577:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191918.991542:0:166577:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191918.991545:0:166577:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191918.992370:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191918.992408:0:160169:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 7 min 3 max 116 00000100:00100000:2.0:1784191918.992418:0:160169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_007' 00000100:00100000:2.0:1784191918.992593:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812477440 00000100:00100000:2.0:1784191918.992606:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812477440 00002000:00100000:2.0:1784191918.992664:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x266:0x0] (0->88086) req@ffff8af22dcfe300 x1870858812477440/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 488/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191918.992678:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af22dcfe300 with x1870858812477440 ext(0->88086) 00002000:00010000:2.0:1784191918.992685:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af22dcfe300 00080000:00000400:0.0:1784191918.992975:0:166438:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191918.993000:0:166438:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191918.993003:0:166438:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191918.993005:0:166438:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191918.993007:0:166438:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191918.993009:0:166438:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191918.993543:0:166577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+58:69112:x1870858812476160:12345-192.168.204.16@tcp:4:cp.0 Request processed in 43547us (46526us total) trans 17179869271 rc 0/0 00000100:00100000:2.0:1784191918.993557:0:166577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 48 00002000:00100000:2.0:1784191918.993570:0:166577:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1de:0x0] (0->116977) req@ffff8af10db4f100 x1870858812476160/t17179869271(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 488/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191918.993581:0:166577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10db4f100 with x1870858812476160 ext(0->116977) 00002000:00010000:2.0:1784191918.993587:0:166577:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af10db4f100 00000100:00100000:2.0:1784191918.993624:0:166577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 60 00000100:00100000:2.0:1784191918.993637:0:166577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+57:69111:x1870858812476672:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:0.0:1784191918.994005:0:166438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+61:69111:x1870858812476032:12345-192.168.204.16@tcp:4:cp.0 Request processed in 3941us (45492us total) trans 21474836580 rc 0/0 00000100:00100000:0.0:1784191918.994015:0:166438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 59 00002000:00100000:0.0:1784191918.994023:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x261:0x0] (0->6820) req@ffff8af23310a680 x1870858812476032/t21474836580(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 7312/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191918.994032:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af23310a680 with x1870858812476032 ext(0->6820) 00002000:00010000:0.0:1784191918.994037:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af23310a680 00000100:00100000:0.0:1784191918.994067:0:166438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 61 00000100:00100000:0.0:1784191918.994076:0:166438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1010baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+60:69112:x1870858812476544:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:2.0:1784191918.995134:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191918.995277:0:160171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+61:69111:x1870858812475520:12345-192.168.204.16@tcp:4:cp.0 Request processed in 20681us (47985us total) trans 21474836579 rc 0/0 00000100:00100000:3.0:1784191918.995289:0:160171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 56 00002000:00100000:3.0:1784191918.995344:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x25f:0x0] (0->854) req@ffff8af233109500 x1870858812475520/t21474836579(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 1344/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191918.995356:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233109500 with x1870858812475520 ext(0->854) 00002000:00010000:3.0:1784191918.995362:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af233109500 00000100:00100000:3.0:1784191918.995389:0:160171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812477568 00000100:00100000:3.0:1784191918.995400:0:160171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812477568 00002000:00100000:3.0:1784191918.995445:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x1e6:0x0] (0->2474) req@ffff8af111b7f100 x1870858812477568/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 2968/0 e 0 to 0 dl 1784191929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191918.995454:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111b7f100 with x1870858812477568 ext(0->2474) 00002000:00010000:3.0:1784191918.995459:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af111b7f100 00000100:00100000:3.0:1784191918.995485:0:160171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 62 00000100:00100000:3.0:1784191918.995495:0:160171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+59:69110:x1870858812476928:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:0.0:1784191919.001976:0:167413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 63 00000100:00100000:0.0:1784191919.002003:0:167413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+60:69110:x1870858812476800:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:3.0:1784191919.003092:0:160171:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:3.0:1784191919.003105:0:160171:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:3.0:1784191919.003108:0:160171:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:3.0:1784191919.003111:0:160171:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:3.0:1784191919.003113:0:160171:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:3.0:1784191919.003115:0:160171:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191919.005912:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191919.006232:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191919.006283:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191919.006306:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191919.006334:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191919.006361:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191919.006391:0:166572:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:2.0:1784191919.006404:0:166572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_008' 00000001:00080000:2.0:1784191919.006547:0:160160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836577 is committed 00000001:00080000:2.0:1784191919.006572:0:160160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836575 is committed 00080000:00000400:1.0:1784191919.006589:0:160170:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:1.0:1784191919.006596:0:160170:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:1.0:1784191919.006598:0:160170:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:1.0:1784191919.006601:0:160170:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:1.0:1784191919.006603:0:160170:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:1.0:1784191919.006605:0:160170:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191919.006824:0:166576:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:2.0:1784191919.006828:0:166576:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191919.006830:0:166576:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:2.0:1784191919.006832:0:166576:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191919.006834:0:166576:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191919.006836:0:166576:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191919.007124:0:160169:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:2.0:1784191919.007136:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812477696 00000100:00100000:2.0:1784191919.007147:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812477696 00002000:00100000:2.0:1784191919.007213:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x268:0x0] (0->26715) req@ffff8af111b7c000 x1870858812477696/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 488/0 e 0 to 0 dl 1784191930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191919.007226:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111b7c000 with x1870858812477696 ext(0->26715) 00002000:00010000:2.0:1784191919.007234:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111b7c000 00000100:00100000:2.0:1784191919.007258:0:160169:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:2.0:1784191919.007264:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812477952 00000100:00100000:2.0:1784191919.007267:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812477952 00002000:00100000:2.0:1784191919.007284:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1e8:0x0] (0->315402) req@ffff8af111b7ea00 x1870858812477952/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 488/0 e 0 to 0 dl 1784191930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191919.007292:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111b7ea00 with x1870858812477952 ext(0->315402) 00002000:00010000:2.0:1784191919.007310:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af111b7ea00 00000100:00100000:2.0:1784191919.007320:0:160169:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:2.0:1784191919.007326:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812477824 00000100:00100000:2.0:1784191919.007329:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812477824 00002000:00100000:2.0:1784191919.007344:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1e7:0x0] (0->1610) req@ffff8af111b7c380 x1870858812477824/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 2104/0 e 0 to 0 dl 1784191930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191919.007352:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111b7c380 with x1870858812477824 ext(0->1610) 00002000:00010000:2.0:1784191919.007356:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af111b7c380 00000100:00100000:2.0:1784191919.007363:0:160169:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:2.0:1784191919.007368:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812478208 00000100:00100000:2.0:1784191919.007370:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812478208 00002000:00100000:2.0:1784191919.007382:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x267:0x0] (0->42516) req@ffff8af111b7d500 x1870858812478208/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 488/0 e 0 to 0 dl 1784191930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191919.007389:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111b7d500 with x1870858812478208 ext(0->42516) 00002000:00010000:2.0:1784191919.007393:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111b7d500 00000100:00100000:2.0:1784191919.007399:0:160169:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:2.0:1784191919.007403:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812478336 00000100:00100000:2.0:1784191919.007406:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812478336 00002000:00100000:2.0:1784191919.007419:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1e5:0x0] (0->1175411) req@ffff8af111b7e300 x1870858812478336/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 488/0 e 0 to 0 dl 1784191930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191919.007429:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111b7e300 with x1870858812478336 ext(0->1175411) 00002000:00010000:2.0:1784191919.007433:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af111b7e300 00000100:00100000:2.0:1784191919.007457:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812478080 00000100:00100000:2.0:1784191919.007461:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812478080 00000100:00100000:2.0:1784191919.007502:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 421 00000100:00100000:2.0:1784191919.007514:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+66:69112:x1870858812478080:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:2.0:1784191919.007635:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+66:69112:x1870858812478080:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 122us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191919.007653:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 421 00000100:00100000:3.0:1784191919.007994:0:160171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+66:69110:x1870858812476928:12345-192.168.204.16@tcp:4:cp.0 Request processed in 12498us (35341us total) trans 17179869273 rc 0/0 00000100:00100000:3.0:1784191919.008015:0:160171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 62 00002000:00100000:3.0:1784191919.008024:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x1e1:0x0] (0->10933) req@ffff8af22dcff800 x1870858812476928/t17179869273(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 11424/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191919.008034:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af22dcff800 with x1870858812476928 ext(0->10933) 00002000:00010000:3.0:1784191919.008039:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af22dcff800 00000100:00100000:3.0:1784191919.008070:0:160171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 64 00000100:00100000:3.0:1784191919.008080:0:160171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+59:69111:x1870858812477056:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:3.0:1784191919.011970:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191919.012641:0:160170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+61:69109:x1870858812476288:12345-192.168.204.16@tcp:4:cp.0 Request processed in 37476us (65481us total) trans 21474836581 rc 0/0 00000100:00100000:1.0:1784191919.012662:0:160170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 57 00000100:00100000:3.0:1784191919.012814:0:160169:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:3.0:1784191919.012828:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812478720 00000100:00100000:3.0:1784191919.012839:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812478720 00002000:00100000:1.0:1784191919.012894:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x262:0x0] (0->143466) req@ffff8af10db4d180 x1870858812476288/t21474836581(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 488/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191919.012899:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x26a:0x0] (0->24287) req@ffff8af233108380 x1870858812478720/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 488/0 e 0 to 0 dl 1784191930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191919.012916:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233108380 with x1870858812478720 ext(0->24287) 00002000:00010000:3.0:1784191919.012924:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af233108380 00002000:00100000:1.0:1784191919.012934:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10db4d180 with x1870858812476288 ext(0->143466) 00002000:00010000:1.0:1784191919.012940:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10db4d180 00000100:00100000:3.0:1784191919.012963:0:160169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 65 00000100:00100000:3.0:1784191919.012976:0:160169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+65:69111:x1870858812477184:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:3.0:1784191919.013716:0:166577:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:3.0:1784191919.013725:0:166577:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:3.0:1784191919.013728:0:166577:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:3.0:1784191919.013731:0:166577:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:3.0:1784191919.013733:0:166577:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:3.0:1784191919.013735:0:166577:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191919.014230:0:166438:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:3.0:1784191919.014235:0:166438:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:3.0:1784191919.014246:0:166438:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:3.0:1784191919.014248:0:166438:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:3.0:1784191919.014250:0:166438:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:3.0:1784191919.014252:0:166438:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191919.017947:0:166576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+67:69110:x1870858812476416:12345-192.168.204.16@tcp:4:cp.0 Request processed in 58227us (70481us total) trans 17179869272 rc 0/0 00000100:00100000:2.0:1784191919.017968:0:166576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 51 00002000:00100000:2.0:1784191919.017988:0:166576:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1df:0x0] (0->171097) req@ffff8af10fb61c00 x1870858812476416/t17179869272(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 488/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191919.018001:0:166576:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10fb61c00 with x1870858812476416 ext(0->171097) 00002000:00010000:2.0:1784191919.018012:0:166576:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af10fb61c00 00000100:00100000:2.0:1784191919.018080:0:166576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 66 00000100:00100000:2.0:1784191919.018100:0:166576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+63:69109:x1870858812477440:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:2.0:1784191919.018708:0:167414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 67 00000100:00100000:2.0:1784191919.018720:0:167414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+66:69112:x1870858812477568:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:2.0:1784191919.019259:0:167414:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:2.0:1784191919.019513:0:167414:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191919.019515:0:167414:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:2.0:1784191919.019517:0:167414:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191919.019519:0:167414:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191919.019520:0:167414:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191919.020368:0:167414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+68:69112:x1870858812477568:12345-192.168.204.16@tcp:4:cp.0 Request processed in 1641us (25233us total) trans 17179869275 rc 0/0 00000100:00100000:2.0:1784191919.020382:0:167414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 67 00002000:00100000:2.0:1784191919.020397:0:167414:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x1e6:0x0] (0->2474) req@ffff8af111b7f100 x1870858812477568/t17179869275(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 2968/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191919.020410:0:167414:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111b7f100 with x1870858812477568 ext(0->2474) 00002000:00010000:2.0:1784191919.020438:0:167414:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af111b7f100 00000100:00100000:2.0:1784191919.020485:0:167414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 68 00000100:00100000:2.0:1784191919.020496:0:167414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+64:69112:x1870858812477696:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:0.0:1784191919.023186:0:166438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1010baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+64:69112:x1870858812476544:12345-192.168.204.16@tcp:4:cp.0 Request processed in 29093us (62239us total) trans 21474836582 rc 0/0 00000100:00100000:0.0:1784191919.023209:0:166438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 61 00002000:00100000:0.0:1784191919.023232:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x263:0x0] (0->31710) req@ffff8af1010baa00 x1870858812476544/t21474836582(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 488/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191919.023244:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af1010baa00 with x1870858812476544 ext(0->31710) 00002000:00010000:0.0:1784191919.023254:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af1010baa00 00000100:00100000:0.0:1784191919.023300:0:166438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 69 00000100:00100000:1.0:1784191919.023315:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191919.023315:0:166438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+67:69110:x1870858812477952:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:1.0:1784191919.023428:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191919.023459:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191919.023482:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191919.023762:0:160170:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 9 min 3 max 116 00000100:00100000:1.0:1784191919.023774:0:160170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_009' 00000100:00100000:1.0:1784191919.023795:0:166572:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 9 min 3 max 116 00000100:00100000:1.0:1784191919.023805:0:166572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812478848 00000100:00100000:1.0:1784191919.023827:0:166572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812478848 00002000:00100000:1.0:1784191919.023877:0:166572:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1e4:0x0] (0->429669) req@ffff8af101687480 x1870858812478848/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 488/0 e 0 to 0 dl 1784191930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191919.023888:0:166572:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af101687480 with x1870858812478848 ext(0->429669) 00002000:00010000:1.0:1784191919.023892:0:166572:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af101687480 00000100:00100000:1.0:1784191919.023909:0:166572:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 9 min 3 max 116 00000100:00100000:1.0:1784191919.023915:0:166572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812478464 00000100:00100000:1.0:1784191919.023918:0:166572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812478464 00002000:00100000:1.0:1784191919.023931:0:166572:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1e3:0x0] (0->254128) req@ffff8af101684e00 x1870858812478464/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 488/0 e 0 to 0 dl 1784191930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191919.023938:0:166572:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af101684e00 with x1870858812478464 ext(0->254128) 00002000:00010000:1.0:1784191919.023942:0:166572:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af101684e00 00000100:00100000:1.0:1784191919.023948:0:166572:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 9 min 3 max 116 00000100:00100000:1.0:1784191919.023953:0:166572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812478592 00000100:00100000:1.0:1784191919.023955:0:166572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812478592 00002000:00100000:1.0:1784191919.023969:0:166572:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x269:0x0] (0->5104) req@ffff8af101687100 x1870858812478592/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 5600/0 e 0 to 0 dl 1784191930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191919.023990:0:166572:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af101687100 with x1870858812478592 ext(0->5104) 00002000:00010000:1.0:1784191919.023996:0:166572:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af101687100 00000100:00100000:1.0:1784191919.024019:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812478976 00000100:00100000:1.0:1784191919.024024:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812478976 00000100:00100000:1.0:1784191919.024066:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 422 00000100:00100000:1.0:1784191919.024075:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+70:69109:x1870858812478976:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:1.0:1784191919.024160:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+70:69109:x1870858812478976:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 86us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191919.024168:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 422 00000100:00100000:2.0:1784191919.024394:0:166577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+68:69111:x1870858812476672:12345-192.168.204.16@tcp:4:cp.0 Request processed in 30755us (63654us total) trans 17179869274 rc 0/0 00000100:00100000:2.0:1784191919.024403:0:166577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 60 00002000:00100000:2.0:1784191919.024410:0:166577:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1e0:0x0] (0->215292) req@ffff8af210f4e680 x1870858812476672/t17179869274(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 488/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191919.024417:0:166577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af210f4e680 with x1870858812476672 ext(0->215292) 00002000:00010000:2.0:1784191919.024422:0:166577:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af210f4e680 00000100:00100000:2.0:1784191919.024444:0:166577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 70 00000100:00100000:2.0:1784191919.024452:0:166577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+67:69110:x1870858812477824:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:2.0:1784191919.024722:0:166577:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:2.0:1784191919.024728:0:166577:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191919.024731:0:166577:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:2.0:1784191919.024734:0:166577:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191919.024737:0:166577:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191919.024739:0:166577:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:0.0:1784191919.026443:0:167413:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:0.0:1784191919.026459:0:167413:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191919.026462:0:167413:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:0.0:1784191919.026465:0:167413:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191919.026467:0:167413:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191919.026469:0:167413:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191919.027662:0:166577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+70:69110:x1870858812477824:12345-192.168.204.16@tcp:4:cp.0 Request processed in 3195us (21362us total) trans 17179869276 rc 0/0 00000100:00100000:2.0:1784191919.027708:0:166577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 70 00002000:00100000:2.0:1784191919.027728:0:166577:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1e7:0x0] (0->1610) req@ffff8af111b7c380 x1870858812477824/t17179869276(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 2104/448 e 0 to 0 dl 1784191930 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191919.027740:0:166577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111b7c380 with x1870858812477824 ext(0->1610) 00002000:00010000:2.0:1784191919.027750:0:166577:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af111b7c380 00000100:00100000:2.0:1784191919.027831:0:166577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 71 00000100:00100000:2.0:1784191919.027845:0:166577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+66:69111:x1870858812478208:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:0.0:1784191919.030449:0:167413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+66:69110:x1870858812476800:12345-192.168.204.16@tcp:4:cp.0 Request processed in 28436us (57619us total) trans 21474836583 rc 0/0 00000100:00100000:0.0:1784191919.030470:0:167413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 63 00002000:00100000:0.0:1784191919.030490:0:167413:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x264:0x0] (0->196400) req@ffff8af22dcffb80 x1870858812476800/t21474836583(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 488/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191919.030501:0:167413:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af22dcffb80 with x1870858812476800 ext(0->196400) 00002000:00010000:0.0:1784191919.030511:0:167413:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af22dcffb80 00000100:00100000:0.0:1784191919.030566:0:167413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 72 00000100:00100000:0.0:1784191919.030585:0:167413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+69:69109:x1870858812478336:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:2.0:1784191919.035563:0:167417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 73 00000100:00100000:2.0:1784191919.035592:0:167417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+65:69111:x1870858812478720:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:0.0:1784191919.036527:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191919.036577:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00080000:00000400:2.0:1784191919.037514:0:160169:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:2.0:1784191919.037526:0:160169:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191919.037528:0:160169:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:2.0:1784191919.037530:0:160169:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191919.037532:0:160169:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191919.037534:0:160169:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:1.0:1784191919.043129:0:166572:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 10 min 3 max 116 00000100:00100000:1.0:1784191919.043160:0:166572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_010' 00000100:00100000:2.0:1784191919.044827:0:160169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+70:69111:x1870858812477184:12345-192.168.204.16@tcp:4:cp.0 Request processed in 31835us (71764us total) trans 17179869277 rc 0/0 00000100:00100000:2.0:1784191919.044848:0:160169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 65 00002000:00100000:2.0:1784191919.046132:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1e2:0x0] (0->159677) req@ffff8af22dcfc700 x1870858812477184/t17179869277(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 488/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191919.046153:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af22dcfc700 with x1870858812477184 ext(0->159677) 00002000:00010000:2.0:1784191919.046163:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af22dcfc700 00000100:00100000:2.0:1784191919.046321:0:160169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812479104 00000100:00100000:2.0:1784191919.046333:0:160169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812479104 00002000:00100000:2.0:1784191919.046387:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x26c:0x0] (0->4511) req@ffff8af205563050 x1870858812479104/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 5000/0 e 0 to 0 dl 1784191930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191919.046396:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af205563050 with x1870858812479104 ext(0->4511) 00002000:00010000:2.0:1784191919.046401:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af205563050 00000100:00100000:2.0:1784191919.046453:0:160169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 74 00000100:00100000:2.0:1784191919.046465:0:160169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+69:69109:x1870858812478848:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:1.0:1784191919.053132:0:166576:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:1.0:1784191919.053144:0:166576:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:1.0:1784191919.053146:0:166576:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:1.0:1784191919.053149:0:166576:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:1.0:1784191919.053152:0:166576:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:1.0:1784191919.053154:0:166576:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191919.053526:0:167418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 75 00000100:00100000:1.0:1784191919.053547:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812479232 00000100:00100000:2.0:1784191919.053549:0:167418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+70:69109:x1870858812478464:12345-192.168.204.16@tcp:4:cp.0 00000100:00100000:1.0:1784191919.053561:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812479232 00000100:00100000:0.0:1784191919.053611:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191919.053623:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 423 00000100:00100000:1.0:1784191919.053630:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+70:69111:x1870858812479232:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:1.0:1784191919.053764:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+70:69111:x1870858812479232:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 132us (17247us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191919.053774:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 423 00080000:00000400:1.0:1784191919.054022:0:160171:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:1.0:1784191919.054027:0:160171:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:1.0:1784191919.054038:0:160171:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:1.0:1784191919.054050:0:160171:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:1.0:1784191919.054053:0:160171:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:1.0:1784191919.054057:0:160171:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191919.054544:0:160170:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 11 min 3 max 116 00000100:00100000:0.0:1784191919.054558:0:160170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_011' 00080000:00000400:0.0:1784191919.055424:0:166438:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191919.055434:0:166438:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191919.055437:0:166438:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191919.055439:0:166438:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191919.055442:0:166438:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191919.055444:0:166438:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191919.064429:0:160170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812479360 00000100:00100000:0.0:1784191919.064465:0:160170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812479360 00002000:00100000:0.0:1784191919.064533:0:160170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x26b:0x0] (0->1764) req@ffff8af10ec84a80 x1870858812479360/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 2256/0 e 0 to 0 dl 1784191930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191919.064547:0:160170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10ec84a80 with x1870858812479360 ext(0->1764) 00002000:00010000:0.0:1784191919.064554:0:160170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10ec84a80 00000100:00100000:2.0:1784191919.068148:0:166576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+70:69109:x1870858812477440:12345-192.168.204.16@tcp:4:cp.0 Request processed in 50038us (75771us total) trans 21474836584 rc 0/0 00000100:00100000:2.0:1784191919.068181:0:166576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 66 00002000:00100000:2.0:1784191919.068203:0:166576:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x266:0x0] (0->88086) req@ffff8af22dcfe300 x1870858812477440/t21474836584(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 488/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191919.068215:0:166576:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af22dcfe300 with x1870858812477440 ext(0->88086) 00002000:00010000:2.0:1784191919.068225:0:166576:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af22dcfe300 00000100:00100000:2.0:1784191919.068282:0:166576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 76 00000100:00100000:2.0:1784191919.068490:0:166576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+69:69111:x1870858812478592:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:2.0:1784191919.069472:0:166576:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:2.0:1784191919.069484:0:166576:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191919.069487:0:166576:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:2.0:1784191919.069490:0:166576:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191919.069493:0:166576:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191919.069496:0:166576:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:1.0:1784191919.069844:0:160171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+69:69111:x1870858812477056:12345-192.168.204.16@tcp:4:cp.0 Request processed in 61756us (96804us total) trans 21474836585 rc 0/0 00000100:00100000:1.0:1784191919.069858:0:160171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 64 00002000:00100000:1.0:1784191919.069872:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x265:0x0] (0->227515) req@ffff8af22dcfc380 x1870858812477056/t21474836585(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:89/0 lens 488/448 e 0 to 0 dl 1784191929 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191919.069894:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af22dcfc380 with x1870858812477056 ext(0->227515) 00002000:00010000:1.0:1784191919.069902:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af22dcfc380 00000100:00100000:1.0:1784191919.069945:0:160171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 77 00000100:00100000:1.0:1784191919.069959:0:160171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af205563050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+68:69112:x1870858812479104:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:1.0:1784191919.070150:0:160171:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:1.0:1784191919.070154:0:160171:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:1.0:1784191919.070156:0:160171:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:1.0:1784191919.070158:0:160171:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:1.0:1784191919.070160:0:160171:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:1.0:1784191919.070162:0:160171:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:3.0:1784191919.070878:0:166577:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:3.0:1784191919.070886:0:166577:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:3.0:1784191919.070888:0:166577:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:3.0:1784191919.070890:0:166577:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:3.0:1784191919.070893:0:166577:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:3.0:1784191919.070895:0:166577:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:3.0:1784191919.071884:0:166577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+73:69111:x1870858812478208:12345-192.168.204.16@tcp:4:cp.0 Request processed in 44032us (65538us total) trans 21474836587 rc 0/0 00000100:00100000:3.0:1784191919.071899:0:166577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 71 00002000:00100000:3.0:1784191919.071914:0:166577:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x267:0x0] (0->42516) req@ffff8af111b7d500 x1870858812478208/t21474836587(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 488/448 e 0 to 0 dl 1784191930 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784191919.071926:0:166577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111b7d500 with x1870858812478208 ext(0->42516) 00002000:00010000:3.0:1784191919.071934:0:166577:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111b7d500 00000100:00100000:3.0:1784191919.071974:0:166577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 78 00000100:00100000:3.0:1784191919.071991:0:166577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+72:69109:x1870858812479360:12345-192.168.204.16@tcp:4:cp.0 00080000:00000400:3.0:1784191919.072271:0:166577:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:3.0:1784191919.072277:0:166577:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:3.0:1784191919.072280:0:166577:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:3.0:1784191919.072282:0:166577:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:3.0:1784191919.072285:0:166577:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:3.0:1784191919.072287:0:166577:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191919.072587:0:167418:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:2.0:1784191919.072592:0:167418:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:2.0:1784191919.072595:0:167418:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:2.0:1784191919.072597:0:167418:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:2.0:1784191919.072600:0:167418:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:2.0:1784191919.072601:0:167418:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:0.0:1784191919.072625:0:166438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+73:69110:x1870858812477952:12345-192.168.204.16@tcp:4:cp.0 Request processed in 49313us (66391us total) trans 17179869278 rc 0/0 00000100:00100000:0.0:1784191919.072635:0:166438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 69 00002000:00100000:0.0:1784191919.072642:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1e8:0x0] (0->315402) req@ffff8af111b7ea00 x1870858812477952/t17179869278(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 488/448 e 0 to 0 dl 1784191930 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191919.072651:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111b7ea00 with x1870858812477952 ext(0->315402) 00002000:00010000:0.0:1784191919.072656:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af111b7ea00 00080000:00000400:0.0:1784191919.072767:0:167417:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191919.072771:0:167417:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191919.072773:0:167417:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191919.072775:0:167417:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191919.072778:0:167417:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191919.072780:0:167417:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:1.0:1784191919.072926:0:160171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af205563050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+76:69112:x1870858812479104:12345-192.168.204.16@tcp:4:cp.0 Request processed in 2970us (36346us total) trans 21474836586 rc 0/0 00000100:00100000:1.0:1784191919.072934:0:160171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 77 00002000:00100000:1.0:1784191919.072941:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x26c:0x0] (0->4511) req@ffff8af205563050 x1870858812479104/t21474836586(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 5000/448 e 0 to 0 dl 1784191930 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191919.072949:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af205563050 with x1870858812479104 ext(0->4511) 00002000:00010000:1.0:1784191919.072953:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af205563050 00000100:00100000:1.0:1784191919.073074:0:166576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+75:69111:x1870858812478592:12345-192.168.204.16@tcp:4:cp.0 Request processed in 4782us (49613us total) trans 21474836588 rc 0/0 00000100:00100000:1.0:1784191919.073090:0:166576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 76 00002000:00100000:1.0:1784191919.073096:0:166576:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x269:0x0] (0->5104) req@ffff8af101687100 x1870858812478592/t21474836588(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 5600/448 e 0 to 0 dl 1784191930 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191919.073103:0:166576:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af101687100 with x1870858812478592 ext(0->5104) 00002000:00010000:1.0:1784191919.073107:0:166576:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af101687100 00080000:00000400:0.0:1784191919.073919:0:160169:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191919.073926:0:160169:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191919.073928:0:160169:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191919.073930:0:160169:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191919.073933:0:160169:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191919.073935:0:160169:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:1.0:1784191919.074006:0:167417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+73:69111:x1870858812478720:12345-192.168.204.16@tcp:4:cp.0 Request processed in 38424us (62053us total) trans 21474836590 rc 0/0 00000100:00100000:1.0:1784191919.074016:0:167417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 73 00002000:00100000:1.0:1784191919.074024:0:167417:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x26a:0x0] (0->24287) req@ffff8af233108380 x1870858812478720/t21474836590(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 488/448 e 0 to 0 dl 1784191930 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191919.074033:0:167417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af233108380 with x1870858812478720 ext(0->24287) 00002000:00010000:1.0:1784191919.074050:0:167417:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af233108380 00080000:00000400:0.0:1784191919.074376:0:167414:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191919.074380:0:167414:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191919.074382:0:167414:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191919.074384:0:167414:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191919.074394:0:167414:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191919.074397:0:167414:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:2.0:1784191919.074930:0:166577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+74:69109:x1870858812479360:12345-192.168.204.16@tcp:4:cp.0 Request processed in 2941us (21317us total) trans 21474836589 rc 0/0 00000100:00100000:2.0:1784191919.074943:0:166577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 78 00002000:00100000:2.0:1784191919.074962:0:166577:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x26b:0x0] (0->1764) req@ffff8af10ec84a80 x1870858812479360/t21474836589(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 2256/448 e 0 to 0 dl 1784191930 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191919.074971:0:166577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af10ec84a80 with x1870858812479360 ext(0->1764) 00002000:00010000:2.0:1784191919.074976:0:166577:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af10ec84a80 00000100:00100000:2.0:1784191919.075066:0:167418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+75:69109:x1870858812478464:12345-192.168.204.16@tcp:4:cp.0 Request processed in 21526us (51637us total) trans 17179869279 rc 0/0 00000100:00100000:2.0:1784191919.075075:0:167418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 75 00002000:00100000:2.0:1784191919.075081:0:167418:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x1e3:0x0] (0->254128) req@ffff8af101684e00 x1870858812478464/t17179869279(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 488/448 e 0 to 0 dl 1784191930 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191919.075089:0:167418:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af101684e00 with x1870858812478464 ext(0->254128) 00002000:00010000:2.0:1784191919.075093:0:167418:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af101684e00 00000100:00100000:2.0:1784191919.076723:0:160169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+73:69109:x1870858812478848:12345-192.168.204.16@tcp:4:cp.0 Request processed in 30225us (53373us total) trans 17179869280 rc 0/0 00000100:00100000:2.0:1784191919.076739:0:160169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 74 00002000:00100000:2.0:1784191919.076754:0:160169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1e4:0x0] (0->429669) req@ffff8af101687480 x1870858812478848/t17179869280(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 488/448 e 0 to 0 dl 1784191930 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784191919.076765:0:160169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af101687480 with x1870858812478848 ext(0->429669) 00002000:00010000:2.0:1784191919.076770:0:160169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af101687480 00000100:00100000:0.0:1784191919.077427:0:167414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+72:69112:x1870858812477696:12345-192.168.204.16@tcp:4:cp.0 Request processed in 56921us (71519us total) trans 21474836591 rc 0/0 00000100:00100000:0.0:1784191919.077442:0:167414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 68 00002000:00100000:0.0:1784191919.077458:0:167414:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x268:0x0] (0->26715) req@ffff8af111b7c000 x1870858812477696/t21474836591(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 488/448 e 0 to 0 dl 1784191930 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784191919.077468:0:167414:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111b7c000 with x1870858812477696 ext(0->26715) 00002000:00010000:0.0:1784191919.077474:0:167414:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111b7c000 00080000:00000400:0.0:1784191919.103486:0:167413:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0001: opcode 2: before 260 < left 274, rollback = 2 00080000:00000400:0.0:1784191919.103497:0:167413:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191919.105680:0:167413:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/274/0 00080000:00000400:0.0:1784191919.105685:0:167413:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 0/0/0, punch: 0/0/0, quota 7/225/0 00080000:00000400:0.0:1784191919.105705:0:167413:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191919.105709:0:167413:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00000100:00100000:1.0:1784191919.112685:0:167413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+73:69109:x1870858812478336:12345-192.168.204.16@tcp:4:cp.0 Request processed in 82083us (106296us total) trans 17179869281 rc 0/0 00000100:00100000:1.0:1784191919.112736:0:167413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 72 00002000:00100000:1.0:1784191919.112759:0:167413:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1e5:0x0] (0->1175411) req@ffff8af111b7e300 x1870858812478336/t17179869281(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:90/0 lens 488/448 e 0 to 0 dl 1784191930 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784191919.112773:0:167413:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111b7e300 with x1870858812478336 ext(0->1175411) 00002000:00010000:1.0:1784191919.112783:0:167413:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8af111b7e300 00010000:00010000:1.0:1784191919.185483:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191919.448290:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191919.448604:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812479488 00000100:00100000:1.0:1784191919.448622:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812479488 00000100:00100000:1.0:1784191919.448746:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 739 00000100:00100000:1.0:1784191919.448760:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69110:x1870858812479488:12345-192.168.204.16@tcp:63:ll_sa.0 00010000:00010000:1.0:1784191919.448831:0:158671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191919.448862:0:158671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4d49f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c3c1 expref: -99 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784191919.458307:0:158671:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 9382us 00010000:00010000:0.0:1784191919.494626:0:158671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7c00/0xfeec3c2dc5a4d4a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.494661:0:158671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7c00/0xfeec3c2dc5a4d4a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.494678:0:158671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7c00/0xfeec3c2dc5a4d4a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.494723:0:158671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7e00/0xfeec3c2dc5a4d4ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x31e7ca2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.494733:0:158671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7e00/0xfeec3c2dc5a4d4ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31e7ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.494757:0:158671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7e00/0xfeec3c2dc5a4d4ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31e7ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.494845:0:158671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7c00/0xfeec3c2dc5a4d4a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.494852:0:158671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7c00/0xfeec3c2dc5a4d4a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.494859:0:158671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7c00/0xfeec3c2dc5a4d4a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.494866:0:158671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b7c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191919.494871:0:158671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7c00/0xfeec3c2dc5a4d4a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.494879:0:158671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7c00/0xfeec3c2dc5a4d4a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.494892:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af227def800) 00010000:00010000:0.0:1784191919.494895:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191919.494899:0:158671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7c00/0xfeec3c2dc5a4d4a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.494905:0:158671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7c00/0xfeec3c2dc5a4d4a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.494917:0:158671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7e00/0xfeec3c2dc5a4d4ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31e7ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.494923:0:158671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7e00/0xfeec3c2dc5a4d4ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31e7ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.494935:0:158671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7e00/0xfeec3c2dc5a4d4ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31e7ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.494940:0:158671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b7e00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:0.0:1784191919.494944:0:158671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7e00/0xfeec3c2dc5a4d4ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31e7ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.494950:0:158671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7e00/0xfeec3c2dc5a4d4ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31e7ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.496322:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x31e7ca2 (ffff8af21713e000) 00010000:00010000:0.0:1784191919.496327:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784191919.496332:0:158671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7e00/0xfeec3c2dc5a4d4ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x31e7ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.496340:0:158671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b7e00/0xfeec3c2dc5a4d4ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x31e7ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.496398:0:158671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4d49f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3c1 expref: 8 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.496410:0:158671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af227def800) 00010000:00010000:0.0:1784191919.496413:0:158671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784191919.496416:0:158671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4d49f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3c1 expref: 8 pid: 158671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191919.496428:0:158671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3fc00, rc -2) 00000100:00100000:0.0:1784191919.496544:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69110:x1870858812479488:12345-192.168.204.16@tcp:63:ll_sa.0 Request processed in 47786us (48270us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784191919.496568:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 739 00000001:02000400:3.0:1784191919.842322:0:167465:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1784191919.964880:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191919.964927:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191919.964966:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191919.965001:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191919.965041:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191919.965089:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812480000 00000100:00100000:1.0:1784191919.965102:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812480000 00000100:00100000:3.0:1784191919.965376:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812479872 00000100:00100000:3.0:1784191919.965396:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812479872 00000100:00100000:1.0:1784191919.966157:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812480128 00000100:00100000:1.0:1784191919.966166:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812480128 00000100:00100000:3.0:1784191919.966336:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812479744 00000100:00100000:3.0:1784191919.966341:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812479744 00000100:00100000:3.0:1784191919.966371:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 380 00000100:00100000:3.0:1784191919.966383:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812479872:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191919.966498:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812479872:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 118us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191919.966507:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 380 00000100:00100000:3.0:1784191919.966530:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 381 00000100:00100000:3.0:1784191919.966536:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69112:x1870858812479744:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191919.966563:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69112:x1870858812479744:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 27us (1597us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191919.966570:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 381 00000100:00100000:2.0:1784191919.967801:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 200 00000100:00100000:2.0:1784191919.967821:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+72:69109:x1870858812480000:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191919.967893:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+72:69109:x1870858812480000:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 80us (2966us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191919.967901:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 200 00000100:00100000:2.0:1784191919.967923:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 201 00000100:00100000:2.0:1784191919.967956:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+73:69112:x1870858812480128:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191919.967984:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+73:69112:x1870858812480128:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 42us (2943us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191919.967990:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 201 00000100:00080000:2.0:1784191919.968343:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784191919.968684:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812479616 00000100:00100000:1.0:1784191919.968720:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812479616 00000100:00100000:1.0:1784191919.968780:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 73 00000100:00100000:1.0:1784191919.968801:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69112:x1870858812479616:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191919.968861:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69112:x1870858812479616:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 73us (3858us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191919.968869:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 73 00010000:00010000:3.0:1784191920.205394:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784191921.037014:0:167518:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784191921.037371:0:167518:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784191921.228967:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784191922.016393:0:167568:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784191922.016636:0:167568:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784191922.257003:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191923.211898:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784191923.211925:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828002688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784191923.212009:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191923.212132:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828002688 00000100:00100000:1.0:1784191923.212152:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828002688 00000100:00100000:1.0:1784191923.212215:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:1.0:1784191923.212224:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828002688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784191923.212261:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:1.0:1784191923.212313:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828002688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191923.212329:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:0.0:1784191923.212468:0:106500:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769803813 gen 2 00000004:00080000:0.0:1784191923.212474:0:106500:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803811 committed transno 25769803813 00000004:00080000:0.0:1784191923.212493:0:106500:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803812 committed transno 25769803813 00000004:00080000:0.0:1784191923.212505:0:106500:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803813 committed transno 25769803813 00000100:00100000:0.0:1784191923.212523:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828002688:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784191923.276959:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191923.724312:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828002816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191923.724418:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191923.724919:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828002816 00000100:00100000:2.0:1784191923.724931:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828002816 00000100:00100000:2.0:1784191923.725002:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:2.0:1784191923.725011:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828002816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784191923.725053:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:2.0:1784191923.725142:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828002816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191923.725150:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:3.0:1784191923.725407:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828002816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784191923.727086:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858828002944:0@lo:400:kworker.0 00000100:00100000:3.0:1784191923.727153:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191923.727192:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858828003072:0@lo:400:kworker.0 00000100:00100000:3.0:1784191923.727194:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858828003456:0@lo:400:kworker.0 00000100:00100000:3.0:1784191923.727220:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191923.727225:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858828003200:0@lo:400:kworker.0 00000100:00100000:3.0:1784191923.727242:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828003968:0@lo:400:kworker.0 00000100:00100000:1.0:1784191923.727246:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191923.727263:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828003712:0@lo:400:kworker.0 00000100:00100000:3.0:1784191923.727264:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191923.727282:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191923.727297:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858828004224:0@lo:400:kworker.0 00000100:00100000:3.0:1784191923.727299:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828003456 00000100:00100000:3.0:1784191923.727316:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828003456 00000100:00100000:1.0:1784191923.727319:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191923.727336:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784191923.727342:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858828003328:0@lo:400:kworker.0 00000100:00100000:1.0:1784191923.727362:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191923.727368:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828003200 00000100:00100000:3.0:1784191923.727371:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828003200 00000100:00100000:1.0:1784191923.727375:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858828003840:0@lo:400:kworker.0 00000100:00100000:3.0:1784191923.727385:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828004224 00000100:00100000:3.0:1784191923.727387:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828004224 00000100:00100000:1.0:1784191923.727392:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191923.727398:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828003328 00000100:00100000:3.0:1784191923.727400:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828003328 00000100:00100000:1.0:1784191923.727402:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828004352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784191923.727412:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828003840 00000100:00100000:3.0:1784191923.727414:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828003840 00000100:00100000:1.0:1784191923.727420:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191923.727444:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1784191923.727452:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858828003456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191923.727505:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858828003456:12345-0@lo:400:kworker.0 Request processed in 53us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191923.727511:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1784191923.727528:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1784191923.727533:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858828003200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191923.727585:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828003968 00000100:00100000:1.0:1784191923.727590:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828003968 00000100:00100000:1.0:1784191923.727618:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828003712 00000100:00100000:1.0:1784191923.727621:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828003712 00000100:00100000:1.0:1784191923.727643:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1784191923.727649:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828003968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191923.727990:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828003968:12345-0@lo:400:kworker.0 Request processed in 339us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191923.727998:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1784191923.728020:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1784191923.728026:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828003712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191923.728063:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828003712:12345-0@lo:400:kworker.0 Request processed in 37us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191923.728069:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1784191923.728247:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1784191923.728257:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858828004224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191923.728290:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858828004224:12345-0@lo:400:kworker.0 Request processed in 35us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191923.728296:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1784191923.728310:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1784191923.728316:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858828003328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191923.728339:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858828003328:12345-0@lo:400:kworker.0 Request processed in 24us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191923.728502:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1784191923.728516:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1784191923.728522:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858828003840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191923.728551:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858828003840:12345-0@lo:400:kworker.0 Request processed in 30us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191923.728557:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1784191923.728579:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191923.728607:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828003584:0@lo:400:kworker.0 00000100:00100000:1.0:1784191923.728639:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191923.728657:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828004096:0@lo:400:kworker.0 00000100:00080000:2.0:1784191923.728833:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784191923.728839:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784191923.728842:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784191923.728845:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784191923.728857:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828003072 00000100:00100000:2.0:1784191923.728864:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828003072 00000100:00100000:2.0:1784191923.728927:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1784191923.728935:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858828003072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191923.728987:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858828003072:12345-0@lo:400:kworker.0 Request processed in 53us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191923.728993:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1784191923.729016:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828004352 00000100:00100000:2.0:1784191923.729021:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828004352 00000100:00100000:2.0:1784191923.729049:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1784191923.729056:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828004352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784191923.729321:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 62706752 pending 3260416 free 67768320 avail 60600320 00000100:00100000:2.0:1784191923.729362:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828004352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 306us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191923.729369:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1784191923.729392:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828003584 00000100:00100000:2.0:1784191923.729395:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828003584 00000100:00100000:2.0:1784191923.729423:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1784191923.729431:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828003584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191923.729461:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828003584:12345-0@lo:400:kworker.0 Request processed in 31us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191923.729467:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:2.0:1784191923.729482:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784191923.729485:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784191923.729545:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828004480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784191923.729574:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191923.729612:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858828003456:0@lo:400:kworker.0 00000100:00100000:2.0:1784191923.729626:0:106501:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836575 gen 2 00000100:00100000:2.0:1784191923.729642:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828003968:0@lo:400:kworker.0 00000100:00100000:2.0:1784191923.729686:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828004480 00000100:00100000:2.0:1784191923.729723:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828004480 00000100:00100000:2.0:1784191923.729748:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1784191923.729753:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828004480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784191923.729770:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 827392 granted 62518336 pending 1179648 free 69541888 avail 62373888 00000100:00100000:2.0:1784191923.729864:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828004480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191923.729947:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1784191923.729994:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828004480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784191923.730281:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191923.730323:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858828003072:0@lo:400:kworker.0 00000100:00100000:1.0:1784191923.730334:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828003584:0@lo:400:kworker.0 00000100:00100000:1.0:1784191923.730395:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858828003328:0@lo:400:kworker.0 00000100:00100000:1.0:1784191923.730408:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858828003840:0@lo:400:kworker.0 00000100:00100000:1.0:1784191923.730425:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828004352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191923.730436:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828003712:0@lo:400:kworker.0 00000100:00100000:1.0:1784191923.730449:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858828004224:0@lo:400:kworker.0 00000100:00100000:0.0:1784191923.731111:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828002944 00000100:00100000:0.0:1784191923.731121:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828002944 00000100:00100000:0.0:1784191923.731163:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784191923.731172:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858828002944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191923.731232:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858828002944:12345-0@lo:400:kworker.0 Request processed in 61us (4079us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191923.731239:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784191923.731272:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828004096 00000100:00100000:0.0:1784191923.731276:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828004096 00000100:00100000:0.0:1784191923.731306:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1784191923.731312:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:106502:x1870858828004096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191923.731346:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:106502:x1870858828004096:12345-0@lo:400:kworker.0 Request processed in 33us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191923.731361:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:0.0:1784191923.731397:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784191923.731424:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828004096:0@lo:400:kworker.0 00000100:00100000:0.0:1784191923.731457:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858828002944:0@lo:400:kworker.0 00000100:00100000:3.0:1784191923.733262:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858828003200:12345-0@lo:400:kworker.0 Request processed in 5721us (6006us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191923.733279:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1784191923.733345:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858828003200:0@lo:400:kworker.0 00000100:00100000:0.0:1784191924.235894:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784191924.235921:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828004608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784191924.236006:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191924.236061:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828004608 00000100:00100000:0.0:1784191924.236068:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828004608 00000100:00100000:0.0:1784191924.236140:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1784191924.236152:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828004608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784191924.236176:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 827392 granted 62518336 pending 1179648 free 69541888 avail 62373888 00000100:00100000:0.0:1784191924.236222:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828004608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191924.236229:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1784191924.236292:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828004608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784191924.241332:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784191924.241472:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828004736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191924.241628:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191924.241764:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828004736 00000100:00100000:0.0:1784191924.241789:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828004736 00000100:00100000:0.0:1784191924.241868:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1784191924.241881:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:106500:x1870858828004736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784191924.241914:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 62706752 pending 3260416 free 67768320 avail 60600320 00000100:00100000:0.0:1784191924.242007:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:106500:x1870858828004736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191924.242014:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1784191924.242118:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828004736:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784191924.300549:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784191924.781614:0:160977:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869281 is committed 00000001:00080000:3.0:1784191924.781798:0:160977:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869266 is committed 00000001:00080000:0.0:1784191924.782923:0:160160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836591 is committed 00000100:00100000:2.0:1784191925.095820:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191925.095878:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191925.095905:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191925.095948:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191925.095957:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812480640 00000100:00100000:0.0:1784191925.095974:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812480640 00000100:00100000:2.0:1784191925.095984:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191925.096013:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812480256 00000100:00100000:2.0:1784191925.096018:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812480256 00000100:00100000:0.0:1784191925.096068:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812480768 00000100:00100000:2.0:1784191925.096072:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 75 00000100:00100000:0.0:1784191925.096073:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812480768 00000100:00100000:2.0:1784191925.096092:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69112:x1870858812480256:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191925.096194:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69112:x1870858812480256:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 108us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191925.096203:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 75 00000100:00100000:2.0:1784191925.096254:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 206 00000100:00100000:2.0:1784191925.096263:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:69111:x1870858812480640:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191925.096299:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:69111:x1870858812480640:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 38us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191925.096306:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 206 00000100:00100000:2.0:1784191925.096333:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812480384 00000100:00100000:2.0:1784191925.096337:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812480384 00000100:00100000:2.0:1784191925.096373:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812480512 00000100:00100000:2.0:1784191925.096377:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812480512 00000100:00100000:2.0:1784191925.096403:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 388 00000100:00100000:2.0:1784191925.096438:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69109:x1870858812480384:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191925.096472:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69109:x1870858812480384:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 49us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191925.096480:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 388 00000100:00100000:2.0:1784191925.096493:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 389 00000100:00100000:2.0:1784191925.096499:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69110:x1870858812480512:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191925.096524:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69110:x1870858812480512:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 25us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191925.096530:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 389 00000100:00100000:0.0:1784191925.098187:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 207 00000100:00100000:0.0:1784191925.098212:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69112:x1870858812480768:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191925.098309:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69112:x1870858812480768:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 108us (2402us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191925.098318:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 207 00000100:00080000:0.0:1784191925.098358:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784191925.098365:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784191925.098370:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784191925.098374:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784191925.324660:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191926.348022:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191927.372013:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191928.334213:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784191928.334317:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828004864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784191928.334434:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191928.334551:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828004864 00000100:00100000:1.0:1784191928.334563:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828004864 00000100:00100000:1.0:1784191928.334645:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:1.0:1784191928.334657:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828004864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784191928.334738:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:1.0:1784191928.334807:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828004864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191928.334816:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:1.0:1784191928.334883:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828004864:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784191928.396067:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191928.844105:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828004992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784191928.844233:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191928.844355:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828004992 00000100:00100000:2.0:1784191928.844368:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828004992 00000100:00100000:2.0:1784191928.844447:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1784191928.844461:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828004992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784191928.844506:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 827392 granted 61338688 pending 0 free 69541888 avail 62373888 00000100:00100000:2.0:1784191928.844561:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828004992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191928.844571:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:2.0:1784191928.844601:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784191928.844668:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828004992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784191928.853907:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828005120:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784191928.854038:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191928.854350:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858828005376:0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.854387:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191928.854426:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828005888:0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.854456:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191928.854480:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828006400:0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.854514:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191928.854536:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784191928.854542:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858828005248:0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.854572:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191928.854593:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828005760:0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.854614:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191928.854633:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828006272:0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.854655:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191928.854714:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828005888 00000100:00100000:2.0:1784191928.854725:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828005888 00000100:00100000:2.0:1784191928.854791:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:2.0:1784191928.854802:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828005888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.854892:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828005888:12345-0@lo:400:kworker.0 Request processed in 90us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191928.854901:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:2.0:1784191928.854933:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828006400 00000100:00100000:2.0:1784191928.854937:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828006400 00000100:00100000:2.0:1784191928.854977:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828006272 00000100:00100000:2.0:1784191928.854980:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828006272 00000100:00100000:2.0:1784191928.855008:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1784191928.855026:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828006400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.855064:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828006400:12345-0@lo:400:kworker.0 Request processed in 40us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191928.855070:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1784191928.855083:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1784191928.855089:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828006272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.855116:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828006272:12345-0@lo:400:kworker.0 Request processed in 26us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191928.855122:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1784191928.855143:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828005376 00000100:00100000:2.0:1784191928.855147:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828005376 00000100:00100000:2.0:1784191928.855179:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828005760 00000100:00100000:2.0:1784191928.855183:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828005760 00000100:00100000:2.0:1784191928.855204:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1784191928.855210:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858828005376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.855242:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858828005376:12345-0@lo:400:kworker.0 Request processed in 32us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191928.855248:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1784191928.855259:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1784191928.855265:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828005760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.855291:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828005760:12345-0@lo:400:kworker.0 Request processed in 27us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191928.855298:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00080000:2.0:1784191928.855330:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784191928.855335:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784191928.855339:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784191928.855341:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784191928.855366:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828005632:0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.855396:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191928.855415:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828006144:0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.855439:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191928.855460:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784191928.855467:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828005504:0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.855490:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191928.855507:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858828006016:0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.855530:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191928.855545:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828006528:0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.855567:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191928.855591:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828005632 00000100:00100000:2.0:1784191928.855595:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828005632 00000100:00100000:2.0:1784191928.855623:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828005504 00000100:00100000:2.0:1784191928.855626:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828005504 00000100:00100000:2.0:1784191928.855638:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828006016 00000100:00100000:2.0:1784191928.855640:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828006016 00000100:00100000:2.0:1784191928.855651:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828006528 00000100:00100000:2.0:1784191928.855653:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828006528 00000100:00100000:2.0:1784191928.855665:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1784191928.855670:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828005632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.855736:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828005632:12345-0@lo:400:kworker.0 Request processed in 64us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191928.855742:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1784191928.855754:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1784191928.855760:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828005504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.855791:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828005504:12345-0@lo:400:kworker.0 Request processed in 32us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191928.855804:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1784191928.855817:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1784191928.855822:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858828006016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.855851:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858828006016:12345-0@lo:400:kworker.0 Request processed in 29us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191928.855871:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1784191928.855882:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1784191928.855888:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828006528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.855916:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828006528:12345-0@lo:400:kworker.0 Request processed in 28us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191928.855923:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00080000:2.0:1784191928.855940:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784191928.855944:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784191928.855989:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828005760:0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.856003:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828006272:0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.856013:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858828005376:0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.856022:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828005888:0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.856031:0:106500:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869266 gen 2 00000100:00100000:2.0:1784191928.856054:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828006400:0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.856094:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828005504:0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.856103:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858828006016:0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.856112:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828006528:0@lo:400:kworker.0 00000100:00100000:2.0:1784191928.856132:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828005632:0@lo:400:kworker.0 00000100:00100000:1.0:1784191928.856670:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828006144 00000100:00100000:1.0:1784191928.856678:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828006144 00000100:00100000:1.0:1784191928.856730:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:1.0:1784191928.856737:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828006144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191928.856799:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828006144:12345-0@lo:400:kworker.0 Request processed in 62us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191928.856814:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:1.0:1784191928.856851:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828006144:0@lo:400:kworker.0 00000100:00100000:0.0:1784191928.857024:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828005120 00000100:00100000:0.0:1784191928.857030:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828005120 00000100:00100000:0.0:1784191928.857078:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1784191928.857086:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828005120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784191928.857120:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:0.0:1784191928.857177:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828005120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (3140us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191928.857184:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1784191928.857211:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828005248 00000100:00100000:0.0:1784191928.857224:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828005248 00000100:00100000:0.0:1784191928.857257:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784191928.857264:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106500:x1870858828005248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191928.857305:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106500:x1870858828005248:12345-0@lo:400:kworker.0 Request processed in 41us (2731us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191928.857311:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784191928.857378:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858828005248:0@lo:400:kworker.0 00000100:00100000:0.0:1784191928.857415:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828005120:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784191928.859283:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784191928.860849:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828006656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191928.860974:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191928.861051:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828006656 00000100:00100000:0.0:1784191928.861061:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828006656 00000100:00100000:0.0:1784191928.861125:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:0.0:1784191928.861137:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828006656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784191928.861459:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:0.0:1784191928.861585:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828006656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 448us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191928.861593:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:1.0:1784191928.874993:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828006656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191929.356577:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828006784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784191929.356660:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191929.356736:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828006784 00000100:00100000:0.0:1784191929.356745:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828006784 00000100:00100000:0.0:1784191929.356808:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1784191929.356817:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828006784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784191929.356840:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 827392 granted 61338688 pending 0 free 69541888 avail 62373888 00000100:00100000:0.0:1784191929.356911:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828006784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191929.356919:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1784191929.356968:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828006784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784191929.358233:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784191929.358261:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828006912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784191929.358313:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191929.358355:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828006912 00000100:00100000:0.0:1784191929.358361:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828006912 00000100:00100000:0.0:1784191929.358400:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1784191929.358411:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828006912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784191929.358433:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:0.0:1784191929.358477:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828006912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191929.358485:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1784191929.358528:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828006912:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784191929.423377:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191930.202434:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191930.202489:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191930.202545:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191930.202575:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191930.202682:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812481152 00000100:00100000:0.0:1784191930.202735:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812481152 00000100:00100000:0.0:1784191930.202807:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 396 00000100:00100000:0.0:1784191930.202818:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812481152:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191930.202912:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812481152:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 97us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191930.202921:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 396 00000100:00100000:2.0:1784191930.203192:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191930.203212:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812481024 00000100:00100000:2.0:1784191930.203216:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812481024 00000100:00100000:2.0:1784191930.203244:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 397 00000100:00100000:2.0:1784191930.203250:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69109:x1870858812481024:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191930.203283:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:69109:x1870858812481024:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 33us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191930.203289:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 397 00000100:00100000:0.0:1784191930.203359:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812481280 00000100:00100000:0.0:1784191930.203363:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812481280 00000100:00100000:0.0:1784191930.203402:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812481408 00000100:00100000:0.0:1784191930.203420:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812481408 00000100:00100000:0.0:1784191930.203448:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 210 00000100:00100000:0.0:1784191930.203454:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:69111:x1870858812481280:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191930.203480:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:69111:x1870858812481280:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 26us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191930.203487:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 210 00000100:00100000:0.0:1784191930.203510:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 211 00000100:00100000:0.0:1784191930.203516:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69109:x1870858812481408:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191930.203536:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69109:x1870858812481408:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 21us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191930.203542:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 211 00000100:00080000:1.0:1784191930.203794:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784191930.203799:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784191930.203801:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784191930.203803:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191930.206462:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812480896 00000100:00100000:3.0:1784191930.206485:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812480896 00000100:00100000:3.0:1784191930.206581:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 77 00000100:00100000:3.0:1784191930.206592:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812480896:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191930.207210:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812480896:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 617us (4661us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191930.207219:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 77 00010000:00010000:0.0:1784191930.444760:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784191931.297421:0:167811:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-lfsck test 45: LFSCK should fix UID/GID/PROJID of OST object ========================================================== 04:52:09 (1784191929) 00000100:00100000:0.0:1784191931.437463:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191931.444119:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812481664 00000100:00100000:2.0:1784191931.444137:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812481664 00000100:00100000:2.0:1784191931.444215:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 793 00000100:00100000:2.0:1784191931.444226:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+7:124536:x1870858812481664:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1784191931.444250:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191931.444253:0:158665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784191931.444288:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d356 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b8b5 expref: 7 pid: 167204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.444307:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af227def800) 00010000:00010000:2.0:1784191931.444318:0:158665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784191931.444334:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127600/0xfeec3c2dc5a4d4b4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c3c8 expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.444470:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127400/0xfeec3c2dc5a4d4bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.444485:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127400/0xfeec3c2dc5a4d4bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.444496:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127400/0xfeec3c2dc5a4d4bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.444509:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4d4c2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.444516:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4d4c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.444522:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4d4c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00000400:2.0:1784191931.445281:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 253 < left 264, rollback = 2 00080000:00000400:2.0:1784191931.445287:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:2.0:1784191931.445290:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:2.0:1784191931.445292:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/2 00080000:00000400:2.0:1784191931.445294:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/1, delete: 0/0/0 00080000:00000400:2.0:1784191931.445296:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00080000:00000400:2.0:1784191931.445338:0:158665:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 251 < left 264, rollback = 2 00080000:00000400:2.0:1784191931.445341:0:158665:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 1/4/4, destroy: 0/0/0 00080000:00000400:2.0:1784191931.445343:0:158665:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 3/264/0 00080000:00000400:2.0:1784191931.445344:0:158665:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/11/0, punch: 0/0/0, quota 1/3/2 00080000:00000400:2.0:1784191931.445347:0:158665:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 2/33/3, delete: 0/0/0 00080000:00000400:2.0:1784191931.445348:0:158665:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00010000:00010000:2.0:1784191931.445479:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d4c9 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.445499:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d4c9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.445508:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d4c9 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191931.445520:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab5:0x61:0x0]: returning size 0 00010000:00010000:2.0:1784191931.445547:0:158665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127400/0xfeec3c2dc5a4d4bb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.445554:0:158665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127400/0xfeec3c2dc5a4d4bb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.445559:0:158665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127400/0xfeec3c2dc5a4d4bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.445566:0:158665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127400/0xfeec3c2dc5a4d4bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.445572:0:158665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191931.445576:0:158665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127400/0xfeec3c2dc5a4d4bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.445582:0:158665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127400/0xfeec3c2dc5a4d4bb lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.445593:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af1066eee00) 00010000:00010000:2.0:1784191931.445596:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191931.445600:0:158665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127400/0xfeec3c2dc5a4d4bb lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.445605:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127400/0xfeec3c2dc5a4d4bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784191931.445625:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b5d905af reply state 00000000f0430db8 transno 38654705665 ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4d4c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.445636:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4d4c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.445641:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ef1f051 (ffff8af1066eed00) 00010000:00010000:2.0:1784191931.445643:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191931.445646:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784191931.445678:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127600/0xfeec3c2dc5a4d4b4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3c8 expref: 9 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.445727:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d4c9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3c8 expref: 8 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.445735:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1066ee600) 00010000:00010000:2.0:1784191931.445738:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191931.445740:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233126000, rc 0) 00000100:00100000:2.0:1784191931.445833:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:124536:x1870858812481664:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1608us (8378us total) trans 38654705665 rc 0/0 00000100:00100000:2.0:1784191931.445842:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 793 00000100:00100000:3.0:1784191931.452192:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191931.452231:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812481920 00000100:00100000:3.0:1784191931.452241:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812481920 00000100:00100000:3.0:1784191931.452295:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 794 00000100:00100000:3.0:1784191931.452304:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:124536:x1870858812481920:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1784191931.452331:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191931.452358:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f000/0xfeec3c2dc5a4d4d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c3cf expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.452476:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d4de lrc: 3/0,1 mode: --/EX res: [0x200003ab5:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.452491:0:161504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d4c9 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3c8 expref: 10 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.452499:0:161504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d4de lrc: 4/0,1 mode: --/EX res: [0x200003ab5:0x61:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.452532:0:161504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d4c9 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3c8 expref: 10 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.452546:0:161504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d4c9 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3c8 expref: 10 pid: 158665 timeout: 5651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191931.452560:0:161504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:161504:1870858828007040:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191931.452969:0:161504:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af233b8b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191931.464312:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191931.464356:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812482048 00000100:00100000:2.0:1784191931.464366:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812482048 00010000:00010000:2.0:1784191931.464409:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d4c9 lrc: 5/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3c8 expref: 11 pid: 158665 timeout: 5651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191931.464447:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 209 00000100:00100000:2.0:1784191931.464468:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:69110:x1870858812482048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784191931.464490:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191931.464498:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d4c9 lrc: 5/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3c8 expref: 11 pid: 158665 timeout: 5651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.464512:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d4c9 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3c8 expref: 11 pid: 158665 timeout: 5651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.464538:0:158651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1066ee600) 00010000:00010000:2.0:1784191931.464544:0:158651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d4de lrc: 3/0,1 mode: --/EX res: [0x200003ab5:0x61:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.464553:0:158651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d4de lrc: 3/0,1 mode: EX/EX res: [0x200003ab5:0x61:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.464561:0:158651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d4de lrc: 4/0,1 mode: EX/EX res: [0x200003ab5:0x61:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.464584:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784191931.464769:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d4c9 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3c8 expref: 11 pid: 158665 timeout: 5651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191931.464790:0:161504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:161504:1870858828007040:192.168.204.16@tcp:104: 00010000:00010000:3.0:1784191931.464827:0:161504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d4de lrc: 3/0,1 mode: EX/EX res: [0x200003ab5:0x61:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.464838:0:161504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d4de lrc: 3/0,1 mode: EX/EX res: [0x200003ab5:0x61:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.464844:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d4de lrc: 3/0,1 mode: EX/EX res: [0x200003ab5:0x61:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191931.464870:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab5:0x61:0x0]: returning size 0 00000004:00080000:3.0:1784191931.465031:0:161504:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x26d:0x0], count =21 00000004:00080000:3.0:1784191931.465042:0:161504:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x26d:0x0]+21 in llog 00000004:00080000:3.0:1784191931.465088:0:161504:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x282:0x0], index 0: 0 00010000:00010000:3.0:1784191931.465205:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d4de lrc: 3/0,1 mode: EX/EX res: [0x200003ab5:0x61:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.465213:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d4de lrc: 2/0,0 mode: EX/EX res: [0x200003ab5:0x61:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.465220:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d4de lrc: 3/0,0 mode: EX/EX res: [0x200003ab5:0x61:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.465226:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d08e600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191931.465230:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d4de lrc: 3/0,0 mode: EX/EX res: [0x200003ab5:0x61:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.465249:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d4de lrc: 4/0,0 mode: EX/EX res: [0x200003ab5:0x61:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.465261:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1066ee600) 00010000:00010000:3.0:1784191931.465264:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784191931.465268:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d4de lrc: 2/0,0 mode: --/EX res: [0x200003ab5:0x61:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.465274:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d4de lrc: 0/0,0 mode: --/EX res: [0x200003ab5:0x61:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.465338:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f000/0xfeec3c2dc5a4d4d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3cf expref: 11 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.465348:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:3.0:1784191931.465351:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784191931.465354:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f000/0xfeec3c2dc5a4d4d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3cf expref: 11 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.465367:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d08f000, rc 0) 00000100:00100000:2.0:1784191931.465861:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+10:69110:x1870858812482048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1392us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191931.465872:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 209 00000100:00100000:3.0:1784191931.466883:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:124536:x1870858812481920:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 14572us (14694us total) trans 38654705666 rc 301/301 00000100:00100000:3.0:1784191931.466895:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 794 00010000:00010000:3.0:1784191931.470354:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191931.470998:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191931.471088:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812482304 00000100:00100000:3.0:1784191931.471098:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812482304 00000100:00100000:3.0:1784191931.471145:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 215 00000100:00100000:3.0:1784191931.471157:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:124536:x1870858812482304:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:3.0:1784191931.471508:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+10:124536:x1870858812482304:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 351us (515us total) trans 38654705667 rc 0/0 00000100:00100000:3.0:1784191931.471516:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 215 00000100:00100000:2.0:1784191931.480931:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191931.481026:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812482432 00000100:00100000:3.0:1784191931.481036:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812482432 00000100:00100000:3.0:1784191931.481101:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 795 00000100:00100000:3.0:1784191931.481112:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+10:124536:x1870858812482432:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1784191931.481140:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191931.481166:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f000/0xfeec3c2dc5a4d4ec lrc: 2/0,0 mode: --/CR res: [0x200003ab5:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c3d6 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.481230:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f000/0xfeec3c2dc5a4d4ec lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x61:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3d6 expref: 11 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.481247:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f000/0xfeec3c2dc5a4d4ec lrc: 3/0,0 mode: CR/CR res: [0x200003ab5:0x61:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3d6 expref: 11 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.481265:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:3.0:1784191931.481269:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784191931.481273:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d08f000, rc 0) 00000100:00100000:3.0:1784191931.481337:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:124536:x1870858812482432:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 227us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191931.481346:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 795 00000100:00100000:1.0:1784191931.501990:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191931.502282:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812482688 00000100:00100000:3.0:1784191931.502292:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812482688 00000100:00100000:3.0:1784191931.502397:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 216 00000100:00100000:3.0:1784191931.502409:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af105324450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+11:124536:x1870858812482688:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:3.0:1784191931.502673:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af105324450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:124536:x1870858812482688:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 264us (690us total) trans 38654705668 rc 0/0 00000100:00100000:3.0:1784191931.502681:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 216 00000100:00100000:1.0:1784191931.547017:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191931.547090:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812482816 00000100:00100000:2.0:1784191931.547104:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812482816 00000100:00100000:2.0:1784191931.547176:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 796 00000100:00100000:2.0:1784191931.547189:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+12:124543:x1870858812482816:12345-192.168.204.16@tcp:101:chown.0 00010000:00010000:2.0:1784191931.547216:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191931.547259:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126e00/0xfeec3c2dc5a4d4f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c3dd expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.547347:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126200/0xfeec3c2dc5a4d4fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.547363:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126200/0xfeec3c2dc5a4d4fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.547376:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126200/0xfeec3c2dc5a4d4fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191931.547431:0:158665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784191931.547436:0:158665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191931.547477:0:158665:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126200/0xfeec3c2dc5a4d4fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.547503:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126e00/0xfeec3c2dc5a4d4f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3dd expref: 14 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.547523:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126200/0xfeec3c2dc5a4d4fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3dd expref: 13 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.547531:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af1066eee00) 00010000:00010000:2.0:1784191931.547534:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784191931.547538:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233126200, rc 0) 00000100:00100000:2.0:1784191931.548149:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:124543:x1870858812482816:12345-192.168.204.16@tcp:101:chown.0 Request processed in 429us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191931.548159:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 796 00000100:00100000:1.0:1784191931.551498:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191931.551587:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812482944 00000100:00100000:3.0:1784191931.551596:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812482944 00000100:00100000:3.0:1784191931.551672:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 797 00000100:00100000:3.0:1784191931.551712:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+13:124543:x1870858812482944:12345-192.168.204.16@tcp:101:chown.0 00010000:00010000:3.0:1784191931.552037:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191931.552062:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d501 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c3e4 expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552129:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f400/0xfeec3c2dc5a4d508 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552144:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f400/0xfeec3c2dc5a4d508 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552157:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f400/0xfeec3c2dc5a4d508 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552171:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d50f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552178:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d50f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552184:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d50f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552254:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0ab600/0xfeec3c2dc5a4d516 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552278:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0ab600/0xfeec3c2dc5a4d516 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552286:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0ab600/0xfeec3c2dc5a4d516 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784191931.552332:0:161504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab5:0x61:0x0]: returning size 0 00000004:00200000:3.0:1784191931.552337:0:161504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784191931.552359:0:161504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0ab600/0xfeec3c2dc5a4d516 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552371:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0ab600/0xfeec3c2dc5a4d516 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552382:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f400/0xfeec3c2dc5a4d508 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552388:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f400/0xfeec3c2dc5a4d508 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552394:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f400/0xfeec3c2dc5a4d508 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552401:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f400/0xfeec3c2dc5a4d508 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552407:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d08f400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191931.552411:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f400/0xfeec3c2dc5a4d508 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552419:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f400/0xfeec3c2dc5a4d508 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552439:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af1066eee00) 00010000:00010000:3.0:1784191931.552442:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191931.552446:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f400/0xfeec3c2dc5a4d508 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552453:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f400/0xfeec3c2dc5a4d508 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552467:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d50f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552473:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d50f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552478:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d50f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552483:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20c0aae00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191931.552485:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d50f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552491:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d50f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552497:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ef1f051 (ffff8af1066eed00) 00010000:00010000:3.0:1784191931.552499:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191931.552502:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d50f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552508:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d50f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552545:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d501 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3e4 expref: 15 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552559:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0ab600/0xfeec3c2dc5a4d516 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3e4 expref: 14 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.552567:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:3.0:1784191931.552569:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784191931.552571:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20c0ab600, rc 0) 00000100:00100000:3.0:1784191931.553027:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:124543:x1870858812482944:12345-192.168.204.16@tcp:101:chown.0 Request processed in 1340us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191931.553035:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 797 00000100:00100000:1.0:1784191931.559271:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191931.559380:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812483072 00000100:00100000:2.0:1784191931.559408:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812483072 00000100:00100000:2.0:1784191931.559477:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 424 00000100:00100000:2.0:1784191931.559489:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+44:69111:x1870858812483072:12345-192.168.204.16@tcp:101:chown.0 00010000:00010000:2.0:1784191931.559510:0:162387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191931.559534:0:162387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f40750a/0xfeec3c2dc5a4d51d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c3eb expref: -99 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784191931.559564:0:162387:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x282:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784191931.559586:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x282:0x0].0x0 since=5551s v=(0 0) 00010000:00010000:2.0:1784191931.559591:0:162387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x282:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784191931.559601:0:162387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f40750a/0xfeec3c2dc5a4d51d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3eb expref: 45 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.559619:0:162387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006f40750a/0xfeec3c2dc5a4d51d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3eb expref: 45 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.559632:0:162387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233126e00, rc 0) 00000100:00100000:2.0:1784191931.559722:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+45:69111:x1870858812483072:12345-192.168.204.16@tcp:101:chown.0 Request processed in 235us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191931.559739:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 424 00000100:00100000:1.0:1784191931.575094:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191931.575188:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812483200 00000100:00100000:3.0:1784191931.575200:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812483200 00000100:00100000:3.0:1784191931.575274:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 798 00000100:00100000:3.0:1784191931.575285:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+14:124543:x1870858812483200:12345-192.168.204.16@tcp:101:chown.0 00010000:00010000:3.0:1784191931.575308:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191931.575331:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d524 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c3f2 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.575374:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d52b lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.575390:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d52b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.575402:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d52b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.575530:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d524 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3f2 expref: 16 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.575550:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d52b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3f2 expref: 15 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191931.575908:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:3.0:1784191931.575913:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784191931.575916:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d08e600, rc 0) 00000100:00100000:2.0:1784191931.576051:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:124543:x1870858812483200:12345-192.168.204.16@tcp:101:chown.0 Request processed in 766us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191931.576060:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 798 00000100:00100000:1.0:1784191931.578772:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191931.578883:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812483456 00000100:00100000:2.0:1784191931.578894:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812483456 00000100:00100000:2.0:1784191931.578960:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 799 00000100:00100000:2.0:1784191931.578971:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+15:124543:x1870858812483456:12345-192.168.204.16@tcp:36:chown.0 00010000:00010000:2.0:1784191931.579047:0:158665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191931.579079:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0ab600/0xfeec3c2dc5a4d516 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3e4 expref: 15 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.579209:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:2.0:1784191931.579215:0:158665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784191931.579251:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4d532 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.579265:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4d532 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x61:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.579275:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4d532 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x61:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784191931.579680:0:158665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x24:0x0].2, 88 off8344 00000004:00080000:2.0:1784191931.579721:0:158665:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 5551759031204ns, next at 5552759028369ns, rc = 0 00000004:00010000:2.0:1784191931.579775:0:158665:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b89c604c reply state 00000000eb2b0622 transno 38654705669 ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4d532 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x61:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.579790:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4d532 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191931.579796:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:2.0:1784191931.579799:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1784191931.579802:0:158665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784191931.579932:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+16:124543:x1870858812483456:12345-192.168.204.16@tcp:36:chown.0 Request processed in 961us (1169us total) trans 38654705669 rc 0/0 00000100:00100000:2.0:1784191931.579940:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 799 00000100:00100000:1.0:1784191931.584053:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191931.584156:0:162390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812483584 00000100:00100000:0.0:1784191931.584168:0:162390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812483584 00000100:00100000:0.0:1784191931.584227:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 425 00000100:00100000:0.0:1784191931.584239:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+45:69112:x1870858812483584:12345-192.168.204.16@tcp:2:chown.0 00080000:00000400:0.0:1784191931.584362:0:162390:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 2: before 259 < left 274, rollback = 2 00080000:00000400:0.0:1784191931.584367:0:162390:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 00080000:00000400:0.0:1784191931.584369:0:162390:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/274/0 00080000:00000400:0.0:1784191931.584371:0:162390:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 1/9/0, punch: 0/0/0, quota 1/3/0 00080000:00000400:0.0:1784191931.584374:0:162390:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 00080000:00000400:0.0:1784191931.584376:0:162390:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 00002000:00010000:0.0:1784191931.584461:0:162390:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784191931.584465:0:162390:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1784191931.584467:0:162390:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1784191931.584468:0:162390:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb ctime from disk: 0 -> 1784191931 00002000:00010000:0.0:1784191931.584480:0:162390:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1784191931.584542:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+46:69112:x1870858812483584:12345-192.168.204.16@tcp:2:chown.0 Request processed in 305us (501us total) trans 21474836592 rc 0/0 00000100:00100000:0.0:1784191931.584551:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 425 00010000:00010000:2.0:1784191932.500939:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191933.459169:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784191933.459197:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828007168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784191933.459286:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191933.459350:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828007168 00000100:00100000:0.0:1784191933.459358:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828007168 00000100:00100000:0.0:1784191933.459410:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:0.0:1784191933.459418:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828007168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784191933.459463:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:0.0:1784191933.459513:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828007168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191933.459520:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:0.0:1784191933.459571:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828007168:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784191933.515804:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191933.944674:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191933.945172:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812483712 00000100:00100000:3.0:1784191933.945184:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812483712 00000100:00100000:2.0:1784191933.945307:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 800 00000100:00100000:2.0:1784191933.945319:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+16:124580:x1870858812483712:12345-192.168.204.16@tcp:101:lfs.0 00000100:00080000:0.0:1784191933.945323:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784191933.945347:0:164531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191933.945373:0:164531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127400/0xfeec3c2dc5a4d539 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c3f9 expref: -99 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945435:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127600/0xfeec3c2dc5a4d540 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945448:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127600/0xfeec3c2dc5a4d540 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945462:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127600/0xfeec3c2dc5a4d540 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945473:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d547 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945480:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945487:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945554:0:164531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4d54e lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945564:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4d54e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945588:0:164531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4d54e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191933.945637:0:164531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab5:0x61:0x0]: returning size 0 00000004:00200000:2.0:1784191933.945642:0:164531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784191933.945666:0:164531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4d54e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945680:0:164531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4d54e lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945887:0:164531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127600/0xfeec3c2dc5a4d540 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945896:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127600/0xfeec3c2dc5a4d540 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945902:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127600/0xfeec3c2dc5a4d540 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945909:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127600/0xfeec3c2dc5a4d540 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945915:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191933.945920:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127600/0xfeec3c2dc5a4d540 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945927:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127600/0xfeec3c2dc5a4d540 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945939:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af1066eee00) 00010000:00010000:2.0:1784191933.945949:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191933.945955:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127600/0xfeec3c2dc5a4d540 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945961:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127600/0xfeec3c2dc5a4d540 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945976:0:164531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945982:0:164531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d547 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945987:0:164531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d547 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.945991:0:164531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233126000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:2.0:1784191933.945994:0:164531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d547 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.946000:0:164531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d547 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.946009:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ef1f051 (ffff8af1066eed00) 00010000:00010000:2.0:1784191933.946011:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784191933.946014:0:164531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d547 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.946019:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126000/0xfeec3c2dc5a4d547 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 164531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.946047:0:164531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127400/0xfeec3c2dc5a4d539 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3f9 expref: 18 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.946412:0:164531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4d54e lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3f9 expref: 17 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.946420:0:164531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:2.0:1784191933.946422:0:164531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191933.946425:0:164531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233127000, rc 0) 00000100:00100000:2.0:1784191933.946534:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:124580:x1870858812483712:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1217us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191933.946543:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 800 00000100:00100000:3.0:1784191933.959168:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191933.959643:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812483968 00000100:00100000:2.0:1784191933.959655:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812483968 00000100:00100000:2.0:1784191933.959747:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 801 00000100:00100000:2.0:1784191933.959759:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:124580:x1870858812483968:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1784191933.959801:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191933.959824:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4d555 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c400 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.959943:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4d55c lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.959961:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4d55c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.959974:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4d55c lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784191933.959986:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab5:0x61:0x0]: returning size 0 00010000:00010000:2.0:1784191933.960144:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4d555 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c400 expref: 20 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.960164:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4d55c lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c400 expref: 19 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.960173:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:2.0:1784191933.960176:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784191933.960179:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233126800, rc 0) 00000100:00100000:2.0:1784191933.960256:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:124580:x1870858812483968:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 500us (1098us total) trans 38654705670 rc 0/0 00000100:00100000:2.0:1784191933.960263:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 801 00000100:00100000:1.0:1784191933.963994:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828007296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191933.964069:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191933.964198:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828007296 00000100:00100000:0.0:1784191933.964207:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828007296 00000100:00100000:0.0:1784191933.964271:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1784191933.964282:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828007296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784191933.964315:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:0.0:1784191933.964373:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828007296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191933.964380:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:1.0:1784191933.964500:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784191933.964547:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828007296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191933.965131:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828007424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784191933.965176:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191933.965404:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858828007552:0@lo:400:kworker.0 00000100:00100000:3.0:1784191933.965448:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191933.965498:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828007552 00000100:00100000:0.0:1784191933.965525:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828007552 00000100:00100000:0.0:1784191933.965570:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784191933.965576:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1074b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106500:x1870858828007552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191933.965624:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1074b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106500:x1870858828007552:12345-0@lo:400:kworker.0 Request processed in 48us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191933.965631:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784191933.965669:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858828007552:0@lo:400:kworker.0 00000100:00100000:0.0:1784191933.966015:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828007424 00000100:00100000:0.0:1784191933.966019:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828007424 00000100:00100000:0.0:1784191933.966057:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:0.0:1784191933.966064:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828007424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784191933.966092:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:3.0:1784191933.966792:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858828007680:0@lo:400:kworker.0 00000100:00100000:3.0:1784191933.966833:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191933.966876:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828008192:0@lo:400:kworker.0 00000100:00100000:3.0:1784191933.966903:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191933.966920:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828008704:0@lo:400:kworker.0 00000100:00100000:3.0:1784191933.966938:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191933.966959:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784191933.966964:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:106501:1870858828007808:0@lo:400:kworker.0 00000100:00100000:3.0:1784191933.966984:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191933.967001:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858828008320:0@lo:400:kworker.0 00000100:00100000:3.0:1784191933.967038:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191933.967058:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858828008832:0@lo:400:kworker.0 00000100:00100000:3.0:1784191933.967078:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191933.967109:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828007680 00000100:00100000:3.0:1784191933.967113:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828007680 00000100:00100000:3.0:1784191933.967158:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828007808 00000100:00100000:3.0:1784191933.967162:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828007808 00000100:00100000:3.0:1784191933.967175:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828008320 00000100:00100000:3.0:1784191933.967177:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828008320 00000100:00100000:3.0:1784191933.967185:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828008832 00000100:00100000:3.0:1784191933.967188:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828008832 00000100:00100000:3.0:1784191933.967199:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1784191933.967204:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858828007680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191933.967246:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858828007680:12345-0@lo:400:kworker.0 Request processed in 41us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191933.967253:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1784191933.967270:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1784191933.967276:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106501:x1870858828007808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191933.967302:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106501:x1870858828007808:12345-0@lo:400:kworker.0 Request processed in 27us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191933.967308:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1784191933.967320:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1784191933.967325:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858828008320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191933.967352:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858828008320:12345-0@lo:400:kworker.0 Request processed in 27us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191933.967357:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1784191933.967366:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1784191933.967378:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858828008832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191933.967404:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858828008832:12345-0@lo:400:kworker.0 Request processed in 27us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191933.967409:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1784191933.967431:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828008192 00000100:00100000:3.0:1784191933.967434:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828008192 00000100:00100000:3.0:1784191933.967461:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828008704 00000100:00100000:3.0:1784191933.967464:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828008704 00000100:00100000:3.0:1784191933.967486:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1784191933.967492:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828008192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191933.967539:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828008192:12345-0@lo:400:kworker.0 Request processed in 47us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191933.967545:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1784191933.967557:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1784191933.967562:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828008704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191933.967588:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828008704:12345-0@lo:400:kworker.0 Request processed in 26us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191933.967594:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1784191933.967650:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:106501:1870858828007808:0@lo:400:kworker.0 00000100:00100000:3.0:1784191933.967660:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858828008320:0@lo:400:kworker.0 00000100:00100000:3.0:1784191933.967669:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858828008832:0@lo:400:kworker.0 00000100:00100000:3.0:1784191933.967677:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858828007680:0@lo:400:kworker.0 00000100:00100000:3.0:1784191933.967685:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828008192:0@lo:400:kworker.0 00000100:00100000:3.0:1784191933.967727:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828008704:0@lo:400:kworker.0 00000100:00100000:0.0:1784191933.969773:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828007424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3691us (4578us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191933.969788:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:0.0:1784191933.969862:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828008064:0@lo:400:kworker.0 00000100:00100000:0.0:1784191933.969920:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191933.969947:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828008576:0@lo:400:kworker.0 00000100:00100000:0.0:1784191933.969971:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191933.969997:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784191933.970006:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858828007936:0@lo:400:kworker.0 00000100:00100000:0.0:1784191933.970028:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191933.970046:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828008448:0@lo:400:kworker.0 00000100:00100000:0.0:1784191933.970069:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191933.970086:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828008960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784191933.970120:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191933.970152:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828008576 00000100:00100000:0.0:1784191933.970158:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828008576 00000100:00100000:0.0:1784191933.970201:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1784191933.970211:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828008576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191933.970260:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828008576:12345-0@lo:400:kworker.0 Request processed in 50us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191933.970267:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1784191933.970285:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828008448 00000100:00100000:0.0:1784191933.970288:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828008448 00000100:00100000:0.0:1784191933.970311:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:0.0:1784191933.970316:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828008448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191933.970363:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828008448:12345-0@lo:400:kworker.0 Request processed in 47us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191933.970369:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:0.0:1784191933.970386:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828008960 00000100:00100000:0.0:1784191933.970389:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828008960 00000100:00100000:0.0:1784191933.970409:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1784191933.970414:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828008960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784191933.970436:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 827392 granted 61338688 pending 0 free 69541888 avail 62373888 00000100:00100000:0.0:1784191933.970463:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828008960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191933.970468:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1784191933.970488:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828008064 00000100:00100000:0.0:1784191933.970491:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828008064 00000100:00100000:0.0:1784191933.970526:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828007936 00000100:00100000:0.0:1784191933.970529:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828007936 00000100:00100000:0.0:1784191933.970561:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1784191933.970566:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828008064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191933.970596:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828008064:12345-0@lo:400:kworker.0 Request processed in 30us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191933.970602:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1784191933.970613:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1784191933.970619:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858828007936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191933.970645:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858828007936:12345-0@lo:400:kworker.0 Request processed in 26us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191933.970651:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1784191933.970722:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858828007936:0@lo:400:kworker.0 00000100:00100000:0.0:1784191933.970734:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828008448:0@lo:400:kworker.0 00000100:00100000:0.0:1784191933.970749:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828008960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784191933.970757:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828008064:0@lo:400:kworker.0 00000100:00100000:0.0:1784191933.970777:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828008576:0@lo:400:kworker.0 00000100:00100000:0.0:1784191933.974872:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191933.974957:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812484096 00000100:00100000:3.0:1784191933.974967:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812484096 00000100:00100000:3.0:1784191933.975203:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 113 00000100:00100000:3.0:1784191933.975215:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:69109:x1870858812484096:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191933.975233:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191933.975256:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126800/0xfeec3c2dc5a4d55c lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c400 expref: 19 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191933.975274:0:158652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:3.0:1784191933.975279:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191933.975354:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:69109:x1870858812484096:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 140us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191933.975362:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 113 00000100:00100000:1.0:1784191933.976850:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828007424:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1784191933.976939:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784191933.976945:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784191933.976948:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784191933.976951:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784191933.989896:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191933.991641:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812484352 00000100:00100000:3.0:1784191933.991654:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812484352 00000100:00100000:3.0:1784191933.992196:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 802 00000100:00100000:2.0:1784191933.992310:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:124580:x1870858812484352:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:2.0:1784191933.992395:0:158667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191933.992424:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4d54e lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3f9 expref: 18 pid: 164531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.992442:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:2.0:1784191933.992448:0:158667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784191933.992470:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4d56a lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x61:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.992483:0:158667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d52b lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3f2 expref: 17 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.992491:0:158667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4d56a lrc: 4/0,1 mode: --/PW res: [0x200003ab5:0x61:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.992674:0:158667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d52b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3f2 expref: 17 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191933.992885:0:158667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d52b lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3f2 expref: 17 pid: 158666 timeout: 5654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191933.992901:0:158667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:158667:1870858828009088:192.168.204.16@tcp:104: 00000100:00100000:2.0:1784191933.992987:0:158667:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10c77b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784191934.002755:0:158667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:158667:1870858828009088:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191934.002802:0:158667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4d56a lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x61:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191934.003177:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191934.003436:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812484480 00000100:00100000:1.0:1784191934.003445:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812484480 00010000:00010000:1.0:1784191934.003488:0:165501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d52b lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3f2 expref: 18 pid: 158666 timeout: 5654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191934.003541:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 210 00000100:00100000:1.0:1784191934.003550:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:69110:x1870858812484480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191934.003565:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191934.003577:0:165501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d52b lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3f2 expref: 18 pid: 158666 timeout: 5654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.003591:0:165501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d52b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3f2 expref: 18 pid: 158666 timeout: 5654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.003618:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d52b lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3f2 expref: 18 pid: 158666 timeout: 5654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.003636:0:165501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:1.0:1784191934.003641:0:165501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4d56a lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x61:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.003651:0:165501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4d56a lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x61:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.003676:0:165501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4d56a lrc: 4/0,1 mode: PW/PW res: [0x200003ab5:0x61:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.003723:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191934.003787:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+17:69110:x1870858812484480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 237us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191934.003795:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 210 00010000:00010000:0.0:1784191934.003977:0:158667:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4d56a lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x61:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191934.003985:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4d56a lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x61:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784191934.004237:0:158667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x24:0x0].3, 88 off8432 00000004:00080000:0.0:1784191934.004248:0:158667:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 5554183557766ns, next at 5555183555375ns, rc = 0 00000004:00010000:0.0:1784191934.004302:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000895ac585 reply state 0000000018b4e6ce transno 38654705671 ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4d56a lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x61:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191934.004316:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4d56a lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191934.004404:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:0.0:1784191934.004408:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1784191934.004411:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784191934.004503:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:124580:x1870858812484352:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 12297us (14617us total) trans 38654705671 rc 0/0 00000100:00100000:0.0:1784191934.004511:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 802 00000100:00100000:3.0:1784191934.013062:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191934.013411:0:158668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812484736 00000100:00100000:2.0:1784191934.013424:0:158668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812484736 00000100:00100000:2.0:1784191934.013517:0:158668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 217 00000100:00100000:2.0:1784191934.013529:0:158668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+18:124580:x1870858812484736:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:2.0:1784191934.014044:0:158668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:124580:x1870858812484736:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 516us (989us total) trans 38654705672 rc 0/0 00000100:00100000:2.0:1784191934.014052:0:158668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 217 00000100:00100000:2.0:1784191934.125085:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191934.125183:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812484992 00000100:00100000:0.0:1784191934.125196:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812484992 00000100:00100000:0.0:1784191934.125265:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 803 00000100:00100000:0.0:1784191934.125276:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+19:124581:x1870858812484992:12345-192.168.204.16@tcp:101:dd.500 00010000:00010000:0.0:1784191934.125306:0:158666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191934.125334:0:158666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b6800/0xfeec3c2dc5a4d571 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c407 expref: -99 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784191934.129001:0:158666:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3607us 00010000:00010000:1.0:1784191934.147732:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4d578 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.147755:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4d578 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.147778:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4d578 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.147792:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4d57f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.147799:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4d57f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.147806:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4d57f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.147918:0:158666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4d586 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.147927:0:158666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4d586 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.147947:0:158666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4d586 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191934.147959:0:158666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab5:0x61:0x0]: returning size 0 00010000:00010000:1.0:1784191934.148056:0:158666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4d578 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.148064:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4d578 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.148071:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4d578 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.148078:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4d578 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.148084:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3fc00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191934.148088:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4d578 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.148096:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4d578 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.148110:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af1066eee00) 00010000:00010000:1.0:1784191934.148114:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191934.148118:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4d578 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.148125:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3fc00/0xfeec3c2dc5a4d578 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.148136:0:158666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4d57f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.148149:0:158666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4d57f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.148155:0:158666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4d57f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.148159:0:158666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3f000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191934.148163:0:158666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4d57f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.148169:0:158666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4d57f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.148177:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ef1f051 (ffff8af1066eed00) 00010000:00010000:1.0:1784191934.148179:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191934.148182:0:158666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4d57f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.148187:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f000/0xfeec3c2dc5a4d57f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.148251:0:158666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af2204b6800/0xfeec3c2dc5a4d571 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c407 expref: 22 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.148272:0:158666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4d586 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c407 expref: 21 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.148279:0:158666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:1.0:1784191934.148281:0:158666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784191934.148290:0:158666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3f400, rc 0) 00000100:00100000:1.0:1784191934.148387:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:124581:x1870858812484992:12345-192.168.204.16@tcp:101:dd.500 Request processed in 23111us (23315us total) trans 38654705673 rc 0/0 00000100:00100000:1.0:1784191934.148397:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 803 00000100:00100000:1.0:1784191934.157869:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191934.157968:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812485120 00000100:00100000:3.0:1784191934.157980:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812485120 00000100:00100000:3.0:1784191934.158045:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 804 00000100:00100000:3.0:1784191934.158055:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+21:124581:x1870858812485120:12345-192.168.204.16@tcp:101:dd.500 00010000:00010000:3.0:1784191934.158084:0:158665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191934.158108:0:158665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f400/0xfeec3c2dc5a4d594 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c40e expref: -99 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191934.158144:0:158665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d59b lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191934.158175:0:158665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d59b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191934.158186:0:158665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d59b lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191934.158298:0:158665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08f400/0xfeec3c2dc5a4d594 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c40e expref: 23 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191934.158317:0:158665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10d08e600/0xfeec3c2dc5a4d59b lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c40e expref: 22 pid: 158665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191934.158326:0:158665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:3.0:1784191934.158329:0:158665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784191934.158332:0:158665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10d08e600, rc 0) 00000100:00100000:3.0:1784191934.158435:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+22:124581:x1870858812485120:12345-192.168.204.16@tcp:101:dd.500 Request processed in 381us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191934.158442:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 804 00000100:00100000:0.0:1784191934.179229:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191934.179443:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812485376 00000100:00100000:2.0:1784191934.179457:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812485376 00000100:00100000:2.0:1784191934.179530:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 805 00000100:00100000:2.0:1784191934.179541:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+22:124581:x1870858812485376:12345-192.168.204.16@tcp:36:dd.500 00010000:00010000:2.0:1784191934.179605:0:158667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191934.179634:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4d586 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c407 expref: 22 pid: 158666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191934.179677:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:2.0:1784191934.179681:0:158667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784191934.179956:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4d5a2 lrc: 3/0,1 mode: --/PW res: [0x200003ab5:0x61:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191934.179973:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4d5a2 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191934.179984:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4d5a2 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784191934.180028:0:158667:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 38654705674 00000004:00010000:2.0:1784191934.180050:0:158667:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000092377809 reply state 00000000afd42598 transno 38654705675 ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4d5a2 lrc: 3/0,1 mode: PW/PW res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191934.180063:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4d5a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191934.180070:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:2.0:1784191934.180072:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784191934.180075:0:158667:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784191934.180175:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:124581:x1870858812485376:12345-192.168.204.16@tcp:36:dd.500 Request processed in 635us (956us total) trans 38654705675 rc 0/0 00000100:00100000:2.0:1784191934.180183:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 805 00000020:00080000:2.0:1784191934.180188:0:158667:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784191934.192264:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191934.192409:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812485504 00000100:00100000:1.0:1784191934.192422:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812485504 00000100:00100000:1.0:1784191934.192506:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 426 00000100:00100000:1.0:1784191934.192517:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+46:124581:x1870858812485504:12345-192.168.204.16@tcp:101:dd.500 00010000:00010000:1.0:1784191934.192536:0:162392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784191934.192555:0:162392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4d5a9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c415 expref: -99 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.192588:0:162392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006f40750a/0xfeec3c2dc5a4d51d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3eb expref: 47 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.192597:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x282:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1784191934.192601:0:162392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x282:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784191934.192607:0:162392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4d5a9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c415 expref: 47 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.192645:0:162392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006f40750a/0xfeec3c2dc5a4d51d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3eb expref: 47 pid: 162387 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.192661:0:162392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006f40750a/0xfeec3c2dc5a4d51d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3eb expref: 47 pid: 162387 timeout: 5654 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191934.192736:0:162392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:162392:1870858828009216:192.168.204.16@tcp:104: 00000100:00100000:1.0:1784191934.192824:0:162392:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10f20f540 going to sleep for 11 seconds 00000100:00080000:2.0:1784191934.192951:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784191934.204963:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191934.205156:0:162392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210300700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:162392:1870858828009216:192.168.204.16@tcp:104: 00010000:00010000:1.0:1784191934.205204:0:162392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4d5a9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c415 expref: 47 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191934.205228:0:162392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af10de3f000, rc 0) 00000100:00100000:1.0:1784191934.205297:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+47:124581:x1870858812485504:12345-192.168.204.16@tcp:101:dd.500 Request processed in 12782us (13043us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191934.205307:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 426 00000100:00100000:3.0:1784191934.205753:0:158650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812485632 00000100:00100000:3.0:1784191934.205774:0:158650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812485632 00010000:00010000:3.0:1784191934.205809:0:158650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006f40750a/0xfeec3c2dc5a4d51d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3eb expref: 47 pid: 162387 timeout: 5654 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191934.205846:0:158650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 211 00000100:00100000:3.0:1784191934.205864:0:158650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+47:69112:x1870858812485632:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191934.205879:0:158650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784191934.205896:0:158650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006f40750a/0xfeec3c2dc5a4d51d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3eb expref: 47 pid: 162387 timeout: 5654 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191934.205910:0:158650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006f40750a/0xfeec3c2dc5a4d51d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3eb expref: 47 pid: 162387 timeout: 5654 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191934.205935:0:158650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f40750a/0xfeec3c2dc5a4d51d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3eb expref: 47 pid: 162387 timeout: 5654 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191934.205952:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x282:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191934.205957:0:158650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x282:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784191934.205964:0:158650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4d5a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c415 expref: 46 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191934.205975:0:158650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4d5a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c415 expref: 46 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191934.206012:0:158650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4d5a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c415 expref: 46 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191934.206025:0:158650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:158650:1870858828009344:192.168.204.16@tcp:105: 00000100:00100000:3.0:1784191934.206105:0:158650:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af205d9fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784191934.227914:0:158650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:158650:1870858828009344:192.168.204.16@tcp:105: 00010000:00010000:3.0:1784191934.227950:0:158650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784191934.228061:0:158650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+46:69112:x1870858812485632:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 22196us (23113us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191934.228091:0:158650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 211 00000100:00100000:1.0:1784191934.238441:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191934.238654:0:166572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812485760 00000100:00100000:0.0:1784191934.238668:0:166572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812485760 00002000:00010000:0.0:1784191934.238769:0:166572:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/642 (0->18446744073709551615) 00002000:00100000:0.0:1784191934.238776:0:166572:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af210300700 with x1870858812485760 ext(0->18446744073709551615) 00002000:00010000:0.0:1784191934.238804:0:166572:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af210300700. 00000100:00100000:0.0:1784191934.238849:0:166572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 79 00000100:00100000:0.0:1784191934.238873:0:166572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+46:69112:x1870858812485760:12345-192.168.204.16@tcp:10:dd.500 00002000:00010000:0.0:1784191934.239544:0:166572:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784191934.239550:0:166572:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb mtime from disk: 0 -> 1784191933 00002000:00010000:0.0:1784191934.239552:0:166572:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1784191934.239554:0:166572:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb ctime from disk: 1784191931 -> 1784191933 00002000:00010000:0.0:1784191934.239556:0:166572:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1784191934.239638:0:166572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+47:69112:x1870858812485760:12345-192.168.204.16@tcp:10:dd.500 Request processed in 766us (1206us total) trans 21474836593 rc 0/0 00000100:00100000:0.0:1784191934.239648:0:166572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 79 00002000:00010000:0.0:1784191934.239653:0:166572:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/642 (0->18446744073709551615) 00002000:00100000:0.0:1784191934.239657:0:166572:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af210300700 with x1870858812485760 ext(0->18446744073709551615) 00002000:00010000:0.0:1784191934.239663:0:166572:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af210300700. 00000100:00100000:0.0:1784191934.455638:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191934.455891:0:160171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812485888 00000100:00100000:1.0:1784191934.455902:0:160171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812485888 00002000:00100000:1.0:1784191934.455955:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x282:0x0] (0->4194303) req@ffff8af111a8ce00 x1870858812485888/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:105/0 lens 488/0 e 0 to 0 dl 1784191945 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:1000 00002000:00100000:1.0:1784191934.455967:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111a8ce00 with x1870858812485888 ext(0->4194303) 00002000:00010000:1.0:1784191934.455974:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111a8ce00 00000100:00100000:1.0:1784191934.456014:0:160171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 80 00000100:00100000:1.0:1784191934.456024:0:160171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+47:69110:x1870858812485888:12345-192.168.204.16@tcp:4:dd.500 00000100:00100000:0.0:1784191934.476392:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828009472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784191934.476479:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191934.476555:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828009472 00000100:00100000:0.0:1784191934.476564:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828009472 00000100:00100000:0.0:1784191934.476629:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1784191934.476639:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828009472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784191934.476663:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:0.0:1784191934.476735:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828009472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191934.476747:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1784191934.476837:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828009472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191934.479177:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828009600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784191934.479261:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191934.482622:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828009600 00000100:00100000:1.0:1784191934.482640:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828009600 00000100:00100000:3.0:1784191934.483584:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1784191934.483595:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1099fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828009600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784191934.483626:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 61469760 pending 4218880 free 69541888 avail 62373888 00000100:00100000:3.0:1784191934.483765:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1099fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828009600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (4504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191934.483772:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1784191934.499370:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828009600:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784191934.540089:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191934.560173:0:160171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+49:69110:x1870858812485888:12345-192.168.204.16@tcp:4:dd.500 Request processed in 102756us (103151us total) trans 21474836594 rc 0/0 00000100:00100000:0.0:1784191934.560199:0:160171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 80 00002000:00100000:0.0:1784191934.560217:0:160171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x282:0x0] (0->4194303) req@ffff8af111a8ce00 x1870858812485888/t21474836594(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:105/0 lens 488/448 e 0 to 0 dl 1784191945 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:1000 00002000:00100000:0.0:1784191934.560228:0:160171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111a8ce00 with x1870858812485888 ext(0->4194303) 00002000:00010000:0.0:1784191934.560235:0:160171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111a8ce00 00000100:00100000:3.0:1784191934.590852:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191934.590988:0:167417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812486016 00000100:00100000:1.0:1784191934.590998:0:167417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812486016 00002000:00100000:1.0:1784191934.591062:0:167417:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x282:0x0] (4194304->8388607) req@ffff8af111b7dc00 x1870858812486016/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:105/0 lens 488/0 e 0 to 0 dl 1784191945 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:1000 00002000:00100000:1.0:1784191934.591073:0:167417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111b7dc00 with x1870858812486016 ext(4194304->8388607) 00002000:00010000:1.0:1784191934.591079:0:167417:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111b7dc00 00000100:00100000:1.0:1784191934.591126:0:167417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 81 00000100:00100000:1.0:1784191934.591136:0:167417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+49:69109:x1870858812486016:12345-192.168.204.16@tcp:4:dd.500 00000100:00100000:0.0:1784191934.692764:0:167417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+51:69109:x1870858812486016:12345-192.168.204.16@tcp:4:dd.500 Request processed in 101606us (101901us total) trans 21474836595 rc 0/0 00000100:00100000:0.0:1784191934.692778:0:167417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 81 00002000:00100000:0.0:1784191934.692793:0:167417:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x282:0x0] (4194304->8388607) req@ffff8af111b7dc00 x1870858812486016/t21474836595(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:105/0 lens 488/448 e 0 to 0 dl 1784191945 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:1000 00002000:00100000:0.0:1784191934.692803:0:167417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111b7dc00 with x1870858812486016 ext(4194304->8388607) 00002000:00010000:0.0:1784191934.692811:0:167417:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111b7dc00 00000100:00100000:1.0:1784191934.745033:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191934.745570:0:167418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812486144 00000100:00100000:2.0:1784191934.745583:0:167418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812486144 00002000:00100000:2.0:1784191934.745799:0:167418:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x282:0x0] (8388608->12582911) req@ffff8af210300380 x1870858812486144/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:105/0 lens 488/0 e 0 to 0 dl 1784191945 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:1000 00002000:00100000:2.0:1784191934.745810:0:167418:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af210300380 with x1870858812486144 ext(8388608->12582911) 00002000:00010000:2.0:1784191934.745815:0:167418:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af210300380 00000100:00100000:2.0:1784191934.745902:0:167418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 82 00000100:00100000:2.0:1784191934.745913:0:167418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+51:69112:x1870858812486144:12345-192.168.204.16@tcp:4:dd.500 00000100:00100000:2.0:1784191934.830510:0:167418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+53:69112:x1870858812486144:12345-192.168.204.16@tcp:4:dd.500 Request processed in 84581us (85470us total) trans 21474836596 rc 0/0 00000100:00100000:2.0:1784191934.830528:0:167418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 82 00002000:00100000:2.0:1784191934.830546:0:167418:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x282:0x0] (8388608->12582911) req@ffff8af210300380 x1870858812486144/t21474836596(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:105/0 lens 488/448 e 0 to 0 dl 1784191945 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:1000 00002000:00100000:2.0:1784191934.830557:0:167418:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af210300380 with x1870858812486144 ext(8388608->12582911) 00002000:00010000:2.0:1784191934.830565:0:167418:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af210300380 00000100:00100000:0.0:1784191934.908487:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191934.909079:0:167414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812486272 00000100:00100000:2.0:1784191934.909092:0:167414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812486272 00002000:00100000:2.0:1784191934.909159:0:167414:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x282:0x0] (12582912->16777215) req@ffff8af111a8ed80 x1870858812486272/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:105/0 lens 488/0 e 0 to 0 dl 1784191945 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:1000 00002000:00100000:2.0:1784191934.909170:0:167414:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111a8ed80 with x1870858812486272 ext(12582912->16777215) 00002000:00010000:2.0:1784191934.909175:0:167414:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111a8ed80 00000100:00100000:2.0:1784191934.909212:0:167414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 83 00000100:00100000:2.0:1784191934.909222:0:167414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+53:69112:x1870858812486272:12345-192.168.204.16@tcp:4:dd.500 00000100:00100000:2.0:1784191934.980052:0:167414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+55:69112:x1870858812486272:12345-192.168.204.16@tcp:4:dd.500 Request processed in 70815us (71559us total) trans 21474836597 rc 0/0 00000100:00100000:2.0:1784191934.980092:0:167414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 83 00002000:00100000:2.0:1784191934.981537:0:167414:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x282:0x0] (12582912->16777215) req@ffff8af111a8ed80 x1870858812486272/t21474836597(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:105/0 lens 488/448 e 0 to 0 dl 1784191945 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:1000 00002000:00100000:2.0:1784191934.981556:0:167414:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111a8ed80 with x1870858812486272 ext(12582912->16777215) 00002000:00010000:2.0:1784191934.981565:0:167414:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111a8ed80 00000100:00100000:0.0:1784191935.034911:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191935.035013:0:167413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812486400 00000100:00100000:1.0:1784191935.035023:0:167413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812486400 00002000:00100000:1.0:1784191935.035072:0:167413:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x282:0x0] (16777216->20971519) req@ffff8af111a8f100 x1870858812486400/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:106/0 lens 488/0 e 0 to 0 dl 1784191946 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:1000 00002000:00100000:1.0:1784191935.035084:0:167413:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111a8f100 with x1870858812486400 ext(16777216->20971519) 00002000:00010000:1.0:1784191935.035090:0:167413:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111a8f100 00000100:00100000:1.0:1784191935.035120:0:167413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 84 00000100:00100000:1.0:1784191935.035129:0:167413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+55:69109:x1870858812486400:12345-192.168.204.16@tcp:4:dd.500 00000100:00100000:1.0:1784191935.117475:0:167413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+57:69109:x1870858812486400:12345-192.168.204.16@tcp:4:dd.500 Request processed in 82333us (82559us total) trans 21474836598 rc 0/0 00000100:00100000:1.0:1784191935.117490:0:167413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 84 00002000:00100000:1.0:1784191935.117514:0:167413:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x282:0x0] (16777216->20971519) req@ffff8af111a8f100 x1870858812486400/t21474836598(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:106/0 lens 488/448 e 0 to 0 dl 1784191946 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:1000 00002000:00100000:1.0:1784191935.117525:0:167413:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111a8f100 with x1870858812486400 ext(16777216->20971519) 00002000:00010000:1.0:1784191935.117546:0:167413:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111a8f100 00000100:00100000:0.0:1784191935.268208:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191935.271747:0:166438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812486528 00000100:00100000:2.0:1784191935.271766:0:166438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812486528 00002000:00100000:3.0:1784191935.271962:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x282:0x0] (20971520->25165823) req@ffff8af111a8e680 x1870858812486528/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:106/0 lens 488/0 e 0 to 0 dl 1784191946 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:1000 00002000:00100000:3.0:1784191935.271974:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111a8e680 with x1870858812486528 ext(20971520->25165823) 00002000:00010000:3.0:1784191935.271980:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111a8e680 00000100:00100000:3.0:1784191935.272015:0:166438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 85 00000100:00100000:3.0:1784191935.272027:0:166438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+57:69110:x1870858812486528:12345-192.168.204.16@tcp:4:dd.500 00000100:00100000:2.0:1784191935.337789:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191935.337957:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191935.337991:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191935.337994:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812486784 00000100:00100000:1.0:1784191935.338009:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812486784 00000100:00100000:2.0:1784191935.338018:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812487040 00000100:00100000:2.0:1784191935.338024:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812487040 00000100:00100000:2.0:1784191935.338093:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 215 00000100:00100000:1.0:1784191935.338098:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 404 00000100:00100000:1.0:1784191935.338110:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:69111:x1870858812486784:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191935.338119:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69110:x1870858812487040:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191935.338271:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812486656 00000100:00100000:3.0:1784191935.338276:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812486656 00000100:00100000:3.0:1784191935.338312:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 79 00000100:00100000:3.0:1784191935.338320:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1074b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69111:x1870858812486656:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191935.338610:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:69110:x1870858812487040:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 504us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191935.338620:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 215 00000100:00080000:2.0:1784191935.338645:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784191935.338649:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784191935.340762:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:69111:x1870858812486784:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 2643us (2793us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191935.340777:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 404 00000100:00100000:0.0:1784191935.341657:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191935.342046:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812486912 00000100:00100000:1.0:1784191935.342056:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812486912 00000100:00100000:1.0:1784191935.342130:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 405 00000100:00100000:1.0:1784191935.342139:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69110:x1870858812486912:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191935.342203:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69110:x1870858812486912:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 64us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191935.342211:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 405 00000100:00080000:0.0:1784191935.342283:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784191935.345112:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1074b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69111:x1870858812486656:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 6779us (7320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191935.345129:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 79 00000100:00100000:3.0:1784191935.387064:0:166438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+59:69110:x1870858812486528:12345-192.168.204.16@tcp:4:dd.500 Request processed in 115027us (118854us total) trans 21474836599 rc 0/0 00000100:00100000:3.0:1784191935.387079:0:166438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 85 00002000:00100000:3.0:1784191935.387118:0:166438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x282:0x0] (20971520->25165823) req@ffff8af111a8e680 x1870858812486528/t21474836599(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:106/0 lens 488/448 e 0 to 0 dl 1784191946 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:1000 00002000:00100000:3.0:1784191935.387129:0:166438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111a8e680 with x1870858812486528 ext(20971520->25165823) 00002000:00010000:3.0:1784191935.387136:0:166438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111a8e680 00000100:00100000:2.0:1784191935.397147:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191935.397302:0:166576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812487168 00000100:00100000:1.0:1784191935.397313:0:166576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812487168 00002000:00100000:1.0:1784191935.397363:0:166576:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x282:0x0] (25165824->29360127) req@ffff8af20cf24380 x1870858812487168/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:106/0 lens 488/0 e 0 to 0 dl 1784191946 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:1000 00002000:00100000:1.0:1784191935.397384:0:166576:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20cf24380 with x1870858812487168 ext(25165824->29360127) 00002000:00010000:1.0:1784191935.397391:0:166576:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af20cf24380 00000100:00100000:1.0:1784191935.397424:0:166576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 86 00000100:00100000:1.0:1784191935.397434:0:166576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+59:69111:x1870858812487168:12345-192.168.204.16@tcp:4:dd.500 00000100:00100000:0.0:1784191935.430143:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191935.430625:0:158669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812487424 00000100:00100000:3.0:1784191935.430636:0:158669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812487424 00000100:00100000:3.0:1784191935.430716:0:158669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 218 00000100:00100000:3.0:1784191935.430727:0:158669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+24:124581:x1870858812487424:12345-192.168.204.16@tcp:35:dd.500 00000001:00080000:3.0:1784191935.431229:0:158669:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 38654705676 00000100:00100000:3.0:1784191935.431364:0:158669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+26:124581:x1870858812487424:12345-192.168.204.16@tcp:35:dd.500 Request processed in 637us (1228us total) trans 38654705677 rc 0/0 00000100:00100000:3.0:1784191935.431839:0:158669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 218 00000020:00080000:3.0:1784191935.431847:0:158669:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784191935.469334:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191935.473975:0:166577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812487552 00000100:00100000:2.0:1784191935.473990:0:166577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812487552 00002000:00100000:2.0:1784191935.474040:0:166577:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x282:0x0] (29360128->31457279) req@ffff8af111a8d180 x1870858812487552/t0(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:106/0 lens 488/0 e 0 to 0 dl 1784191946 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:1000 00002000:00100000:2.0:1784191935.474051:0:166577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111a8d180 with x1870858812487552 ext(29360128->31457279) 00002000:00010000:2.0:1784191935.474072:0:166577:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111a8d180 00000100:00100000:2.0:1784191935.474115:0:166577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 87 00000100:00100000:2.0:1784191935.474125:0:166577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+63:69111:x1870858812487552:12345-192.168.204.16@tcp:4:dd.500 00000100:00100000:3.0:1784191935.489811:0:166576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+63:69111:x1870858812487168:12345-192.168.204.16@tcp:4:dd.500 Request processed in 92365us (92662us total) trans 21474836600 rc 0/0 00000100:00100000:3.0:1784191935.489827:0:166576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 86 00002000:00100000:3.0:1784191935.489842:0:166576:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x282:0x0] (25165824->29360127) req@ffff8af20cf24380 x1870858812487168/t21474836600(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:106/0 lens 488/448 e 0 to 0 dl 1784191946 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:1000 00002000:00100000:3.0:1784191935.489854:0:166576:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af20cf24380 with x1870858812487168 ext(25165824->29360127) 00002000:00010000:3.0:1784191935.489861:0:166576:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af20cf24380 00000100:00100000:0.0:1784191935.493576:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191935.493845:0:158652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812487680 00000100:00100000:3.0:1784191935.493855:0:158652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812487680 00000100:00100000:3.0:1784191935.493940:0:158652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 114 00000100:00100000:3.0:1784191935.493952:0:158652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+43:122640:x1870858812487680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191935.493967:0:158652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 38 locks, starting at 0 00002000:00010000:3.0:1784191935.494238:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1c5:0x0] updating lvb size from disk: 0 -> 38517 00002000:00010000:3.0:1784191935.494243:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1c5:0x0] updating lvb mtime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.494245:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1c5:0x0] updating lvb ctime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.494247:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1c5:0x0] updating lvb blocks from disk: 0 -> 80 00010000:00010000:3.0:1784191935.494278:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac115e8b/0xfeec3c2dc5a4b65a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9d4 expref: 43 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.494315:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1c4:0x0] updating lvb size from disk: 0 -> 1735 00002000:00010000:3.0:1784191935.494318:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1c4:0x0] updating lvb mtime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.494320:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1c4:0x0] updating lvb ctime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.494322:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1c4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.494331:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047a435b4/0xfeec3c2dc5a4b5a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b98e expref: 42 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.494348:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1c3:0x0] updating lvb size from disk: 0 -> 5634 00002000:00010000:3.0:1784191935.494351:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1c3:0x0] updating lvb mtime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.494353:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1c3:0x0] updating lvb ctime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.494355:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1c3:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784191935.494363:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ed6aa89/0xfeec3c2dc5a4b4ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b948 expref: 41 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.494380:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e4:0x0] updating lvb size from disk: 0 -> 429670 00002000:00010000:3.0:1784191935.494382:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e4:0x0] updating lvb mtime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.494385:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e4:0x0] updating lvb ctime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.494387:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e4:0x0] updating lvb blocks from disk: 0 -> 840 00010000:00010000:3.0:1784191935.494393:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064b52797/0xfeec3c2dc5a4cc64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c24e expref: 40 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.494425:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e3:0x0] updating lvb size from disk: 0 -> 254129 00002000:00010000:3.0:1784191935.494427:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e3:0x0] updating lvb mtime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.494429:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e3:0x0] updating lvb ctime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.494431:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e3:0x0] updating lvb blocks from disk: 0 -> 504 00010000:00010000:3.0:1784191935.494439:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000794619ed/0xfeec3c2dc5a4cbae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c208 expref: 39 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.494456:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e5:0x0] updating lvb size from disk: 0 -> 1175412 00002000:00010000:3.0:1784191935.494458:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e5:0x0] updating lvb mtime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.494460:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e5:0x0] updating lvb ctime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.494462:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e5:0x0] updating lvb blocks from disk: 0 -> 2296 00010000:00010000:3.0:1784191935.494468:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b7200e9/0xfeec3c2dc5a4cd1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1175551) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c294 expref: 38 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.494482:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e8:0x0] updating lvb size from disk: 0 -> 315403 00002000:00010000:3.0:1784191935.494484:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e8:0x0] updating lvb mtime from disk: 0 -> 1784191894 00002000:00010000:3.0:1784191935.494486:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e8:0x0] updating lvb ctime from disk: 0 -> 1784191894 00002000:00010000:3.0:1784191935.494488:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e8:0x0] updating lvb blocks from disk: 0 -> 624 00010000:00010000:3.0:1784191935.494494:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000453d8882/0xfeec3c2dc5a4cf3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c366 expref: 37 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.494507:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e7:0x0] updating lvb size from disk: 0 -> 1611 00002000:00010000:3.0:1784191935.494509:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e7:0x0] updating lvb mtime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.494511:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e7:0x0] updating lvb ctime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.494513:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e7:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.494527:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089fd668b/0xfeec3c2dc5a4ce86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c320 expref: 36 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.494544:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e6:0x0] updating lvb size from disk: 0 -> 2475 00002000:00010000:3.0:1784191935.494546:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e6:0x0] updating lvb mtime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.494548:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e6:0x0] updating lvb ctime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.494550:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e6:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.494557:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9be9514/0xfeec3c2dc5a4cdd0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2da expref: 35 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.494572:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e2:0x0] updating lvb size from disk: 0 -> 159678 00002000:00010000:3.0:1784191935.494574:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e2:0x0] updating lvb mtime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.494576:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e2:0x0] updating lvb ctime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.494578:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e2:0x0] updating lvb blocks from disk: 0 -> 312 00010000:00010000:3.0:1784191935.494584:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a9db4e1/0xfeec3c2dc5a4caf8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1c2 expref: 34 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.494602:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e1:0x0] updating lvb size from disk: 0 -> 10934 00002000:00010000:3.0:1784191935.494605:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e1:0x0] updating lvb mtime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.494607:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e1:0x0] updating lvb ctime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.494609:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e1:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:3.0:1784191935.494617:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c46a14a/0xfeec3c2dc5a4ca42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c17c expref: 33 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.494633:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e0:0x0] updating lvb size from disk: 0 -> 215293 00002000:00010000:3.0:1784191935.494635:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e0:0x0] updating lvb mtime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.494638:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e0:0x0] updating lvb ctime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.494646:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e0:0x0] updating lvb blocks from disk: 0 -> 424 00010000:00010000:3.0:1784191935.494657:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c94d6048/0xfeec3c2dc5a4c98c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c136 expref: 32 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.494675:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1df:0x0] updating lvb size from disk: 0 -> 171098 00002000:00010000:3.0:1784191935.494678:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1df:0x0] updating lvb mtime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.494680:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1df:0x0] updating lvb ctime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.494682:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1df:0x0] updating lvb blocks from disk: 0 -> 336 00010000:00010000:3.0:1784191935.495765:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0245066/0xfeec3c2dc5a4c8d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0f0 expref: 31 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.495810:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1de:0x0] updating lvb size from disk: 0 -> 116978 00002000:00010000:3.0:1784191935.495813:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1de:0x0] updating lvb mtime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.495815:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1de:0x0] updating lvb ctime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.495817:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1de:0x0] updating lvb blocks from disk: 0 -> 232 00010000:00010000:3.0:1784191935.495834:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a09c1cad/0xfeec3c2dc5a4c820 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0aa expref: 30 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.495853:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1dd:0x0] updating lvb size from disk: 0 -> 4750 00002000:00010000:3.0:1784191935.495855:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1dd:0x0] updating lvb mtime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.495857:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1dd:0x0] updating lvb ctime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.495859:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1dd:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784191935.495866:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c6d270f/0xfeec3c2dc5a4c76a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c064 expref: 29 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.495882:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1dc:0x0] updating lvb size from disk: 0 -> 1654 00002000:00010000:3.0:1784191935.495885:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1dc:0x0] updating lvb mtime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.495900:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1dc:0x0] updating lvb ctime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.495914:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1dc:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.495927:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a68f315/0xfeec3c2dc5a4c6b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c01e expref: 28 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.495949:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1db:0x0] updating lvb size from disk: 0 -> 1408 00002000:00010000:3.0:1784191935.495952:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1db:0x0] updating lvb mtime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.495954:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1db:0x0] updating lvb ctime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.495956:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1db:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.495964:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac8b255/0xfeec3c2dc5a4c5fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfd8 expref: 27 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.495980:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1da:0x0] updating lvb size from disk: 0 -> 1659 00002000:00010000:3.0:1784191935.495983:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1da:0x0] updating lvb mtime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.495985:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1da:0x0] updating lvb ctime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.495987:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1da:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.495995:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db153155/0xfeec3c2dc5a4c548 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf92 expref: 26 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496010:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1d9:0x0] updating lvb size from disk: 0 -> 423 00002000:00010000:3.0:1784191935.496013:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1d9:0x0] updating lvb mtime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.496015:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1d9:0x0] updating lvb ctime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.496017:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1d9:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.496024:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6185cba/0xfeec3c2dc5a4c492 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf4c expref: 25 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496042:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1d8:0x0] updating lvb size from disk: 0 -> 158096 00002000:00010000:3.0:1784191935.496051:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1d8:0x0] updating lvb mtime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.496053:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1d8:0x0] updating lvb ctime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.496055:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1d8:0x0] updating lvb blocks from disk: 0 -> 312 00010000:00010000:3.0:1784191935.496067:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9e67abe/0xfeec3c2dc5a4c3dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf06 expref: 24 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496085:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1d1:0x0] updating lvb size from disk: 0 -> 234 00002000:00010000:3.0:1784191935.496088:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1d1:0x0] updating lvb mtime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.496090:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1d1:0x0] updating lvb ctime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.496092:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1d1:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.496100:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a32aa829/0xfeec3c2dc5a4bee2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd1c expref: 23 pid: 162391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496120:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1d7:0x0] updating lvb size from disk: 0 -> 13879 00002000:00010000:3.0:1784191935.496122:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1d7:0x0] updating lvb mtime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.496124:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1d7:0x0] updating lvb ctime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.496126:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1d7:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:3.0:1784191935.496133:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adc4f613/0xfeec3c2dc5a4c326 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bec0 expref: 22 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496231:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1cf:0x0] updating lvb size from disk: 0 -> 55540 00002000:00010000:3.0:1784191935.496235:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1cf:0x0] updating lvb mtime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.496237:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1cf:0x0] updating lvb ctime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.496239:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1cf:0x0] updating lvb blocks from disk: 0 -> 112 00010000:00010000:3.0:1784191935.496249:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e52d9cf4/0xfeec3c2dc5a4bd76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc90 expref: 21 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496279:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1d0:0x0] updating lvb size from disk: 0 -> 6213 00002000:00010000:3.0:1784191935.496282:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1d0:0x0] updating lvb mtime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.496284:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1d0:0x0] updating lvb ctime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.496286:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1d0:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784191935.496295:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e08ed8b/0xfeec3c2dc5a4be2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcd6 expref: 20 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496310:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1d2:0x0] updating lvb size from disk: 0 -> 3079 00002000:00010000:3.0:1784191935.496312:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1d2:0x0] updating lvb mtime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.496314:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1d2:0x0] updating lvb ctime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.496316:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1d2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.496323:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8560c00/0xfeec3c2dc5a4bf98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd62 expref: 19 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496338:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1d6:0x0] updating lvb size from disk: 0 -> 111013 00002000:00010000:3.0:1784191935.496340:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1d6:0x0] updating lvb mtime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.496342:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1d6:0x0] updating lvb ctime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.496343:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1d6:0x0] updating lvb blocks from disk: 0 -> 224 00010000:00010000:3.0:1784191935.496349:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000689dcc0/0xfeec3c2dc5a4c270 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be7a expref: 18 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496362:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1ce:0x0] updating lvb size from disk: 0 -> 2192 00002000:00010000:3.0:1784191935.496364:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1ce:0x0] updating lvb mtime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.496366:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1ce:0x0] updating lvb ctime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.496368:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1ce:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.496384:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073e3f816/0xfeec3c2dc5a4bcc0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc4a expref: 17 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496399:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1d5:0x0] updating lvb size from disk: 0 -> 6430 00002000:00010000:3.0:1784191935.496401:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1d5:0x0] updating lvb mtime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.496403:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1d5:0x0] updating lvb ctime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.496406:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1d5:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784191935.496413:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff1434c0/0xfeec3c2dc5a4c1ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be34 expref: 16 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496429:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1d4:0x0] updating lvb size from disk: 0 -> 1790 00002000:00010000:3.0:1784191935.496431:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1d4:0x0] updating lvb mtime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.496433:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1d4:0x0] updating lvb ctime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.496435:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1d4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.496442:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f714d7c/0xfeec3c2dc5a4c104 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdee expref: 15 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496457:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1d3:0x0] updating lvb size from disk: 0 -> 7185 00002000:00010000:3.0:1784191935.496459:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1d3:0x0] updating lvb mtime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.496462:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1d3:0x0] updating lvb ctime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.496463:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1d3:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784191935.496471:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a25c204/0xfeec3c2dc5a4c04e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bda8 expref: 14 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496487:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1cd:0x0] updating lvb size from disk: 0 -> 4218 00002000:00010000:3.0:1784191935.496489:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1cd:0x0] updating lvb mtime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.496492:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1cd:0x0] updating lvb ctime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.496513:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1cd:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784191935.496525:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7a9a193/0xfeec3c2dc5a4bc0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc04 expref: 13 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496544:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1cc:0x0] updating lvb size from disk: 0 -> 2858 00002000:00010000:3.0:1784191935.496547:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1cc:0x0] updating lvb mtime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.496549:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1cc:0x0] updating lvb ctime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.496551:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1cc:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.496558:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2deb7eb/0xfeec3c2dc5a4bb54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbbe expref: 12 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496573:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1cb:0x0] updating lvb size from disk: 0 -> 16001 00002000:00010000:3.0:1784191935.496575:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1cb:0x0] updating lvb mtime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.496577:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1cb:0x0] updating lvb ctime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.496579:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1cb:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:3.0:1784191935.496587:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ace93dee/0xfeec3c2dc5a4ba9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb78 expref: 11 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496602:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1ca:0x0] updating lvb size from disk: 0 -> 4915 00002000:00010000:3.0:1784191935.496604:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1ca:0x0] updating lvb mtime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.496606:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1ca:0x0] updating lvb ctime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.496608:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1ca:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784191935.496615:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a5d7473/0xfeec3c2dc5a4b9e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb32 expref: 10 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496632:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1c9:0x0] updating lvb size from disk: 0 -> 704 00002000:00010000:3.0:1784191935.496634:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1c9:0x0] updating lvb mtime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.496643:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1c9:0x0] updating lvb ctime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.496645:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1c9:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.496655:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f16b6d98/0xfeec3c2dc5a4b932 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8baec expref: 9 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496674:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1c8:0x0] updating lvb size from disk: 0 -> 4207 00002000:00010000:3.0:1784191935.496676:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1c8:0x0] updating lvb mtime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.496679:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1c8:0x0] updating lvb ctime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.496681:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1c8:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784191935.496746:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098710056/0xfeec3c2dc5a4b87c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8baa6 expref: 8 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496764:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1c7:0x0] updating lvb size from disk: 0 -> 9198 00002000:00010000:3.0:1784191935.496767:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1c7:0x0] updating lvb mtime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.496769:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1c7:0x0] updating lvb ctime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.496771:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1c7:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:3.0:1784191935.496779:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002354354a/0xfeec3c2dc5a4b7c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba60 expref: 7 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.496794:0:158652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1c6:0x0] updating lvb size from disk: 0 -> 15476 00002000:00010000:3.0:1784191935.496796:0:158652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1c6:0x0] updating lvb mtime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.496798:0:158652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1c6:0x0] updating lvb ctime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.496800:0:158652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1c6:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:3.0:1784191935.496808:0:158652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003b5ef39/0xfeec3c2dc5a4b710 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba1a expref: 6 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191935.496820:0:158652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191935.497888:0:158652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:122640:x1870858812487680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3930us (4315us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191935.497911:0:158652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 114 00000100:00100000:3.0:1784191935.505351:0:166577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+63:69111:x1870858812487552:12345-192.168.204.16@tcp:4:dd.500 Request processed in 31215us (36019us total) trans 21474836601 rc 0/0 00000100:00100000:3.0:1784191935.505367:0:166577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 87 00002000:00100000:3.0:1784191935.505381:0:166577:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x282:0x0] (29360128->31457279) req@ffff8af111a8d180 x1870858812487552/t21474836601(0) o4->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:106/0 lens 488/448 e 0 to 0 dl 1784191946 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:1000 00002000:00100000:3.0:1784191935.505391:0:166577:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8af111a8d180 with x1870858812487552 ext(29360128->31457279) 00002000:00010000:3.0:1784191935.505398:0:166577:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8af111a8d180 00000100:00100000:1.0:1784191935.539923:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191935.540016:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812487808 00000100:00100000:3.0:1784191935.540028:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812487808 00000100:00100000:3.0:1784191935.540107:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 115 00000100:00100000:3.0:1784191935.540120:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22e9a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+63:122639:x1870858812487808:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784191935.540356:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 40 locks, starting at 0 00002000:00010000:3.0:1784191935.540385:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb size from disk: 0 -> 31457280 00002000:00010000:3.0:1784191935.540389:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb mtime from disk: 1784191933 -> 1784191934 00002000:00010000:3.0:1784191935.540392:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb ctime from disk: 1784191933 -> 1784191934 00002000:00010000:3.0:1784191935.540394:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb blocks from disk: 0 -> 61440 00010000:00010000:3.0:1784191935.540430:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a83f569/0xfeec3c2dc5a4d5a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c415 expref: 63 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.540470:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x249:0x0] updating lvb size from disk: 0 -> 39343 00002000:00010000:3.0:1784191935.540473:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x249:0x0] updating lvb mtime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.540475:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x249:0x0] updating lvb ctime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.540477:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x249:0x0] updating lvb blocks from disk: 0 -> 80 00010000:00010000:3.0:1784191935.540486:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d67af17a/0xfeec3c2dc5a4b6b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9f7 expref: 62 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.540534:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x247:0x0] updating lvb size from disk: 0 -> 391200 00002000:00010000:3.0:1784191935.540536:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x247:0x0] updating lvb mtime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.540538:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x247:0x0] updating lvb ctime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.540540:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x247:0x0] updating lvb blocks from disk: 0 -> 768 00010000:00010000:3.0:1784191935.540550:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f533b2f/0xfeec3c2dc5a4b549 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b96b expref: 61 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.540569:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x246:0x0] updating lvb size from disk: 0 -> 903 00002000:00010000:3.0:1784191935.540571:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x246:0x0] updating lvb mtime from disk: 0 -> 1784191888 00002000:00010000:3.0:1784191935.540573:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x246:0x0] updating lvb ctime from disk: 0 -> 1784191888 00002000:00010000:3.0:1784191935.540576:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x246:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.540584:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003af6ff5d/0xfeec3c2dc5a4b470 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b91e expref: 60 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.540605:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x26b:0x0] updating lvb size from disk: 0 -> 1765 00002000:00010000:3.0:1784191935.540608:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x26b:0x0] updating lvb mtime from disk: 0 -> 1784191894 00002000:00010000:3.0:1784191935.540610:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x26b:0x0] updating lvb ctime from disk: 0 -> 1784191894 00002000:00010000:3.0:1784191935.540612:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x26b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.540619:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9ad66f0/0xfeec3c2dc5a4cee1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c343 expref: 59 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.540636:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x26c:0x0] updating lvb size from disk: 0 -> 4512 00002000:00010000:3.0:1784191935.540638:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x26c:0x0] updating lvb mtime from disk: 0 -> 1784191894 00002000:00010000:3.0:1784191935.540640:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x26c:0x0] updating lvb ctime from disk: 0 -> 1784191894 00002000:00010000:3.0:1784191935.540642:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x26c:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784191935.540661:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000407a238a/0xfeec3c2dc5a4cf97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c389 expref: 58 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.540679:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x26a:0x0] updating lvb size from disk: 0 -> 24288 00002000:00010000:3.0:1784191935.540682:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x26a:0x0] updating lvb mtime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.540684:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x26a:0x0] updating lvb ctime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.540686:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x26a:0x0] updating lvb blocks from disk: 0 -> 48 00010000:00010000:3.0:1784191935.543123:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a57683a/0xfeec3c2dc5a4ce2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2fd expref: 57 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543186:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x269:0x0] updating lvb size from disk: 0 -> 5105 00002000:00010000:3.0:1784191935.543189:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x269:0x0] updating lvb mtime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.543192:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x269:0x0] updating lvb ctime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.543194:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x269:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784191935.543203:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fface28/0xfeec3c2dc5a4cd75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x269:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c2b7 expref: 56 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543224:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x267:0x0] updating lvb size from disk: 0 -> 42517 00002000:00010000:3.0:1784191935.543226:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x267:0x0] updating lvb mtime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.543228:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x267:0x0] updating lvb ctime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.543230:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x267:0x0] updating lvb blocks from disk: 0 -> 88 00010000:00010000:3.0:1784191935.543238:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042c4bc32/0xfeec3c2dc5a4cc09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c22b expref: 55 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543256:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x268:0x0] updating lvb size from disk: 0 -> 26716 00002000:00010000:3.0:1784191935.543258:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x268:0x0] updating lvb mtime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.543261:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x268:0x0] updating lvb ctime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.543283:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x268:0x0] updating lvb blocks from disk: 0 -> 56 00010000:00010000:3.0:1784191935.543294:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cba9fe15/0xfeec3c2dc5a4ccbf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x268:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c271 expref: 54 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543317:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x266:0x0] updating lvb size from disk: 0 -> 88087 00002000:00010000:3.0:1784191935.543319:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x266:0x0] updating lvb mtime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.543321:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x266:0x0] updating lvb ctime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.543323:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x266:0x0] updating lvb blocks from disk: 0 -> 176 00010000:00010000:3.0:1784191935.543328:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c5c492b/0xfeec3c2dc5a4cb53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c1e5 expref: 53 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543345:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x265:0x0] updating lvb size from disk: 0 -> 227516 00002000:00010000:3.0:1784191935.543348:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x265:0x0] updating lvb mtime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.543350:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x265:0x0] updating lvb ctime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.543353:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x265:0x0] updating lvb blocks from disk: 0 -> 448 00010000:00010000:3.0:1784191935.543359:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3c6a7cd/0xfeec3c2dc5a4ca9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x265:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c19f expref: 52 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543373:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x264:0x0] updating lvb size from disk: 0 -> 196401 00002000:00010000:3.0:1784191935.543375:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x264:0x0] updating lvb mtime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.543377:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x264:0x0] updating lvb ctime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.543379:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x264:0x0] updating lvb blocks from disk: 0 -> 384 00010000:00010000:3.0:1784191935.543385:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b11e744/0xfeec3c2dc5a4c9e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x264:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->196607) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c159 expref: 51 pid: 162339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543398:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x263:0x0] updating lvb size from disk: 0 -> 31711 00002000:00010000:3.0:1784191935.543400:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x263:0x0] updating lvb mtime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.543407:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x263:0x0] updating lvb ctime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.543409:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x263:0x0] updating lvb blocks from disk: 0 -> 64 00010000:00010000:3.0:1784191935.543419:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca579565/0xfeec3c2dc5a4c931 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c113 expref: 50 pid: 161232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543435:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x262:0x0] updating lvb size from disk: 0 -> 143467 00002000:00010000:3.0:1784191935.543437:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x262:0x0] updating lvb mtime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.543439:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x262:0x0] updating lvb ctime from disk: 0 -> 1784191893 00002000:00010000:3.0:1784191935.543441:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x262:0x0] updating lvb blocks from disk: 0 -> 288 00010000:00010000:3.0:1784191935.543447:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034cd9df9/0xfeec3c2dc5a4c87b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c0cd expref: 49 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543461:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x261:0x0] updating lvb size from disk: 0 -> 6821 00002000:00010000:3.0:1784191935.543464:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x261:0x0] updating lvb mtime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543466:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x261:0x0] updating lvb ctime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543468:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x261:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784191935.543474:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016b53d07/0xfeec3c2dc5a4c7c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x261:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c087 expref: 48 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543487:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x260:0x0] updating lvb size from disk: 0 -> 6548 00002000:00010000:3.0:1784191935.543489:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x260:0x0] updating lvb mtime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543491:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x260:0x0] updating lvb ctime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543493:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x260:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784191935.543499:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058b59712/0xfeec3c2dc5a4c70f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x260:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c041 expref: 47 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543512:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x25f:0x0] updating lvb size from disk: 0 -> 855 00002000:00010000:3.0:1784191935.543520:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x25f:0x0] updating lvb mtime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543522:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x25f:0x0] updating lvb ctime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543523:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x25f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.543534:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d8b7604/0xfeec3c2dc5a4c659 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bffb expref: 46 pid: 162387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543550:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x25e:0x0] updating lvb size from disk: 0 -> 1753 00002000:00010000:3.0:1784191935.543553:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x25e:0x0] updating lvb mtime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543554:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x25e:0x0] updating lvb ctime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543556:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x25e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.543562:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebbede44/0xfeec3c2dc5a4c5a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bfb5 expref: 45 pid: 160166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543575:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x25d:0x0] updating lvb size from disk: 0 -> 1342 00002000:00010000:3.0:1784191935.543577:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x25d:0x0] updating lvb mtime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543579:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x25d:0x0] updating lvb ctime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543580:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x25d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.543586:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d1638d4/0xfeec3c2dc5a4c4ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf6f expref: 44 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543599:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x25c:0x0] updating lvb size from disk: 0 -> 37842 00002000:00010000:3.0:1784191935.543602:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x25c:0x0] updating lvb mtime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543603:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x25c:0x0] updating lvb ctime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543606:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x25c:0x0] updating lvb blocks from disk: 0 -> 80 00010000:00010000:3.0:1784191935.543613:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f487fd9/0xfeec3c2dc5a4c437 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bf29 expref: 43 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543642:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x25b:0x0] updating lvb size from disk: 0 -> 2129 00002000:00010000:3.0:1784191935.543644:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x25b:0x0] updating lvb mtime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543646:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x25b:0x0] updating lvb ctime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543648:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x25b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.543657:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000307c76b1/0xfeec3c2dc5a4c381 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bee3 expref: 42 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543671:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x259:0x0] updating lvb size from disk: 0 -> 6234 00002000:00010000:3.0:1784191935.543673:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x259:0x0] updating lvb mtime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543675:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x259:0x0] updating lvb ctime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543677:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x259:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784191935.543683:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007912d3f9/0xfeec3c2dc5a4c215 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be57 expref: 41 pid: 160163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543817:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x256:0x0] updating lvb size from disk: 0 -> 4150 00002000:00010000:3.0:1784191935.543819:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x256:0x0] updating lvb mtime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.543821:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x256:0x0] updating lvb ctime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.543823:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x256:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784191935.543832:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db5cd8a5/0xfeec3c2dc5a4bff3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd85 expref: 40 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543848:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x258:0x0] updating lvb size from disk: 0 -> 1694 00002000:00010000:3.0:1784191935.543850:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x258:0x0] updating lvb mtime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543852:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x258:0x0] updating lvb ctime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543854:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x258:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.543872:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000656eaba/0xfeec3c2dc5a4c15f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x258:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be11 expref: 39 pid: 160165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543891:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x257:0x0] updating lvb size from disk: 0 -> 8441 00002000:00010000:3.0:1784191935.543893:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x257:0x0] updating lvb mtime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.543895:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x257:0x0] updating lvb ctime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.543897:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x257:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:3.0:1784191935.543904:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000664a8f24/0xfeec3c2dc5a4c0a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bdcb expref: 38 pid: 162385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543921:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x25a:0x0] updating lvb size from disk: 0 -> 35427 00002000:00010000:3.0:1784191935.543924:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x25a:0x0] updating lvb mtime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543926:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x25a:0x0] updating lvb ctime from disk: 0 -> 1784191892 00002000:00010000:3.0:1784191935.543928:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x25a:0x0] updating lvb blocks from disk: 0 -> 72 00010000:00010000:3.0:1784191935.543935:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8d574bd/0xfeec3c2dc5a4c2cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8be9d expref: 37 pid: 162398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543950:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x252:0x0] updating lvb size from disk: 0 -> 938 00002000:00010000:3.0:1784191935.543952:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x252:0x0] updating lvb mtime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.543954:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x252:0x0] updating lvb ctime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.543956:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x252:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.543962:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1b06070/0xfeec3c2dc5a4bd1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc6d expref: 36 pid: 162390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.543977:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x255:0x0] updating lvb size from disk: 0 -> 4117 00002000:00010000:3.0:1784191935.543979:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x255:0x0] updating lvb mtime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.543981:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x255:0x0] updating lvb ctime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.543990:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x255:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784191935.544001:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ccb4982/0xfeec3c2dc5a4bf3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bd3f expref: 35 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.544020:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x253:0x0] updating lvb size from disk: 0 -> 6813 00002000:00010000:3.0:1784191935.544022:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x253:0x0] updating lvb mtime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.544024:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x253:0x0] updating lvb ctime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.544027:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x253:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1784191935.544033:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7b81951/0xfeec3c2dc5a4bdd1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcb3 expref: 34 pid: 162395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.544047:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x254:0x0] updating lvb size from disk: 0 -> 269 00002000:00010000:3.0:1784191935.544049:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x254:0x0] updating lvb mtime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.544052:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x254:0x0] updating lvb ctime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.544054:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x254:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.544060:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068c48e28/0xfeec3c2dc5a4be87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x254:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bcf9 expref: 33 pid: 162394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.544076:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x251:0x0] updating lvb size from disk: 0 -> 3006 00002000:00010000:3.0:1784191935.544079:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x251:0x0] updating lvb mtime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.544081:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x251:0x0] updating lvb ctime from disk: 0 -> 1784191891 00002000:00010000:3.0:1784191935.544083:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x251:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.544090:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dd05be7/0xfeec3c2dc5a4bc65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bc27 expref: 32 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.544103:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x250:0x0] updating lvb size from disk: 0 -> 18269 00002000:00010000:3.0:1784191935.544106:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x250:0x0] updating lvb mtime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.544114:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x250:0x0] updating lvb ctime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.544116:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x250:0x0] updating lvb blocks from disk: 0 -> 40 00010000:00010000:3.0:1784191935.544127:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e62983b5/0xfeec3c2dc5a4bbaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bbe1 expref: 31 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.544145:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x24f:0x0] updating lvb size from disk: 0 -> 838 00002000:00010000:3.0:1784191935.544148:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x24f:0x0] updating lvb mtime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.544150:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x24f:0x0] updating lvb ctime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.544152:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x24f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.544159:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095cd9ea3/0xfeec3c2dc5a4baf9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb9b expref: 30 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.544173:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x24e:0x0] updating lvb size from disk: 0 -> 1613 00002000:00010000:3.0:1784191935.544175:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x24e:0x0] updating lvb mtime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.544177:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x24e:0x0] updating lvb ctime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.544179:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x24e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.544186:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008deb768f/0xfeec3c2dc5a4ba43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb55 expref: 29 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.544201:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x24d:0x0] updating lvb size from disk: 0 -> 1754 00002000:00010000:3.0:1784191935.544203:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x24d:0x0] updating lvb mtime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.544206:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x24d:0x0] updating lvb ctime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.544208:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x24d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.544215:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de80b18d/0xfeec3c2dc5a4b98d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bb0f expref: 28 pid: 162389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.544230:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x24c:0x0] updating lvb size from disk: 0 -> 28245 00002000:00010000:3.0:1784191935.544238:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x24c:0x0] updating lvb mtime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.544240:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x24c:0x0] updating lvb ctime from disk: 0 -> 1784191890 00002000:00010000:3.0:1784191935.544242:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x24c:0x0] updating lvb blocks from disk: 0 -> 56 00010000:00010000:3.0:1784191935.544253:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bff4aa4/0xfeec3c2dc5a4b8d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8bac9 expref: 27 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.544271:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x24b:0x0] updating lvb size from disk: 0 -> 2659 00002000:00010000:3.0:1784191935.544274:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x24b:0x0] updating lvb mtime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.544276:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x24b:0x0] updating lvb ctime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.544278:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x24b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.544285:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f090523/0xfeec3c2dc5a4b821 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba83 expref: 26 pid: 162392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.544299:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x24a:0x0] updating lvb size from disk: 0 -> 674 00002000:00010000:3.0:1784191935.544301:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x24a:0x0] updating lvb mtime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.544303:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x24a:0x0] updating lvb ctime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.544305:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x24a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784191935.544312:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009548de5/0xfeec3c2dc5a4b76b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8ba3d expref: 25 pid: 162396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784191935.544328:0:158651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x248:0x0] updating lvb size from disk: 0 -> 9974 00002000:00010000:3.0:1784191935.544331:0:158651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x248:0x0] updating lvb mtime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.544333:0:158651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x248:0x0] updating lvb ctime from disk: 0 -> 1784191889 00002000:00010000:3.0:1784191935.544335:0:158651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x248:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:3.0:1784191935.544342:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000502ea2c8/0xfeec3c2dc5a4b5ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8b9b1 expref: 24 pid: 162386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191935.544369:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191935.544649:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22e9a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+23:122639:x1870858812487808:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4527us (4734us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191935.544660:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 115 00010000:00010000:3.0:1784191935.564484:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784191936.529099:0:167172:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 38654705677 is committed 00000004:00080000:2.0:1784191936.529127:0:167172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:2.0:1784191936.529153:0:167172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1784191936.529340:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4d4c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191936.529354:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1784191936.529355:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4d4c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529369:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4d4c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529376:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127800 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191936.529381:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4d4c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191936.529387:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828009728:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1784191936.529392:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4d4c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529414:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ef1f051 (ffff8af1066eed00) 00010000:00010000:3.0:1784191936.529418:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191936.529423:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4d4c2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529430:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127800/0xfeec3c2dc5a4d4c2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529457:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4d532 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529463:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4d532 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191936.529485:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784191936.529488:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4d532 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529494:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233126600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191936.529497:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4d532 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529504:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4d532 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529531:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:3.0:1784191936.529534:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784191936.529538:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4d532 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529544:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233126600/0xfeec3c2dc5a4d532 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 158665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191936.529555:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828009728 00010000:00010000:3.0:1784191936.529558:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4d56a lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191936.529565:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828009728 00010000:00010000:3.0:1784191936.529566:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4d56a lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529575:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4d56a lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529581:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127c00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191936.529585:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4d56a lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529602:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4d56a lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529612:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:3.0:1784191936.529615:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1784191936.529617:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4d56a lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529623:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127c00/0xfeec3c2dc5a4d56a lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529636:0:106486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4d5a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191936.529643:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00010000:00010000:3.0:1784191936.529646:0:106486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4d5a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529653:0:106486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4d5a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191936.529657:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828009728:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1784191936.529661:0:106486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af233127000 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191936.529666:0:106486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4d5a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529672:0:106486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4d5a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529679:0:106486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:3.0:1784191936.529682:0:106486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191936.529684:0:106486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4d5a2 lrc: 2/0,0 mode: --/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191936.529757:0:106486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af233127000/0xfeec3c2dc5a4d5a2 lrc: 0/0,0 mode: --/TXN res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191936.530345:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:106501:x1870858828009728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 690us (862us total) trans 21474836602 rc 0/0 00000100:00100000:1.0:1784191936.530354:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00080000:1.0:1784191936.530382:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1784191936.530493:0:106501:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af210300e00/2, rc 0, transno 21474836602 00000100:00100000:2.0:1784191936.530514:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828009728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784191936.530804:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828009856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784191936.530852:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191936.530946:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828009856 00000100:00100000:1.0:1784191936.530951:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828009856 00000100:00100000:1.0:1784191936.530984:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1784191936.530991:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:106499:x1870858828009856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784191936.531089:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:106499:x1870858828009856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (236us total) trans 21474836603 rc 0/0 00000100:00100000:1.0:1784191936.531096:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000004:00080000:1.0:1784191936.531126:0:106499:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8af210302680/2, rc 0, transno 21474836603 00000100:00100000:1.0:1784191936.531131:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828009856:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1784191936.589284:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784191937.557488:0:160160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836603 is committed 00000001:00080000:2.0:1784191937.557510:0:160160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836601 is committed 00010000:00010000:1.0:1784191937.618195:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784191938.114663:0:168006:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 5558293970372ns, next at 5555183555375ns, rc = 0 00080000:00080000:2.0:1784191938.114908:0:168006:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1784191938.115024:0:168006:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 5558294334142ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784191938.115032:0:168006:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1784191938.115129:0:168006:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 5558294436336ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784191938.115143:0:168006:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1784191938.115207:0:168006:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 5558294517799ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784191938.115213:0:168006:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1784191938.119525:0:167172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:3.0:1784191938.119821:0:165481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 4 committed 00000004:00080000:3.0:1784191938.119844:0:165481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 4 committed 00000004:00080000:1.0:1784191938.119937:0:167172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:2.0:1784191938.572647:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784191938.572686:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828009984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784191938.572774:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191938.572974:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828009984 00000100:00100000:0.0:1784191938.572994:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828009984 00000100:00100000:0.0:1784191938.573043:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:0.0:1784191938.573052:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828009984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784191938.573088:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:0.0:1784191938.573138:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828009984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191938.573144:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:2.0:1784191938.573497:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828009984:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784191938.635930:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191939.083988:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858828010240:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.084064:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191939.084115:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828010752:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.084140:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191939.084163:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828011264:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.084187:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191939.084211:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1784191939.084217:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828010112:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.084248:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191939.084270:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858828010624:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.084291:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191939.084308:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858828011136:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.084330:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191939.084348:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828011648:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.084366:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191939.084392:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858828010368:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.084415:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191939.084432:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828010880:0@lo:400:kworker.0 00000100:00100000:2.0:1784191939.084793:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784191939.084804:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828011776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784191939.084840:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191939.084934:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828011776 00000100:00100000:0.0:1784191939.084942:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828011776 00000100:00100000:0.0:1784191939.085006:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1784191939.085015:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828011776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784191939.085049:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 29815872 pending 0 free 38084608 avail 30916608 00000100:00100000:0.0:1784191939.085099:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828011776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191939.085106:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:0.0:1784191939.085141:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191939.085191:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828011776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784191939.085704:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191939.085736:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828011392:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.085768:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191939.085790:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784191939.085796:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858828010496:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.085820:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191939.085832:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828011008:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.085853:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191939.085872:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828011520:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.085895:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191939.085942:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828010240 00000100:00100000:3.0:1784191939.085948:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828010240 00000100:00100000:3.0:1784191939.085982:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828010624 00000100:00100000:3.0:1784191939.085986:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828010624 00000100:00100000:3.0:1784191939.086000:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828011136 00000100:00100000:3.0:1784191939.086003:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828011136 00000100:00100000:3.0:1784191939.086015:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828011648 00000100:00100000:3.0:1784191939.086018:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828011648 00000100:00100000:3.0:1784191939.086027:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828010368 00000100:00100000:3.0:1784191939.086030:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828010368 00000100:00100000:3.0:1784191939.086043:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828010496 00000100:00100000:3.0:1784191939.086046:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828010496 00000100:00100000:3.0:1784191939.086062:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1784191939.086069:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858828010240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.086112:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858828010240:12345-0@lo:400:kworker.0 Request processed in 43us (2049us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191939.086119:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1784191939.086134:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1784191939.086153:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858828010624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.086185:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858828010624:12345-0@lo:400:kworker.0 Request processed in 33us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191939.086191:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1784191939.086204:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1784191939.086210:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858828011136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.086237:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858828011136:12345-0@lo:400:kworker.0 Request processed in 27us (1906us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191939.086243:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1784191939.086255:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1784191939.086260:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828011648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.086286:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828011648:12345-0@lo:400:kworker.0 Request processed in 27us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191939.086292:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1784191939.086303:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1784191939.086309:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858828010368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.086342:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858828010368:12345-0@lo:400:kworker.0 Request processed in 34us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191939.086349:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1784191939.086360:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1784191939.086366:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858828010496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.086392:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858828010496:12345-0@lo:400:kworker.0 Request processed in 26us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191939.086398:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1784191939.086420:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828010752 00000100:00100000:3.0:1784191939.086430:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828010752 00000100:00100000:3.0:1784191939.086458:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828011264 00000100:00100000:3.0:1784191939.086462:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828011264 00000100:00100000:3.0:1784191939.086498:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1784191939.086504:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828010752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.086538:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828010752:12345-0@lo:400:kworker.0 Request processed in 35us (2398us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191939.086544:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1784191939.086556:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1784191939.086562:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828011264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.086588:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828011264:12345-0@lo:400:kworker.0 Request processed in 26us (2400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191939.086594:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1784191939.086618:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828010112 00000100:00100000:3.0:1784191939.086621:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828010112 00000100:00100000:3.0:1784191939.086645:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784191939.086651:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1074b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828010112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.086720:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1074b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828010112:12345-0@lo:400:kworker.0 Request processed in 69us (2471us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191939.086726:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784191939.086774:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828010880 00000100:00100000:3.0:1784191939.086779:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828010880 00000100:00100000:3.0:1784191939.086804:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828011392 00000100:00100000:3.0:1784191939.086807:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828011392 00000100:00100000:3.0:1784191939.086824:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828011008 00000100:00100000:3.0:1784191939.086827:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828011008 00000100:00100000:3.0:1784191939.086839:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828011520 00000100:00100000:3.0:1784191939.086842:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828011520 00000100:00100000:3.0:1784191939.086858:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1784191939.086871:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828010880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.086902:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828010880:12345-0@lo:400:kworker.0 Request processed in 32us (2432us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191939.086908:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1784191939.086920:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1784191939.086925:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828011392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.086953:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828011392:12345-0@lo:400:kworker.0 Request processed in 27us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191939.086958:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1784191939.086968:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1784191939.086974:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828011008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.087001:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828011008:12345-0@lo:400:kworker.0 Request processed in 28us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191939.087007:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1784191939.087017:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1784191939.087022:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828011520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.087048:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828011520:12345-0@lo:400:kworker.0 Request processed in 26us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191939.087054:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:3.0:1784191939.087095:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784191939.087099:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784191939.087102:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784191939.087104:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784191939.087132:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858828010496:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.087142:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828011008:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.087163:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828011520:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.087174:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858828010368:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.087183:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828010880:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.087191:0:106499:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836603 gen 2 00000004:00080000:3.0:1784191939.087196:0:106499:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af210300e00, transno 21474836602 00000004:00080000:3.0:1784191939.087206:0:106499:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8af210302680, transno 21474836603 00000100:00100000:3.0:1784191939.087210:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828011392:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.087403:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828010112:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.087416:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858828010624:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.087425:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858828011136:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.087435:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828011648:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.087444:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858828010240:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.087454:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828010752:0@lo:400:kworker.0 00000100:00100000:3.0:1784191939.087462:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828011264:0@lo:400:kworker.0 00000100:00100000:0.0:1784191939.089490:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784191939.089510:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828011904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191939.089573:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191939.089617:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828011904 00000100:00100000:0.0:1784191939.089624:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828011904 00000100:00100000:0.0:1784191939.089680:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1784191939.089704:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828011904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784191939.089736:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:0.0:1784191939.089776:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828011904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191939.089790:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1784191939.089830:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828011904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191939.092837:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784191939.092860:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828012032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784191939.092929:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191939.092974:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828012032 00000100:00100000:2.0:1784191939.092980:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828012032 00000100:00100000:2.0:1784191939.093027:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1784191939.093034:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828012032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784191939.093066:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:2.0:1784191939.093114:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828012032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191939.093121:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1784191939.093174:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828012032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784191939.596826:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784191939.596853:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828012160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784191939.596928:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191939.597292:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828012160 00000100:00100000:1.0:1784191939.597301:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828012160 00000100:00100000:1.0:1784191939.597356:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1784191939.597380:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828012160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784191939.597405:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 29815872 pending 0 free 38084608 avail 30916608 00000100:00100000:1.0:1784191939.597462:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828012160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191939.597470:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1784191939.597585:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828012160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784191939.598199:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828012288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191939.598240:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191939.598342:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828012288 00000100:00100000:2.0:1784191939.598348:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828012288 00000100:00100000:2.0:1784191939.598385:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1784191939.598392:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210302680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828012288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784191939.598409:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:2.0:1784191939.598948:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210302680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828012288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 556us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191939.598966:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1784191939.599022:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828012288:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784191939.660090:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191940.439582:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191940.439712:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812488064 00000100:00100000:3.0:1784191940.439724:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812488064 00000100:00100000:3.0:1784191940.439834:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 412 00000100:00100000:3.0:1784191940.439846:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69109:x1870858812488064:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191940.439954:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69109:x1870858812488064:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 109us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191940.439962:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 412 00000100:00080000:0.0:1784191940.440114:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784191940.442142:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191940.442235:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191940.442275:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191940.442296:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191940.442329:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812488320 00000100:00100000:1.0:1784191940.442337:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812488320 00000100:00100000:1.0:1784191940.442391:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812488448 00000100:00100000:1.0:1784191940.442394:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812488448 00000100:00100000:1.0:1784191940.442432:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 220 00000100:00100000:1.0:1784191940.442442:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812488320:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191940.442508:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812488192 00000100:00100000:0.0:1784191940.442514:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812488192 00000100:00100000:1.0:1784191940.442524:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812488320:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 83us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191940.442534:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 220 00000100:00100000:1.0:1784191940.442560:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 221 00000100:00100000:0.0:1784191940.442560:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 413 00000100:00100000:0.0:1784191940.442573:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812488192:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191940.442588:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69109:x1870858812488448:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191940.442612:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812488192:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 41us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191940.442620:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 413 00000100:00100000:1.0:1784191940.442626:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69109:x1870858812488448:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 39us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191940.442634:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 221 00000100:00080000:0.0:1784191940.442661:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784191940.442667:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784191940.442670:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784191940.443309:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812487936 00000100:00100000:3.0:1784191940.443317:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812487936 00000100:00100000:3.0:1784191940.443365:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 81 00000100:00100000:3.0:1784191940.443372:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812487936:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191940.443434:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812487936:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 61us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191940.443442:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 81 00010000:00010000:3.0:1784191940.683899:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191941.708002:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191942.733238:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191943.692027:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784191943.692058:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828012416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784191943.692149:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191943.692373:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828012416 00000100:00100000:3.0:1784191943.692381:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828012416 00000100:00100000:3.0:1784191943.692438:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:3.0:1784191943.692448:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828012416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784191943.692484:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:3.0:1784191943.692553:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828012416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191943.692560:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00100000:0.0:1784191943.692659:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828012416:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784191943.756618:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191944.204541:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784191944.204566:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828012544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191944.204653:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191944.204744:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828012544 00000100:00100000:0.0:1784191944.204752:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828012544 00000100:00100000:0.0:1784191944.204802:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:0.0:1784191944.204810:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828012544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784191944.204847:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:0.0:1784191944.204907:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828012544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191944.204914:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:0.0:1784191944.204963:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828012544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784191944.205356:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858828012672:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.205395:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191944.205430:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858828013184:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.205459:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191944.205498:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828013696:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.205520:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191944.205538:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784191944.205544:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858828012800:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.205576:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191944.205594:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828013312:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.205617:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191944.205633:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828013824:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.205654:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191944.205682:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828013184 00000100:00100000:3.0:1784191944.205686:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828013184 00000100:00100000:3.0:1784191944.205741:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828012800 00000100:00100000:3.0:1784191944.205745:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828012800 00000100:00100000:3.0:1784191944.205761:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1784191944.205769:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858828013184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.205812:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858828013184:12345-0@lo:400:kworker.0 Request processed in 45us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191944.205819:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1784191944.205833:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1784191944.205840:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858828012800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.205867:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858828012800:12345-0@lo:400:kworker.0 Request processed in 29us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191944.205882:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1784191944.205903:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858828013056:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.205928:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191944.205945:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858828013568:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.205964:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191944.205978:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:106500:1870858828014080:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.205998:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191944.206014:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784191944.206020:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858828012928:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.206041:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191944.206051:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828013440:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.206069:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191944.206083:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828013952:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.206102:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191944.206128:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828013056 00000100:00100000:3.0:1784191944.206132:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828013056 00000100:00100000:3.0:1784191944.206151:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828013568 00000100:00100000:3.0:1784191944.206153:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828013568 00000100:00100000:3.0:1784191944.206163:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828014080 00000100:00100000:3.0:1784191944.206165:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828014080 00000100:00100000:3.0:1784191944.206175:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828012928 00000100:00100000:3.0:1784191944.206178:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828012928 00000100:00100000:3.0:1784191944.206190:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1784191944.206195:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858828013056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.206230:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858828013056:12345-0@lo:400:kworker.0 Request processed in 34us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191944.206245:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1784191944.206259:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1784191944.206265:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858828013568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.206295:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858828013568:12345-0@lo:400:kworker.0 Request processed in 30us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191944.206300:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1784191944.206311:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1784191944.206316:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106500:x1870858828014080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.206341:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106500:x1870858828014080:12345-0@lo:400:kworker.0 Request processed in 25us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191944.206346:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1784191944.206358:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1784191944.206363:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858828012928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.206388:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858828012928:12345-0@lo:400:kworker.0 Request processed in 26us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191944.206394:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1784191944.206412:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828013312 00000100:00100000:3.0:1784191944.206416:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828013312 00000100:00100000:3.0:1784191944.206441:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828013824 00000100:00100000:3.0:1784191944.206444:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828013824 00000100:00100000:3.0:1784191944.206460:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828013440 00000100:00100000:3.0:1784191944.206462:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828013440 00000100:00100000:3.0:1784191944.206476:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828013952 00000100:00100000:3.0:1784191944.206479:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828013952 00000100:00100000:3.0:1784191944.206494:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1784191944.206500:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828013312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.206541:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828013312:12345-0@lo:400:kworker.0 Request processed in 41us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191944.206547:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1784191944.206559:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1784191944.206565:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828013824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.206603:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828013824:12345-0@lo:400:kworker.0 Request processed in 38us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191944.206608:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1784191944.206619:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1784191944.206625:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828013440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.206652:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828013440:12345-0@lo:400:kworker.0 Request processed in 28us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191944.206658:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1784191944.206669:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1784191944.206674:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828013952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.206727:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828013952:12345-0@lo:400:kworker.0 Request processed in 53us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191944.206733:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1784191944.206788:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858828012928:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.206798:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828013440:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.206807:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828013952:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.206815:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858828013056:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.206824:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858828013568:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.206844:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:106500:1870858828014080:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.206883:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828013696 00000100:00100000:3.0:1784191944.206887:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828013696 00000100:00100000:3.0:1784191944.206911:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:3.0:1784191944.206917:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828013696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.206951:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828013696:12345-0@lo:400:kworker.0 Request processed in 34us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191944.206956:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:3.0:1784191944.206981:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858828012800:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.206991:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828013312:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.207000:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828013824:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.207009:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858828013184:0@lo:400:kworker.0 00000100:00100000:3.0:1784191944.207018:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828013696:0@lo:400:kworker.0 00000100:00100000:1.0:1784191944.207265:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828012672 00000100:00100000:1.0:1784191944.207270:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828012672 00000100:00100000:1.0:1784191944.207315:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784191944.207322:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858828012672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191944.207365:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858828012672:12345-0@lo:400:kworker.0 Request processed in 43us (1969us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191944.207371:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784191944.207421:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858828012672:0@lo:400:kworker.0 00000100:00100000:2.0:1784191944.207789:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784191944.207800:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828014208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784191944.207835:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191944.207865:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828014208 00000100:00100000:2.0:1784191944.207869:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828014208 00000100:00100000:2.0:1784191944.207899:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1784191944.207905:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828014208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784191944.207929:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 29815872 pending 0 free 38084608 avail 30916608 00000100:00100000:2.0:1784191944.207962:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828014208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191944.207969:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1784191944.208001:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828014208:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784191944.208086:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784191944.208091:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784191944.208094:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784191944.208096:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784191944.208186:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784191944.208194:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828014336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191944.208220:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191944.208288:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828014336 00000100:00100000:0.0:1784191944.208292:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828014336 00000100:00100000:0.0:1784191944.208327:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1784191944.208335:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828014336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784191944.208351:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:0.0:1784191944.208386:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828014336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191944.208393:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1784191944.208461:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828014336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784191944.715914:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784191944.715939:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828014464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784191944.716028:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191944.716908:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828014592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191944.716951:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191944.717353:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828014464 00000100:00100000:1.0:1784191944.717362:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828014464 00000100:00100000:1.0:1784191944.717412:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828014592 00000100:00100000:1.0:1784191944.717416:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828014592 00000100:00100000:1.0:1784191944.717432:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1784191944.717441:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828014464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784191944.717465:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 29815872 pending 0 free 38084608 avail 30916608 00000100:00100000:1.0:1784191944.717529:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828014464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191944.717537:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1784191944.717555:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1784191944.717571:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828014592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784191944.717582:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784191944.717611:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828014592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191944.717633:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1784191944.717676:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828014592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784191944.717725:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828014464:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784191944.783713:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191945.557964:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191945.558197:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191945.558238:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191945.558257:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191945.558276:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191945.558305:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812489088 00000100:00100000:2.0:1784191945.558315:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812489088 00000100:00100000:3.0:1784191945.558368:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812488832 00000100:00100000:3.0:1784191945.558376:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812488832 00000100:00100000:2.0:1784191945.558376:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812488960 00000100:00100000:2.0:1784191945.558382:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812488960 00000100:00100000:2.0:1784191945.558418:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 226 00000100:00100000:2.0:1784191945.558430:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812489088:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191945.558431:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812488704 00000100:00100000:3.0:1784191945.558437:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812488704 00000100:00100000:3.0:1784191945.558473:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 420 00000100:00100000:3.0:1784191945.558492:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812488832:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191945.558601:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812489088:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 173us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191945.558615:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 226 00000100:00100000:2.0:1784191945.558633:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 227 00000100:00100000:2.0:1784191945.558641:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812488960:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191945.558671:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812488960:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 31us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191945.558677:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 227 00000100:00080000:2.0:1784191945.558716:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784191945.558721:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784191945.558724:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784191945.558726:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784191945.559155:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812488832:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 663us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191945.559163:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 420 00000100:00100000:3.0:1784191945.559179:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 421 00000100:00100000:3.0:1784191945.559187:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812488704:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191945.559213:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812488704:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 28us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191945.559219:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 421 00000100:00100000:3.0:1784191945.559237:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812488576 00000100:00100000:3.0:1784191945.559241:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812488576 00000100:00100000:3.0:1784191945.559272:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 83 00000100:00100000:3.0:1784191945.559279:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812488576:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191945.559302:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812488576:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 24us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191945.559307:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 83 00010000:00010000:1.0:1784191945.818089:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191946.827893:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784191947.146014:0:168151:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 5567325316300ns, next at 5555183555375ns, rc = 0 00080000:00080000:3.0:1784191947.146115:0:168151:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1784191947.146722:0:168151:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 5567326031161ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784191947.146732:0:168151:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1784191947.146852:0:168151:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 5567326161720ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784191947.146859:0:168151:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1784191947.146932:0:168151:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 5567326242393ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784191947.146938:0:168151:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1784191947.157130:0:165481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 5 committed 00000004:00080000:2.0:1784191947.157157:0:165481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 5 committed 00000004:00080000:1.0:1784191947.157212:0:167172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:1.0:1784191947.159824:0:167172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:3.0:1784191947.852746:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191948.815004:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828014720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784191948.815120:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191948.815279:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828014720 00000100:00100000:1.0:1784191948.815292:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828014720 00000100:00100000:1.0:1784191948.815368:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:1.0:1784191948.815381:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828014720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784191948.816600:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:1.0:1784191948.816761:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828014720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1380us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191948.816773:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:0.0:1784191948.816847:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828014720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784191948.822770:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191948.823834:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812489216 00000100:00100000:3.0:1784191948.823849:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812489216 00000100:00100000:3.0:1784191948.824023:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 806 00000100:00100000:3.0:1784191948.824038:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:124969:x1870858812489216:12345-192.168.204.16@tcp:48:lfs.0 00000100:00080000:0.0:1784191948.830359:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784191948.838497:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:124969:x1870858812489216:12345-192.168.204.16@tcp:48:lfs.0 Request processed in 14429us (15717us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191948.838513:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 806 00000100:00100000:3.0:1784191948.842292:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191948.842395:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812489344 00000100:00100000:0.0:1784191948.842406:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812489344 00000100:00080000:2.0:1784191948.842471:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191948.842535:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 429 00000100:00100000:0.0:1784191948.842547:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:124969:x1870858812489344:12345-192.168.204.16@tcp:19:lfs.0 00000100:00100000:0.0:1784191948.844307:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:124969:x1870858812489344:12345-192.168.204.16@tcp:19:lfs.0 Request processed in 1755us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191948.844320:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 429 00000100:00100000:3.0:1784191948.849312:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191948.849555:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812489472 00000100:00100000:1.0:1784191948.849566:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812489472 00000100:00100000:1.0:1784191948.849644:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 430 00000100:00100000:1.0:1784191948.849655:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1051f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:124969:x1870858812489472:12345-192.168.204.16@tcp:19:lfs.0 00000100:00080000:2.0:1784191948.849994:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784191948.850632:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1051f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:124969:x1870858812489472:12345-192.168.204.16@tcp:19:lfs.0 Request processed in 975us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191948.850641:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 430 00000100:00100000:3.0:1784191948.856265:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191948.856308:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812489600 00000100:00100000:3.0:1784191948.856318:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812489600 00000100:00100000:3.0:1784191948.856432:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 807 00000100:00100000:3.0:1784191948.856446:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:124969:x1870858812489600:12345-192.168.204.16@tcp:48:lfs.0 00000100:00100000:1.0:1784191948.859934:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:124969:x1870858812489600:12345-192.168.204.16@tcp:48:lfs.0 Request processed in 3478us (3666us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191948.859951:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 807 00000100:00100000:3.0:1784191948.864774:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191948.864915:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812489728 00000100:00100000:1.0:1784191948.864935:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812489728 00000100:00100000:1.0:1784191948.865002:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 808 00000100:00080000:2.0:1784191948.865015:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784191948.865015:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:124969:x1870858812489728:12345-192.168.204.16@tcp:48:lfs.0 00000100:00100000:0.0:1784191948.867236:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:124969:x1870858812489728:12345-192.168.204.16@tcp:48:lfs.0 Request processed in 2215us (2463us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191948.867250:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 808 00010000:00010000:3.0:1784191948.878863:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191948.904490:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191948.906069:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812489856 00000100:00100000:0.0:1784191948.906083:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812489856 00000100:00100000:0.0:1784191948.906161:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 809 00000100:00100000:0.0:1784191948.906172:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:124971:x1870858812489856:12345-192.168.204.16@tcp:48:lfs.0 00000100:00100000:0.0:1784191948.906269:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:124971:x1870858812489856:12345-192.168.204.16@tcp:48:lfs.0 Request processed in 99us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191948.906277:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 809 00000100:00100000:0.0:1784191948.913720:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191948.913854:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812489984 00000100:00100000:2.0:1784191948.913865:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812489984 00000100:00100000:2.0:1784191948.913932:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 431 00000100:00100000:2.0:1784191948.913943:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:124971:x1870858812489984:12345-192.168.204.16@tcp:19:lfs.0 00000100:00100000:2.0:1784191948.914087:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:124971:x1870858812489984:12345-192.168.204.16@tcp:19:lfs.0 Request processed in 146us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191948.914095:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 431 00000100:00100000:2.0:1784191948.926739:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191948.928825:0:162390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812490112 00000100:00100000:1.0:1784191948.928838:0:162390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812490112 00000100:00100000:1.0:1784191948.928907:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 432 00000100:00100000:1.0:1784191948.928917:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:124971:x1870858812490112:12345-192.168.204.16@tcp:19:lfs.0 00000100:00100000:1.0:1784191948.929114:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:124971:x1870858812490112:12345-192.168.204.16@tcp:19:lfs.0 Request processed in 197us (2386us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191948.929122:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 432 00000100:00100000:0.0:1784191948.937834:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191948.937873:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812490240 00000100:00100000:0.0:1784191948.937882:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812490240 00000100:00100000:0.0:1784191948.938759:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 810 00000100:00100000:0.0:1784191948.938775:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:124971:x1870858812490240:12345-192.168.204.16@tcp:48:lfs.0 00000100:00100000:0.0:1784191948.938926:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:124971:x1870858812490240:12345-192.168.204.16@tcp:48:lfs.0 Request processed in 156us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191948.938998:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 810 00000100:00100000:1.0:1784191948.954178:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191948.954230:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812490368 00000100:00100000:1.0:1784191948.954239:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812490368 00000100:00100000:1.0:1784191948.954290:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 811 00000100:00100000:1.0:1784191948.954299:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:124971:x1870858812490368:12345-192.168.204.16@tcp:48:lfs.0 00000100:00100000:1.0:1784191948.954508:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:124971:x1870858812490368:12345-192.168.204.16@tcp:48:lfs.0 Request processed in 209us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191948.954516:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 811 00000100:00100000:2.0:1784191949.324324:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828014848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191949.324982:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191949.325668:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828014848 00000100:00100000:0.0:1784191949.325679:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828014848 00000100:00100000:0.0:1784191949.325889:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:0.0:1784191949.325902:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828014848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784191949.325941:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:0.0:1784191949.326008:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828014848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191949.326015:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:3.0:1784191949.326495:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858828014976:0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.326543:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191949.326575:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858828015488:0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.326599:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191949.326619:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828016000:0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.326640:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191949.326672:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828016512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784191949.326736:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191949.326760:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784191949.326766:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858828015104:0@lo:400:kworker.0 00000100:00100000:2.0:1784191949.327112:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828014976 00000100:00100000:2.0:1784191949.327117:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828014976 00000100:00100000:2.0:1784191949.327165:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784191949.327175:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858828014976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191949.327221:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858828014976:12345-0@lo:400:kworker.0 Request processed in 48us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191949.327228:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784191949.327288:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828015360:0@lo:400:kworker.0 00000100:00100000:2.0:1784191949.327314:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191949.327338:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858828015872:0@lo:400:kworker.0 00000100:00100000:2.0:1784191949.327359:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191949.327375:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828016384:0@lo:400:kworker.0 00000100:00100000:2.0:1784191949.327395:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191949.327436:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828014848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191949.327454:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784191949.327460:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828015232:0@lo:400:kworker.0 00000100:00100000:2.0:1784191949.327494:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191949.327740:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828016000 00000100:00100000:1.0:1784191949.327745:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828016000 00000100:00100000:1.0:1784191949.328337:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:1.0:1784191949.328348:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828016000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191949.328406:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828016000:12345-0@lo:400:kworker.0 Request processed in 61us (1764us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191949.328413:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:1.0:1784191949.328462:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828016640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191949.328520:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191949.328587:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828016512 00000100:00100000:1.0:1784191949.328591:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828016512 00000100:00100000:1.0:1784191949.328629:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828016640 00000100:00100000:1.0:1784191949.328632:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828016640 00000100:00100000:1.0:1784191949.328666:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1784191949.328673:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828016512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784191949.328737:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 29815872 pending 0 free 38084608 avail 30916608 00000100:00100000:1.0:1784191949.328773:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828016512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (2036us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191949.329001:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1784191949.329010:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828016640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784191949.329028:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:0.0:1784191949.329066:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828016640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191949.329072:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1784191949.329131:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828016640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191949.329184:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1784191949.329279:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828015744:0@lo:400:kworker.0 00000100:00100000:2.0:1784191949.329308:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191949.329328:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828016256:0@lo:400:kworker.0 00000100:00100000:2.0:1784191949.329348:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784191949.329374:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784191949.329378:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784191949.330288:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828015488 00000100:00100000:3.0:1784191949.330297:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828015488 00000100:00100000:3.0:1784191949.330337:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828015360 00000100:00100000:3.0:1784191949.330351:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828015360 00000100:00100000:3.0:1784191949.330369:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828015872 00000100:00100000:3.0:1784191949.330372:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828015872 00000100:00100000:3.0:1784191949.330383:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828016384 00000100:00100000:3.0:1784191949.330386:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828016384 00000100:00100000:3.0:1784191949.330396:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828015232 00000100:00100000:3.0:1784191949.330398:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828015232 00000100:00100000:3.0:1784191949.330415:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1784191949.330421:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858828015488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.330500:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858828015488:12345-0@lo:400:kworker.0 Request processed in 79us (3899us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191949.330506:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1784191949.330521:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1784191949.330527:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828015360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.330562:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828015360:12345-0@lo:400:kworker.0 Request processed in 36us (3247us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191949.330569:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1784191949.330582:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1784191949.330588:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858828015872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.330617:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858828015872:12345-0@lo:400:kworker.0 Request processed in 30us (3257us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191949.330623:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1784191949.330633:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1784191949.330639:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828016384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.330676:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828016384:12345-0@lo:400:kworker.0 Request processed in 37us (3280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191949.330682:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1784191949.330723:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1784191949.330743:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828015232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.330785:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828015232:12345-0@lo:400:kworker.0 Request processed in 36us (3283us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191949.330792:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1784191949.330816:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828015744 00000100:00100000:3.0:1784191949.330820:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828015744 00000100:00100000:3.0:1784191949.330845:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828016256 00000100:00100000:3.0:1784191949.330849:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828016256 00000100:00100000:3.0:1784191949.330873:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784191949.330879:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828015744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.330913:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828015744:12345-0@lo:400:kworker.0 Request processed in 35us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191949.330919:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784191949.330930:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1784191949.330935:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828016256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.330964:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828016256:12345-0@lo:400:kworker.0 Request processed in 29us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191949.330970:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:3.0:1784191949.330985:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784191949.330990:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784191949.330992:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191949.331007:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191949.331034:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828015616:0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.331060:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191949.331077:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828016128:0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.331096:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191949.331134:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858828014976:0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.331149:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858828015488:0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.331162:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828016000:0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.331181:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828016512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784191949.331215:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828015104 00000100:00100000:3.0:1784191949.331218:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828015104 00000100:00100000:3.0:1784191949.331242:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1784191949.331248:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858828015104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.331282:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858828015104:12345-0@lo:400:kworker.0 Request processed in 34us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191949.331288:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00080000:3.0:1784191949.331301:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784191949.331317:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858828015104:0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.331433:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828015616 00000100:00100000:3.0:1784191949.331437:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828015616 00000100:00100000:3.0:1784191949.331460:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828016128 00000100:00100000:3.0:1784191949.331463:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828016128 00000100:00100000:3.0:1784191949.331513:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1784191949.331519:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828015616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.331555:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828015616:12345-0@lo:400:kworker.0 Request processed in 36us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191949.331560:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1784191949.331571:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1784191949.331577:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828016128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.331602:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828016128:12345-0@lo:400:kworker.0 Request processed in 26us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191949.331615:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:3.0:1784191949.331638:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784191949.331656:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828015616:0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.331665:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828016128:0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.331725:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828015232:0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.331735:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828015744:0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.331744:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828016256:0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.331756:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828015360:0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.331767:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858828015872:0@lo:400:kworker.0 00000100:00100000:3.0:1784191949.331776:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828016384:0@lo:400:kworker.0 00000100:00100000:1.0:1784191949.835860:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828016896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784191949.835953:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191949.835999:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828016768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784191949.836022:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191949.836539:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828016896 00000100:00100000:0.0:1784191949.836548:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828016896 00000100:00100000:0.0:1784191949.836597:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828016768 00000100:00100000:0.0:1784191949.836601:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828016768 00000100:00100000:0.0:1784191949.836615:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1784191949.836624:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828016896:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784191949.836640:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1784191949.836652:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828016768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784191949.836674:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784191949.836752:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828016768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191949.836760:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1784191949.836807:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828016768:0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784191949.836890:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 29815872 pending 0 free 38084608 avail 30916608 00000100:00100000:0.0:1784191949.837113:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828016896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 489us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191949.837120:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1784191949.837319:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828016896:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784191949.900210:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191950.678681:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191950.678854:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812490624 00000100:00100000:1.0:1784191950.678863:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812490624 00000100:00100000:1.0:1784191950.678949:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 428 00000100:00100000:1.0:1784191950.678959:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812490624:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191950.679061:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812490624:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 102us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191950.679069:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 428 00000100:00080000:3.0:1784191950.679244:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784191950.684587:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191950.684643:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191950.684667:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191950.684706:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191950.684745:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812490496 00000100:00100000:3.0:1784191950.684756:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812490496 00000100:00100000:3.0:1784191950.684803:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 85 00000100:00100000:3.0:1784191950.684814:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69111:x1870858812490496:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191950.684887:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69111:x1870858812490496:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 75us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191950.684913:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 85 00000100:00100000:3.0:1784191950.684948:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812491008 00000100:00100000:3.0:1784191950.684952:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812491008 00000100:00100000:3.0:1784191950.684985:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812490880 00000100:00100000:3.0:1784191950.684987:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812490880 00000100:00100000:3.0:1784191950.685015:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 232 00000100:00100000:3.0:1784191950.685022:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812491008:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191950.685052:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812491008:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 30us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191950.685059:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 232 00000100:00100000:3.0:1784191950.685071:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 233 00000100:00100000:3.0:1784191950.685078:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812490880:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191950.685102:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812490880:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 25us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191950.685108:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 233 00000100:00080000:3.0:1784191950.685251:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784191950.685256:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784191950.685377:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812490752 00000100:00100000:2.0:1784191950.685381:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812490752 00000100:00100000:2.0:1784191950.685420:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 429 00000100:00100000:2.0:1784191950.685427:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812490752:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191950.685477:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812490752:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 51us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191950.685484:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 429 00000100:00080000:2.0:1784191950.685507:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784191950.929649:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784191951.212165:0:168296:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 5571391472874ns, next at 5555183555375ns, rc = 0 00080000:00080000:0.0:1784191951.212184:0:168296:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1784191951.212308:0:168296:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 5571391618377ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784191951.212323:0:168296:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1784191951.215842:0:167172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1784191951.216576:0:168296:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 5571395885521ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784191951.216591:0:168296:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1784191951.218345:0:167172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:0.0:1784191951.219053:0:168296:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 5571398362727ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784191951.219072:0:168296:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1784191951.220366:0:165481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 6 committed 00000004:00080000:3.0:1784191951.223221:0:165481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 6 committed 00010000:00010000:3.0:1784191951.947942:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191952.645661:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191952.646029:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812491136 00000100:00100000:3.0:1784191952.646050:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812491136 00000100:00080000:2.0:1784191952.646186:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784191952.646232:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 812 00000100:00100000:3.0:1784191952.646245:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125163:x1870858812491136:12345-192.168.204.16@tcp:48:lfs.0 00000100:00100000:3.0:1784191952.649594:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125163:x1870858812491136:12345-192.168.204.16@tcp:48:lfs.0 Request processed in 3329us (3928us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191952.649620:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 812 00000100:00100000:2.0:1784191952.655281:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191952.655400:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812491264 00000100:00100000:1.0:1784191952.655423:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812491264 00000100:00100000:1.0:1784191952.655556:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 433 00000100:00100000:1.0:1784191952.655568:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:125163:x1870858812491264:12345-192.168.204.16@tcp:19:lfs.0 00000100:00080000:2.0:1784191952.660419:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784191952.660775:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:125163:x1870858812491264:12345-192.168.204.16@tcp:19:lfs.0 Request processed in 5202us (5495us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191952.660789:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 433 00000100:00100000:1.0:1784191952.667452:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191952.667559:0:162390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812491392 00000100:00100000:3.0:1784191952.667570:0:162390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812491392 00000100:00100000:3.0:1784191952.667660:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 434 00000100:00100000:3.0:1784191952.667673:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:125163:x1870858812491392:12345-192.168.204.16@tcp:19:lfs.0 00000100:00080000:0.0:1784191952.668758:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784191952.670522:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:125163:x1870858812491392:12345-192.168.204.16@tcp:19:lfs.0 Request processed in 2841us (3072us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191952.670538:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 434 00000100:00100000:0.0:1784191952.675005:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191952.675076:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812491520 00000100:00100000:3.0:1784191952.675086:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812491520 00000100:00100000:3.0:1784191952.675149:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 813 00000100:00100000:3.0:1784191952.675161:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125163:x1870858812491520:12345-192.168.204.16@tcp:48:lfs.0 00000100:00100000:3.0:1784191952.678011:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125163:x1870858812491520:12345-192.168.204.16@tcp:48:lfs.0 Request processed in 2840us (3002us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191952.678026:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 813 00000100:00100000:1.0:1784191952.683752:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191952.683866:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812491648 00000100:00100000:3.0:1784191952.683877:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812491648 00000100:00100000:3.0:1784191952.683956:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 814 00000100:00100000:3.0:1784191952.683968:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:125163:x1870858812491648:12345-192.168.204.16@tcp:48:lfs.0 00000100:00080000:1.0:1784191952.684783:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191952.685191:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:125163:x1870858812491648:12345-192.168.204.16@tcp:48:lfs.0 Request processed in 1222us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191952.685202:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 814 00000100:00100000:3.0:1784191952.745881:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191952.745980:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812491776 00000100:00100000:0.0:1784191952.745990:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812491776 00000100:00100000:0.0:1784191952.746054:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 815 00000100:00100000:0.0:1784191952.746065:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125165:x1870858812491776:12345-192.168.204.16@tcp:48:lfs.0 00000100:00100000:0.0:1784191952.746177:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125165:x1870858812491776:12345-192.168.204.16@tcp:48:lfs.0 Request processed in 114us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191952.746186:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 815 00000100:00100000:0.0:1784191952.755362:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191952.755460:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812491904 00000100:00100000:3.0:1784191952.755471:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812491904 00000100:00100000:3.0:1784191952.755548:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 435 00000100:00100000:3.0:1784191952.755558:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:125165:x1870858812491904:12345-192.168.204.16@tcp:19:lfs.0 00000100:00100000:3.0:1784191952.755719:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:125165:x1870858812491904:12345-192.168.204.16@tcp:19:lfs.0 Request processed in 161us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191952.755727:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 435 00000100:00100000:0.0:1784191952.767760:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191952.767974:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812492032 00000100:00100000:0.0:1784191952.767985:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812492032 00000100:00100000:0.0:1784191952.768039:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 436 00000100:00100000:0.0:1784191952.768050:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:125165:x1870858812492032:12345-192.168.204.16@tcp:19:lfs.0 00000100:00100000:0.0:1784191952.768872:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:125165:x1870858812492032:12345-192.168.204.16@tcp:19:lfs.0 Request processed in 819us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191952.768882:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 436 00000100:00100000:1.0:1784191952.785947:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191952.785983:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812492160 00000100:00100000:1.0:1784191952.785993:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812492160 00000100:00100000:1.0:1784191952.786049:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 816 00000100:00100000:1.0:1784191952.786061:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125165:x1870858812492160:12345-192.168.204.16@tcp:48:lfs.0 00000100:00100000:1.0:1784191952.786218:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125165:x1870858812492160:12345-192.168.204.16@tcp:48:lfs.0 Request processed in 158us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191952.786226:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 816 00000100:00100000:3.0:1784191952.789759:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191952.789793:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812492288 00000100:00100000:3.0:1784191952.789803:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812492288 00000100:00100000:3.0:1784191952.789861:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 817 00000100:00100000:3.0:1784191952.789872:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:125165:x1870858812492288:12345-192.168.204.16@tcp:48:lfs.0 00000100:00100000:3.0:1784191952.790088:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:125165:x1870858812492288:12345-192.168.204.16@tcp:48:lfs.0 Request processed in 217us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191952.790096:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 817 00010000:00010000:3.0:1784191952.975742:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191953.934071:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828017024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784191953.934146:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191953.934222:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828017024 00000100:00100000:2.0:1784191953.934230:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828017024 00000100:00100000:2.0:1784191953.934281:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:2.0:1784191953.934291:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828017024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784191953.934332:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:2.0:1784191953.934436:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828017024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191953.934445:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:2.0:1784191953.934500:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828017024:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784191953.996729:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191954.443872:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828017152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784191954.443977:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191954.444058:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784191954.444065:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828017280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784191954.444096:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191954.444132:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828017280 00000100:00100000:1.0:1784191954.444142:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828017280 00000100:00100000:1.0:1784191954.444200:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1784191954.444211:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828017280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784191954.444244:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 29815872 pending 0 free 38084608 avail 30916608 00000100:00100000:1.0:1784191954.444289:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828017280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191954.444296:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:1.0:1784191954.444317:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784191954.444352:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828017280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784191954.444743:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828017408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191954.444774:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191954.444810:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828017408 00000100:00100000:1.0:1784191954.444815:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828017408 00000100:00100000:1.0:1784191954.444844:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1784191954.444851:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828017408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784191954.444871:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784191954.444903:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828017408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191954.444908:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:1.0:1784191954.444923:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784191954.444945:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828017408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784191954.445147:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828017152 00000100:00100000:2.0:1784191954.445154:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828017152 00000100:00100000:3.0:1784191954.445217:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:3.0:1784191954.445228:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828017152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784191954.445257:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:3.0:1784191954.445301:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828017152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191954.445308:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:1.0:1784191954.447464:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828017536:0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.447546:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191954.447593:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858828018048:0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.447623:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191954.447651:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828018560:0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.447671:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191954.447716:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784191954.447723:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828017920:0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.447744:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191954.447761:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828018432:0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.447784:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191954.447815:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828018048 00000100:00100000:1.0:1784191954.447823:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828018048 00000100:00100000:1.0:1784191954.447877:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828018560 00000100:00100000:1.0:1784191954.447880:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828018560 00000100:00100000:1.0:1784191954.447898:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828017920 00000100:00100000:1.0:1784191954.447901:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828017920 00000100:00100000:1.0:1784191954.447917:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1784191954.447926:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858828018048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.447977:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858828018048:12345-0@lo:400:kworker.0 Request processed in 52us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191954.447985:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1784191954.448002:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1784191954.448007:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828018560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.448034:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828018560:12345-0@lo:400:kworker.0 Request processed in 26us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191954.448057:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1784191954.448070:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1784191954.448076:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828017920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.448103:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828017920:12345-0@lo:400:kworker.0 Request processed in 27us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191954.448109:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1784191954.448134:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828018432 00000100:00100000:1.0:1784191954.448137:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828018432 00000100:00100000:1.0:1784191954.448163:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1784191954.448168:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828018432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.448195:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828018432:12345-0@lo:400:kworker.0 Request processed in 27us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191954.448201:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:1.0:1784191954.448223:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784191954.448228:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784191954.448230:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784191954.448246:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858828017664:0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.448272:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191954.448289:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858828018176:0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.448309:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191954.448350:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828017152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784191954.448371:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784191954.448390:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858828017792:0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.448414:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191954.448432:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828018304:0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.448467:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191954.448543:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828018304 00000100:00100000:1.0:1784191954.448547:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828018304 00000100:00100000:1.0:1784191954.448575:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1784191954.448582:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828018304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.448616:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828018304:12345-0@lo:400:kworker.0 Request processed in 34us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191954.448622:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1784191954.448637:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828017664 00000100:00100000:1.0:1784191954.448640:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828017664 00000100:00100000:1.0:1784191954.448662:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828018176 00000100:00100000:1.0:1784191954.448665:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828018176 00000100:00100000:1.0:1784191954.448676:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828017792 00000100:00100000:1.0:1784191954.448679:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828017792 00000100:00100000:1.0:1784191954.448723:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1784191954.448729:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858828017664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.448761:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858828017664:12345-0@lo:400:kworker.0 Request processed in 33us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191954.448767:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1784191954.448778:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:1.0:1784191954.448783:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858828018176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.448804:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858828018176:12345-0@lo:400:kworker.0 Request processed in 21us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191954.448809:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:1.0:1784191954.448818:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1784191954.448823:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858828017792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.448845:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858828017792:12345-0@lo:400:kworker.0 Request processed in 22us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191954.448857:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00080000:1.0:1784191954.448877:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784191954.448879:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784191954.448881:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784191954.448904:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828017920:0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.448915:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828018432:0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.448926:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858828018048:0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.448935:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828018560:0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.448968:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858828017792:0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.448977:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828018304:0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.448986:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858828017664:0@lo:400:kworker.0 00000100:00100000:1.0:1784191954.448994:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858828018176:0@lo:400:kworker.0 00000100:00100000:3.0:1784191954.449112:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828017536 00000100:00100000:3.0:1784191954.449117:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828017536 00000100:00100000:3.0:1784191954.449146:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784191954.449152:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828017536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191954.449192:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828017536:12345-0@lo:400:kworker.0 Request processed in 40us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191954.449207:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784191954.449245:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828017536:0@lo:400:kworker.0 00000100:00100000:2.0:1784191954.957714:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828018688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784191954.957785:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191954.957850:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784191954.957858:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828018816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784191954.957882:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191954.957980:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828018688 00000100:00100000:1.0:1784191954.957988:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828018688 00000100:00100000:1.0:1784191954.958042:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828018816 00000100:00100000:1.0:1784191954.958046:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828018816 00000100:00100000:1.0:1784191954.958063:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1784191954.958071:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828018688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784191954.958095:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784191954.958145:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828018688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191954.958152:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1784191954.958169:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1784191954.958185:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828018816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784191954.958199:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 29815872 pending 0 free 38084608 avail 30916608 00000100:00100000:3.0:1784191954.958259:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828018688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784191954.965622:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828018816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7424us (7725us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191954.965640:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1784191954.970640:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828018816:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784191955.026963:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191955.797477:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191955.797516:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191955.797546:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191955.797577:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191955.797646:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191955.797679:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812492800 00000100:00100000:1.0:1784191955.797713:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812492800 00000100:00100000:1.0:1784191955.797771:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812492928 00000100:00100000:1.0:1784191955.797775:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812492928 00000100:00100000:1.0:1784191955.797800:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 236 00000100:00100000:1.0:1784191955.797809:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812492800:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191955.797888:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812492800:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 79us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191955.797895:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 236 00000100:00100000:1.0:1784191955.797915:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 237 00000100:00100000:1.0:1784191955.797922:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812492928:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191955.798082:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812492544 00000100:00100000:0.0:1784191955.798087:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812492544 00000100:00100000:0.0:1784191955.798124:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812492672 00000100:00100000:0.0:1784191955.798133:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812492672 00000100:00100000:0.0:1784191955.798162:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 436 00000100:00100000:0.0:1784191955.798171:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69109:x1870858812492544:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191955.798225:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812492928:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 303us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191955.798233:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 237 00000100:00100000:1.0:1784191955.798254:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812492416 00000100:00100000:1.0:1784191955.798258:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812492416 00000100:00100000:1.0:1784191955.798293:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 87 00000100:00100000:1.0:1784191955.798300:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69111:x1870858812492416:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191955.798396:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 437 00000100:00100000:2.0:1784191955.798406:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812492672:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191955.801595:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69109:x1870858812492544:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 3411us (4113us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191955.801611:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 436 00000100:00100000:1.0:1784191955.801731:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69111:x1870858812492416:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 3429us (4150us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191955.801742:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 87 00000100:00080000:1.0:1784191955.801799:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784191955.801804:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784191955.801808:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784191955.801812:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784191955.802440:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812492672:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 4029us (4915us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191955.802450:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 437 00000004:00080000:3.0:1784191955.812779:0:168440:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 5575992085590ns, next at 5555183555375ns, rc = 0 00080000:00080000:3.0:1784191955.812804:0:168440:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1784191955.812981:0:168440:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 5575992291210ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784191955.812989:0:168440:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1784191955.813302:0:168440:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 5575992612462ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784191955.813310:0:168440:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1784191955.813398:0:168440:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 5575992707873ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784191955.813412:0:168440:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1784191955.816891:0:165481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 7 committed 00000004:00080000:0.0:1784191955.816930:0:165481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 7 committed 00000004:00080000:3.0:1784191955.817786:0:167172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:3.0:1784191955.820067:0:167172:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:2.0:1784191956.045776:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191957.071416:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191957.343118:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191957.343198:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812493056 00000100:00100000:3.0:1784191957.343210:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812493056 00000100:00100000:3.0:1784191957.343301:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 818 00000100:00100000:3.0:1784191957.343314:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125357:x1870858812493056:12345-192.168.204.16@tcp:48:lfs.0 00000100:00080000:1.0:1784191957.343544:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784191957.351867:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125357:x1870858812493056:12345-192.168.204.16@tcp:48:lfs.0 Request processed in 8537us (8742us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191957.351882:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 818 00000100:00100000:1.0:1784191957.358511:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191957.358600:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812493184 00000100:00100000:0.0:1784191957.358612:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812493184 00000100:00100000:0.0:1784191957.358726:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 437 00000100:00100000:0.0:1784191957.358739:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:125357:x1870858812493184:12345-192.168.204.16@tcp:19:lfs.0 00000100:00080000:1.0:1784191957.359289:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191957.359426:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:125357:x1870858812493184:12345-192.168.204.16@tcp:19:lfs.0 Request processed in 689us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191957.359434:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 437 00000100:00100000:1.0:1784191957.362956:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191957.363305:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812493312 00000100:00100000:0.0:1784191957.363316:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812493312 00000100:00100000:0.0:1784191957.363549:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 438 00000100:00100000:0.0:1784191957.363563:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:125357:x1870858812493312:12345-192.168.204.16@tcp:19:lfs.0 00000100:00100000:3.0:1784191957.366997:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:125357:x1870858812493312:12345-192.168.204.16@tcp:19:lfs.0 Request processed in 3426us (4049us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191957.367010:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 438 00000100:00080000:1.0:1784191957.369939:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784191957.383264:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191957.384880:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812493440 00000100:00100000:0.0:1784191957.384897:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812493440 00000100:00100000:1.0:1784191957.390714:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 819 00000100:00100000:1.0:1784191957.390733:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125357:x1870858812493440:12345-192.168.204.16@tcp:48:lfs.0 00000100:00100000:1.0:1784191957.392471:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125357:x1870858812493440:12345-192.168.204.16@tcp:48:lfs.0 Request processed in 1731us (9205us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191957.392487:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 819 00000100:00100000:2.0:1784191957.407568:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191957.408483:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812493568 00000100:00100000:3.0:1784191957.408506:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812493568 00000100:00080000:2.0:1784191957.408633:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191957.412789:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 820 00000100:00100000:3.0:1784191957.412821:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:125357:x1870858812493568:12345-192.168.204.16@tcp:48:lfs.0 00000100:00100000:3.0:1784191957.429560:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:125357:x1870858812493568:12345-192.168.204.16@tcp:48:lfs.0 Request processed in 16737us (21990us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191957.429576:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 820 00000100:00100000:3.0:1784191957.461682:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191957.461756:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812493696 00000100:00100000:3.0:1784191957.461766:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812493696 00000100:00100000:3.0:1784191957.461825:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 821 00000100:00100000:3.0:1784191957.461835:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125359:x1870858812493696:12345-192.168.204.16@tcp:48:lfs.0 00000100:00100000:3.0:1784191957.461938:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125359:x1870858812493696:12345-192.168.204.16@tcp:48:lfs.0 Request processed in 104us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191957.461946:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 821 00000100:00100000:3.0:1784191957.467053:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191957.467331:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812493824 00000100:00100000:0.0:1784191957.467342:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812493824 00000100:00100000:0.0:1784191957.467442:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 439 00000100:00100000:0.0:1784191957.467454:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:125359:x1870858812493824:12345-192.168.204.16@tcp:19:lfs.0 00000100:00100000:0.0:1784191957.467594:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:125359:x1870858812493824:12345-192.168.204.16@tcp:19:lfs.0 Request processed in 142us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191957.467611:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 439 00000100:00100000:2.0:1784191957.478130:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191957.479120:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812493952 00000100:00100000:0.0:1784191957.479135:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812493952 00000100:00100000:0.0:1784191957.479215:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 440 00000100:00100000:0.0:1784191957.479227:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:125359:x1870858812493952:12345-192.168.204.16@tcp:19:lfs.0 00000100:00100000:0.0:1784191957.479473:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:125359:x1870858812493952:12345-192.168.204.16@tcp:19:lfs.0 Request processed in 247us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191957.479481:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 440 00000100:00100000:3.0:1784191957.481636:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191957.481778:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812494080 00000100:00100000:1.0:1784191957.481790:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812494080 00000100:00100000:1.0:1784191957.481852:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 822 00000100:00100000:1.0:1784191957.481863:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af112196450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125359:x1870858812494080:12345-192.168.204.16@tcp:48:lfs.0 00000100:00100000:1.0:1784191957.482003:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af112196450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125359:x1870858812494080:12345-192.168.204.16@tcp:48:lfs.0 Request processed in 142us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191957.482025:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 822 00000100:00100000:0.0:1784191957.487078:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191957.487173:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812494208 00000100:00100000:3.0:1784191957.487183:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812494208 00000100:00100000:3.0:1784191957.487245:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 823 00000100:00100000:3.0:1784191957.487254:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:125359:x1870858812494208:12345-192.168.204.16@tcp:48:lfs.0 00000100:00100000:3.0:1784191957.487457:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:125359:x1870858812494208:12345-192.168.204.16@tcp:48:lfs.0 Request processed in 203us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191957.487466:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 823 00000100:00100000:2.0:1784191957.508900:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191957.509066:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812494464 00000100:00100000:3.0:1784191957.509081:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812494464 00000100:00100000:3.0:1784191957.509162:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 824 00000100:00100000:3.0:1784191957.509191:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125362:x1870858812494464:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1784191957.509220:0:161504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191957.509245:0:161504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0ab600/0xfeec3c2dc5a4d5b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c41c expref: -99 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509345:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d5b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509360:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d5b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509371:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d5b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509388:0:161504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4d5be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509394:0:161504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4d5be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509400:0:161504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4d5be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509471:0:161504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d5b7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509479:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d5b7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509485:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d5b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509517:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d5b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509524:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20c0aae00 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191957.509528:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d5b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509537:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d5b7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509551:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af1066eee00) 00010000:00010000:3.0:1784191957.509555:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191957.509560:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d5b7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509567:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0aae00/0xfeec3c2dc5a4d5b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509584:0:161504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4d5be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509590:0:161504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4d5be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509595:0:161504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4d5be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509599:0:161504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:3.0:1784191957.509602:0:161504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4d5be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509618:0:161504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4d5be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509625:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ef1f051 (ffff8af108400a00) 00010000:00010000:3.0:1784191957.509628:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784191957.509630:0:161504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4d5be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509636:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af1115b9200/0xfeec3c2dc5a4d5be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 161504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509668:0:161504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0ab600/0xfeec3c2dc5a4d5b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c41c expref: 10 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509679:0:161504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af1066eee00) 00010000:00010000:3.0:1784191957.509682:0:161504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784191957.509685:0:161504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af20c0ab600/0xfeec3c2dc5a4d5b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c41c expref: 10 pid: 161504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191957.509759:0:161504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20c0ab600, rc 0) 00000100:00100000:3.0:1784191957.509847:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125362:x1870858812494464:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 660us (959us total) trans 0 rc 301/301 00000100:00100000:3.0:1784191957.509856:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 824 00000100:00100000:2.0:1784191957.513938:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191957.514005:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812494592 00000100:00100000:1.0:1784191957.514015:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812494592 00000100:00100000:1.0:1784191957.514849:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 825 00000100:00100000:1.0:1784191957.514863:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125362:x1870858812494592:12345-192.168.204.16@tcp:34:lfs.0 00010000:00010000:1.0:1784191957.514952:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4d5c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.514972:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4d5c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.514985:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4d5c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515004:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4d5cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515012:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4d5cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515018:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4d5cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515106:0:158667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4d5d3 lrc: 3/1,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515116:0:158667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4d5d3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515124:0:158667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4d5d3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784191957.515182:0:158667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200003ab5:0x61:0x0]: returning size 31457280 00000004:00200000:1.0:1784191957.515186:0:158667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784191957.515203:0:158667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4d5d3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515219:0:158667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4d5c5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515225:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4d5c5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515231:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4d5c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515238:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4d5c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515244:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e200 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191957.515249:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4d5c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515257:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4d5c5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515269:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8af1066eee00) 00010000:00010000:1.0:1784191957.515272:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191957.515276:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4d5c5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515282:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e200/0xfeec3c2dc5a4d5c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515306:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4d5cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515313:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4d5cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515470:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4d5cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515476:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3e600 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191957.515479:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4d5cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515485:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4d5cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515494:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ef1f051 (ffff8af233110000) 00010000:00010000:1.0:1784191957.515496:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191957.515499:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4d5cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515504:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3e600/0xfeec3c2dc5a4d5cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ef1f051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515519:0:158667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4d5d3 lrc: 3/1,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515526:0:158667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4d5d3 lrc: 2/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515531:0:158667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4d5d3 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515543:0:158667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3f400 already unused, calling callback (ffffffffc19954f0) 00010000:00010000:1.0:1784191957.515546:0:158667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4d5d3 lrc: 3/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515552:0:158667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4d5d3 lrc: 4/0,0 mode: PR/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515560:0:158667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200003ab5:0x61:0x0].0x0 (ffff8af1102d0900) 00010000:00010000:1.0:1784191957.515562:0:158667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784191957.515565:0:158667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4d5d3 lrc: 2/0,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191957.515571:0:158667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8af10de3f400/0xfeec3c2dc5a4d5d3 lrc: 0/0,0 mode: --/PR res: [0x200003ab5:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 158667 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191957.515664:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125362:x1870858812494592:12345-192.168.204.16@tcp:34:lfs.0 Request processed in 805us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191957.515673:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 825 00010000:00010000:1.0:1784191958.092274:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191959.052369:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828018944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784191959.052452:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191959.052782:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828018944 00000100:00100000:2.0:1784191959.052790:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828018944 00000100:00100000:2.0:1784191959.052850:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:2.0:1784191959.052859:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828018944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784191959.052895:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:2.0:1784191959.052959:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828018944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191959.052967:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:3.0:1784191959.053061:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828018944:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784191959.123007:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784191959.276420:0:168586:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1784191959.276476:0:168586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d08fc00/0xfeec3c2dc5a4d2d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2d8 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191959.276489:0:168586:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d08fc00/0xfeec3c2dc5a4d2d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d2d8 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191959.276497:0:168586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d08fc00/0xfeec3c2dc5a4d2d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4d2d8 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191959.276504:0:168586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.116@tcp lock: ffff8af10d08fc00/0xfeec3c2dc5a4d2d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4d2d8 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191959.276535:0:168586:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784191959.276540:0:168586:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1784191959.276568:0:168586:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784191959.276573:0:168586:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784191959.276579:0:168586:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784191959.276605:0:168586:0:(import.c:65:import_set_state_nolock()) ffff8af23d85c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1784191959.277109:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191959.277118:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.116@tcp lock: ffff8af10d08fc00/0xfeec3c2dc5a4d2d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4d2d8 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191959.277127:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d08fc00 already unused, calling callback (ffffffffc1384c20) 10000000:00010000:1.0:1784191959.277131:0:158653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.116@tcp lock: ffff8af10d08fc00/0xfeec3c2dc5a4d2d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4d2d8 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191959.277154:0:158653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af10d08fc00/0xfeec3c2dc5a4d2d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4d2d8 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191959.277161:0:158653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af10d08fc00/0xfeec3c2dc5a4d2d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4d2d8 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191959.277167:0:158653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784191959.277170:0:158653:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784191959.277172:0:158653:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784191959.277201:0:158653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.116@tcp lock: ffff8af10d08fc00/0xfeec3c2dc5a4d2d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4d2d8 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191959.277207:0:158653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191959.277245:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.116@tcp lock: ffff8af10d08fc00/0xfeec3c2dc5a4d2d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4d2d8 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191959.277253:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af10d08fc00/0xfeec3c2dc5a4d2d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4d2d8 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191959.277265:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191959.277267:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191959.277269:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191959.277273:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784191959.277298:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:106498:1870858828019072:0@lo:39:umount.0 00000100:00100000:0.0:1784191959.277300:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858828019200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784191959.281406:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191959.284231:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828019200 00000100:00100000:2.0:1784191959.284250:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828019200 00000100:00100000:2.0:1784191959.284389:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1784191959.284401:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858828019200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784191959.284432:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784191959.284453:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af1115b8800/0xfeec3c2dc5a4d2d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d2d1 expref: 24 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191959.284470:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784191959.284553:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:106501:x1870858828019200:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (3156us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191959.284561:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1784191959.285261:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191959.285339:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828019072 00000100:00100000:1.0:1784191959.285346:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828019072 00000100:00100000:1.0:1784191959.285395:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:1.0:1784191959.285403:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:106498:x1870858828019072:12345-0@lo:39:umount.0 00000020:00000080:1.0:1784191959.285443:0:164531:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4d33a 00000100:00080000:1.0:1784191959.285469:0:164531:0:(import.c:65:import_set_state_nolock()) ffff8af1093af800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784191959.285531:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+1:106498:x1870858828019072:12345-0@lo:39:umount.0 Request processed in 129us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191959.285537:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000020:00000080:1.0:1784191959.285545:0:164531:0:(genops.c:906:class_export_put()) final put ffff8af1093ad800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:1.0:1784191959.285587:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784191959.285618:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23d85c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784191959.285631:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:106498:1870858828019072:0@lo:39:umount.0 00000100:00080000:1.0:1784191959.285860:0:168586:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784191959.285864:0:168586:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784191959.285869:0:168586:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784191959.286740:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af1093ad800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:1.0:1784191959.286751:0:168586:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784191959.286756:0:168586:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784191959.286763:0:168586:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1784191959.286788:0:168586:0:(import.c:65:import_set_state_nolock()) ffff8af10c3ad800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:3.0:1784191959.286814:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af1093af800 for lustre-MDT0000 00000100:00100000:1.0:1784191959.286824:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:106498:1870858828019328:0@lo:39:umount.0 00000100:00100000:3.0:1784191959.286857:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858828019200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191959.286890:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784191959.286925:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784191959.288921:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828019328 00000100:00100000:1.0:1784191959.288937:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828019328 00000100:00100000:1.0:1784191959.289028:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:1.0:1784191959.289041:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106498:x1870858828019328:12345-0@lo:39:umount.0 00000020:00000080:1.0:1784191959.289070:0:158665:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4ac0b 00000100:00080000:1.0:1784191959.289081:0:158665:0:(import.c:65:import_set_state_nolock()) ffff8af109024000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1784191959.289168:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784191959.289178:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+1:106498:x1870858828019328:12345-0@lo:39:umount.0 Request processed in 140us (2287us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191959.289188:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000020:00000080:1.0:1784191959.289200:0:158665:0:(genops.c:906:class_export_put()) final put ffff8af109021000/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:1.0:1784191959.289256:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784191959.289261:0:123300:0:(genops.c:865:class_export_destroy()) destroying export ffff8af109021000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00080000:1.0:1784191959.289314:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10c3ad800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:3.0:1784191959.289324:0:123300:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af109024000 for lustre-MDT0001 00000100:00100000:1.0:1784191959.289330:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:106498:1870858828019328:0@lo:39:umount.0 00000100:00080000:1.0:1784191959.289368:0:168586:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784191959.289371:0:168586:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784191959.289377:0:168586:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1784191959.295243:0:168586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af20c0aaa00/0xfeec3c2dc5a4d2df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2e6 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191959.295263:0:168586:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af20c0aaa00/0xfeec3c2dc5a4d2df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d2e6 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191959.295270:0:168586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af20c0aaa00/0xfeec3c2dc5a4d2df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4d2e6 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191959.295276:0:168586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.116@tcp lock: ffff8af20c0aaa00/0xfeec3c2dc5a4d2df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4d2e6 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191959.295309:0:168586:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784191959.295317:0:168586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10de3fa00/0xfeec3c2dc5a4d2ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d2f4 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191959.295324:0:168586:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10de3fa00/0xfeec3c2dc5a4d2ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d2f4 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191959.295331:0:168586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10de3fa00/0xfeec3c2dc5a4d2ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4d2f4 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191959.295342:0:168586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.116@tcp lock: ffff8af10de3fa00/0xfeec3c2dc5a4d2ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfeec3c2dc5a4d2f4 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191959.295360:0:168586:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1784191959.295364:0:168586:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1784191959.295419:0:168586:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1784191959.295424:0:168586:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:0.0:1784191959.295430:0:168586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1784191959.295437:0:168586:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:1.0:1784191959.295724:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784191959.295733:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.116@tcp lock: ffff8af20c0aaa00/0xfeec3c2dc5a4d2df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4d2e6 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191959.295741:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af20c0aaa00 already unused, calling callback (ffffffffc1384c20) 10000000:00010000:1.0:1784191959.295746:0:158653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.116@tcp lock: ffff8af20c0aaa00/0xfeec3c2dc5a4d2df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4d2e6 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191959.295755:0:158653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af20c0aaa00/0xfeec3c2dc5a4d2df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4d2e6 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191959.295762:0:158653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af20c0aaa00/0xfeec3c2dc5a4d2df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4d2e6 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191959.295768:0:158653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784191959.295770:0:158653:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1784191959.295772:0:158653:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1784191959.295809:0:158653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.116@tcp lock: ffff8af20c0aaa00/0xfeec3c2dc5a4d2df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4d2e6 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191959.295815:0:158653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191959.295848:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.116@tcp lock: ffff8af20c0aaa00/0xfeec3c2dc5a4d2df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4d2e6 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191959.295868:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af20c0aaa00/0xfeec3c2dc5a4d2df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4d2e6 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191959.295880:0:158653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191959.295884:0:158653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.116@tcp lock: ffff8af10de3fa00/0xfeec3c2dc5a4d2ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4d2f4 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191959.295890:0:158653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10de3fa00 already unused, calling callback (ffffffffc1384c20) 10000000:00010000:1.0:1784191959.295893:0:158653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.116@tcp lock: ffff8af10de3fa00/0xfeec3c2dc5a4d2ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfeec3c2dc5a4d2f4 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191959.295899:0:158653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af10de3fa00/0xfeec3c2dc5a4d2ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xfeec3c2dc5a4d2f4 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191959.295906:0:158653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af10de3fa00/0xfeec3c2dc5a4d2ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xfeec3c2dc5a4d2f4 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191959.295912:0:158653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1784191959.295914:0:158653:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1784191959.295916:0:158653:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1784191959.295933:0:158653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.116@tcp lock: ffff8af10de3fa00/0xfeec3c2dc5a4d2ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4d2f4 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191959.295939:0:158653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191959.295945:0:158653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.116@tcp lock: ffff8af10de3fa00/0xfeec3c2dc5a4d2ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4d2f4 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191959.295951:0:158653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af10de3fa00/0xfeec3c2dc5a4d2ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xfeec3c2dc5a4d2f4 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191959.295970:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191959.295971:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191959.295973:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191959.296142:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191959.296349:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858828019456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191959.296426:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191959.296491:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784191959.296498:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858828019584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784191959.296524:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191959.296785:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828019456 00000100:00100000:1.0:1784191959.296785:0:160189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828019584 00000100:00100000:1.0:1784191959.296794:0:160189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828019584 00000100:00100000:2.0:1784191959.296795:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828019456 00000100:00100000:1.0:1784191959.296852:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784191959.296862:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858828019584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191959.296877:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191959.296894:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af20c0aa400/0xfeec3c2dc5a4d2f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d2ed expref: 24 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191959.296907:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191959.297000:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:106499:x1870858828019584:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191959.297007:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784191959.297024:0:160189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1784191959.297031:0:160189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:106499:x1870858828019456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191959.297038:0:160189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191959.297048:0:160189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af20c0aba00/0xfeec3c2dc5a4d2e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d2df expref: 22 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191959.297058:0:160189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191959.297080:0:160189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:106499:x1870858828019456:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191959.297087:0:160189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00002000:00000080:0.0:1784191959.298497:0:168586:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:0.0:1784191959.298572:0:168586:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000020:00000080:0.0:1784191959.299682:0:168586:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:0.0:1784191959.299711:0:168586:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff8af20d951800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 21474836603 stale:0 00000020:00080000:0.0:1784191959.299722:0:168586:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff8af109022800 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 192.168.204.16@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 21474836601 stale:0 00000020:00080000:0.0:1784191959.299726:0:168586:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff8af101783000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 21474836544 stale:0 00000020:00080000:0.0:1784191959.299731:0:168586:0:(genops.c:1574:class_disconnect_exports()) OBD device 22 (ffff8af1077a3380) has exports, disconnecting them 00000020:00080000:0.0:1784191959.299735:0:168586:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8af20d951800), last request at 1784191954 00000020:00000080:0.0:1784191959.299742:0:168586:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4d1ff 00000100:00080000:0.0:1784191959.299752:0:168586:0:(import.c:65:import_set_state_nolock()) ffff8af20d952000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784191959.299775:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1784191959.299786:0:168586:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af20d951800): rc 0 00000020:00000080:0.0:1784191959.299788:0:168586:0:(genops.c:906:class_export_put()) final put ffff8af20d951800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:0.0:1784191959.299800:0:168586:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.204.16@tcp (ffff8af109022800), last request at 1784191957 00000020:00000080:0.0:1784191959.299804:0:168586:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4b462 00000100:00080000:0.0:1784191959.299809:0:168586:0:(import.c:65:import_set_state_nolock()) ffff8af109020000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784191959.299821:0:168586:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.16@tcp (ffff8af109022800): rc 0 00000020:00000080:0.0:1784191959.299823:0:168586:0:(genops.c:906:class_export_put()) final put ffff8af109022800/62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000020:00080000:0.0:1784191959.299828:0:168586:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8af101783000), last request at 1784191954 00000020:00000080:0.0:1784191959.299830:0:168586:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4a9c6 00000100:00080000:0.0:1784191959.301925:0:168586:0:(import.c:65:import_set_state_nolock()) ffff8af1086f5000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784191959.301967:0:168586:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af101783000): rc 0 00000020:00000080:0.0:1784191959.301970:0:168586:0:(genops.c:906:class_export_put()) final put ffff8af101783000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:0.0:1784191959.302011:0:168586:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff8af1077a3380) has no exports 00000020:00000080:3.0:1784191959.305155:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af20d951800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1784191959.305226:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af109022800/62ac9b09-d016-4ae6-b1b1-fe120a3abe0a for lustre-OST0000 00000020:00000080:3.0:1784191959.305266:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af101783000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1784191959.305307:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af20d952000 for lustre-OST0000 00000020:00000080:3.0:1784191959.305313:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af109020000 for lustre-OST0000 00000020:00000080:3.0:1784191959.305315:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af1086f5000 for lustre-OST0000 00000100:00100000:3.0:1784191959.305371:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858828019584:0@lo:103:ldlm_bl.0 00000020:01000000:0.0:1784191959.305384:0:168586:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8af10db0f6c0 - data ffff8af2244ff0d8/ffff8af10fbc7800 00000100:00100000:3.0:1784191959.305386:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858828019456:0@lo:103:ldlm_bl.0 00000020:01000000:0.0:1784191959.305559:0:168586:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8af10cb22300 - data ffff8af22469baf8/ffff8af1076d5400 00010000:00010000:1.0:1784191959.305789:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191959.305814:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1784191959.322016:0:168586:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1784191959.335074:0:168586:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a475fc 00000020:00000080:1.0:1784191959.335089:0:168586:0:(genops.c:906:class_export_put()) final put ffff8af23f60b000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1784191959.335116:0:168586:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af10c3af800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1784191959.335120:0:168586:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af10c3af800 2 00000020:01000004:1.0:1784191959.335124:0:168586:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8af10c3af800 from lustre-OST0000 00000020:00000080:1.0:1784191959.335150:0:168586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784191959.335168:0:168586:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1784191959.335171:0:168586:0:(genops.c:906:class_export_put()) final put ffff8af1086f4800/lustre-OST0000_UUID 00000020:00000080:1.0:1784191959.335175:0:168586:0:(genops.c:865:class_export_destroy()) destroying export ffff8af1086f4800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1784191959.335183:0:168586:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1784191959.335248:0:168586:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:1.0:1784191959.335253:0:168586:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1784191959.335257:0:168586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784191959.335264:0:168586:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784191959.335271:0:168586:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8af23d858800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784191959.335277:0:168586:0:(genops.c:1574:class_disconnect_exports()) OBD device 23 (ffff8af1090099c0) has exports, disconnecting them 00000020:00080000:1.0:1784191959.335292:0:168586:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8af23d858800), last request at 1784191651 00000020:00000080:1.0:1784191959.335296:0:168586:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a47626 00000020:00080000:1.0:1784191959.335305:0:168586:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af23d858800): rc 0 00000020:00000080:1.0:1784191959.335312:0:168586:0:(genops.c:906:class_export_put()) final put ffff8af23d858800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1784191959.335320:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23f60b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1784191959.335340:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23d858800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1784191959.342757:0:168586:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1784191959.342767:0:168586:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784191959.342771:0:168586:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784191959.342779:0:168586:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784191959.342952:0:168586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784191959.342968:0:168586:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1784191959.342975:0:168586:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1784191959.342981:0:168586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784191959.342986:0:168586:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784191959.342994:0:168586:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8af1079c5000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784191959.343000:0:168586:0:(genops.c:1574:class_disconnect_exports()) OBD device 24 (ffff8af1017519c0) has exports, disconnecting them 00000020:00080000:2.0:1784191959.343005:0:168586:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8af1079c5000), last request at 1784191651 00000020:00000080:2.0:1784191959.343010:0:168586:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4763b 00000020:00080000:2.0:1784191959.343030:0:168586:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8af1079c5000): rc 0 00000020:00000080:2.0:1784191959.343037:0:168586:0:(genops.c:906:class_export_put()) final put ffff8af1079c5000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1784191959.343118:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af23d85c000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1784191959.343128:0:70119:0:(genops.c:906:class_export_put()) final put ffff8af104ade000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1784191959.343132:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af104ade000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1784191959.343142:0:70119:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1784191959.343260:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af1079c5000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1784191959.344744:0:168586:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1784191959.344764:0:168586:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784191959.344768:0:168586:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784191959.344776:0:168586:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784191959.344814:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af10c3ad800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1784191959.344974:0:168586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784191959.344989:0:168586:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1784191959.344996:0:168586:0:(genops.c:906:class_export_put()) final put ffff8af23470d000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1784191959.344999:0:168586:0:(genops.c:865:class_export_destroy()) destroying export ffff8af23470d000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1784191959.345011:0:168586:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1784191959.345106:0:168586:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af10c3af800 1 00000020:00000080:3.0:1784191959.345112:0:168586:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a475d9 00000020:00000080:3.0:1784191959.345118:0:168586:0:(genops.c:906:class_export_put()) final put ffff8af206527000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1784191959.345127:0:168586:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1784191959.345135:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af206527000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1784191959.345144:0:168586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784191959.345152:0:168586:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784191959.345156:0:168586:0:(genops.c:1579:class_disconnect_exports()) OBD device 20 (ffff8af10900b380) has no exports 00000020:00000080:0.0:1784191959.446231:0:168586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784191959.446251:0:168586:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1784191959.446256:0:168586:0:(genops.c:906:class_export_put()) final put ffff8af10c3ab000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1784191959.446261:0:168586:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10c3ab000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1784191959.446274:0:168586:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1784191959.446461:0:168586:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8af10c3af000 00000020:02000400:0.0:1784191959.446527:0:168586:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00100000:3.0:1784191959.565509:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828019712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784191959.565597:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191959.565654:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784191959.565661:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828019840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784191959.565727:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191959.565759:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828019968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784191959.565784:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191959.565823:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828019712 00000100:00100000:3.0:1784191959.565832:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828019712 00000100:00100000:3.0:1784191959.565891:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828019968 00000100:00100000:3.0:1784191959.565894:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828019968 00000100:00100000:3.0:1784191959.565909:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1784191959.565929:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828019712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784191959.565960:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:3.0:1784191959.566005:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828019712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191959.566013:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1784191959.566031:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1784191959.566036:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:106499:x1870858828019968:12345-0@lo:13:osp-pre-0-1.0 00000020:00080000:3.0:1784191959.566042:0:160168:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784191959.566073:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:106499:x1870858828019968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (288us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784191959.566080:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1784191959.566110:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828019840 00000100:00100000:3.0:1784191959.566113:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828019840 00000100:00100000:3.0:1784191959.566139:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:3.0:1784191959.566145:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828019840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784191959.566170:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:3.0:1784191959.566201:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828019840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191959.566207:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00080000:3.0:1784191959.566223:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:02020000:3.0:1784191959.566249:0:106499:0:(client.c:1492:ptlrpc_check_status()) lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00100000:2.0:1784191959.567549:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858828020096:0@lo:400:kworker.0 00000100:00100000:2.0:1784191959.567617:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191959.567663:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828020608:0@lo:400:kworker.0 00000100:00100000:2.0:1784191959.567707:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191959.567734:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784191959.567740:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828020480:0@lo:400:kworker.0 00000100:00100000:2.0:1784191959.567766:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191959.567800:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828020096 00000100:00100000:2.0:1784191959.567807:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828020096 00000100:00100000:2.0:1784191959.567864:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1784191959.567872:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858828020096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191959.567922:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858828020096:12345-0@lo:400:kworker.0 Request processed in 51us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191959.567929:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1784191959.567957:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828020608 00000100:00100000:2.0:1784191959.567960:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828020608 00000100:00100000:2.0:1784191959.567987:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828020480 00000100:00100000:2.0:1784191959.567990:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828020480 00000100:00100000:2.0:1784191959.568008:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1784191959.568014:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828020608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191959.568044:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828020608:12345-0@lo:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191959.568050:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1784191959.568062:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1784191959.568066:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:106500:x1870858828020480:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784191959.568071:0:162386:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784191959.568096:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:106500:x1870858828020480:12345-0@lo:400:kworker.0 Request processed in 28us (328us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784191959.568101:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1784191959.568142:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858828020352:0@lo:400:kworker.0 00000100:00100000:2.0:1784191959.568177:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191959.568199:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784191959.568205:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858828020224:0@lo:400:kworker.0 00000100:00100000:2.0:1784191959.568228:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191959.568247:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828020736:0@lo:400:kworker.0 00000100:00100000:2.0:1784191959.568268:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191959.568311:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828020352 00000100:00100000:2.0:1784191959.568315:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828020352 00000100:00100000:2.0:1784191959.568338:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828020224 00000100:00100000:2.0:1784191959.568341:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828020224 00000100:00100000:2.0:1784191959.568358:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828020736 00000100:00100000:2.0:1784191959.568360:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828020736 00000100:00100000:2.0:1784191959.568372:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:2.0:1784191959.568378:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858828020352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191959.568414:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858828020352:12345-0@lo:400:kworker.0 Request processed in 35us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191959.568420:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:2.0:1784191959.568433:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1784191959.568439:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858828020224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191959.568467:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858828020224:12345-0@lo:400:kworker.0 Request processed in 29us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191959.568473:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1784191959.568485:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1784191959.568490:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828020736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191959.568516:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828020736:12345-0@lo:400:kworker.0 Request processed in 26us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191959.568529:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00080000:2.0:1784191959.568556:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784191959.568561:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784191959.568563:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784191959.568598:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858828020224:0@lo:400:kworker.0 00000100:00100000:2.0:1784191959.568610:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828020736:0@lo:400:kworker.0 00000100:00100000:2.0:1784191959.568619:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858828020352:0@lo:400:kworker.0 00000100:00080000:2.0:1784191959.568662:0:106500:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784191959.568668:0:106500:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784191959.568671:0:106500:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:2.0:1784191959.568685:0:106500:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:2.0:1784191959.568714:0:106500:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784191959.568719:0:106500:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 5533 00000100:00080000:2.0:1784191959.568725:0:106500:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8af2029fa800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:2.0:1784191959.568752:0:106500:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af106b85f80 x1870858828020864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784191959.568773:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828020480:0@lo:400:kworker.0 00000100:00100000:2.0:1784191959.568787:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858828020096:0@lo:400:kworker.0 00000100:00100000:2.0:1784191959.568797:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828020608:0@lo:400:kworker.0 00000100:00100000:2.0:1784191959.568823:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858828020864:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:2.0:1784191959.568850:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191959.568883:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828020864 00000100:00100000:2.0:1784191959.568893:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828020864 00000100:00100000:2.0:1784191959.568917:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1784191959.568922:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:106498:x1870858828020864:12345-0@lo:8:ptlrpcd_00_01.0 00010000:00020000:2.0:1784191959.568943:0:162392:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784191959.568978:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:106498:x1870858828020864:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 54us (127us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784191959.568984:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00080000:2.0:1784191959.569011:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784191959.569015:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784191959.569019:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858828020864:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:2.0:1784191959.570549:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828019840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191959.570576:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828019712:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1784191959.576014:0:106499:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784191959.576022:0:106499:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784191959.576027:0:106499:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:3.0:1784191959.576043:0:106499:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:3.0:1784191959.576045:0:106499:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784191959.576061:0:106499:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 5482 00000100:00080000:3.0:1784191959.576069:0:106499:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8af23f2d8800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:3.0:1784191959.576106:0:106499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af233108700 x1870858828020992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784191959.578491:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828020992:0@lo:8:ptlrpcd_00_00.0 00000100:00100000:0.0:1784191959.578572:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191959.580403:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828020992 00000100:00100000:2.0:1784191959.580416:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828020992 00000100:00100000:2.0:1784191959.580476:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1784191959.580485:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:106498:x1870858828020992:12345-0@lo:8:ptlrpcd_00_00.0 00010000:00020000:2.0:1784191959.580509:0:160163:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784191959.580587:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:106498:x1870858828020992:12345-0@lo:8:ptlrpcd_00_00.0 Request processed in 103us (2016us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784191959.580594:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00080000:0.0:1784191959.581197:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784191959.581204:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784191959.581209:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828020992:0@lo:8:ptlrpcd_00_00.0 00000100:00100000:3.0:1784191960.076193:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828021120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191960.076286:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191960.077265:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828021120 00000100:00100000:3.0:1784191960.077288:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828021120 00000100:00100000:3.0:1784191960.077347:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1784191960.077356:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828021120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784191960.078069:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:3.0:1784191960.078161:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828021120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 804us (1875us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191960.078170:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1784191960.079339:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828021120:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784191960.140834:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191960.917802:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191960.917847:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191960.917885:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191960.917904:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191960.917924:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812494720 00000100:00100000:1.0:1784191960.917929:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191960.917938:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812494720 00000100:00100000:1.0:1784191960.917953:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812494976 00000100:00100000:1.0:1784191960.917956:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812494976 00000100:00100000:1.0:1784191960.917999:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812494848 00000100:00100000:1.0:1784191960.918002:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812494848 00000100:00100000:0.0:1784191960.918003:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 88 00000100:00100000:0.0:1784191960.918015:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812494720:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191960.918034:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 442 00000100:00100000:1.0:1784191960.918042:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812494976:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191960.918892:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 443 00000100:00100000:3.0:1784191960.918912:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69109:x1870858812494848:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191960.919043:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812494976:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 1000us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191960.919054:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 442 00000100:00100000:1.0:1784191960.919098:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812495232 00000100:00100000:1.0:1784191960.919106:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812495232 00000100:00100000:1.0:1784191960.919146:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812495104 00000100:00100000:1.0:1784191960.919149:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812495104 00000100:00100000:1.0:1784191960.919168:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 239 00000100:00100000:1.0:1784191960.919187:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69109:x1870858812495232:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191960.921433:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812494720:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 3403us (3568us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191960.921454:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 88 00000100:00080000:0.0:1784191960.921587:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784191960.921596:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784191960.921601:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191960.921646:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69109:x1870858812494848:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 2738us (3736us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191960.921671:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 443 00000100:00100000:3.0:1784191960.921746:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 444 00000100:00100000:3.0:1784191960.921755:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:69111:x1870858812495104:12345-192.168.204.16@tcp:400:kworker.0 00000020:00080000:3.0:1784191960.921778:0:162387:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.16@tcp 00000100:00100000:3.0:1784191960.921828:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:69111:x1870858812495104:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 72us (3897us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784191960.921836:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 444 00000100:00100000:1.0:1784191960.927337:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69109:x1870858812495232:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 8139us (9427us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191960.927360:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 239 00000100:00100000:1.0:1784191960.939802:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191960.939949:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812495360 00000100:00100000:3.0:1784191960.939964:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812495360 00000100:00100000:3.0:1784191960.940068:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 445 00000100:00100000:3.0:1784191960.940080:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:69108:x1870858812495360:12345-192.168.204.16@tcp:8:ptlrpcd_00_02.0 00010000:00020000:3.0:1784191960.940120:0:161232:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784191960.940211:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:69108:x1870858812495360:12345-192.168.204.16@tcp:8:ptlrpcd_00_02.0 Request processed in 131us (428us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784191960.940218:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 445 00010000:00010000:0.0:1784191961.163922:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191962.188434:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191963.212534:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191964.172641:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828021248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784191964.172754:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191964.173350:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828021248 00000100:00100000:2.0:1784191964.173360:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828021248 00000100:00100000:2.0:1784191964.173421:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:2.0:1784191964.173436:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828021248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784191964.173472:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:2.0:1784191964.173740:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828021248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 304us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191964.173748:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:0.0:1784191964.173899:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828021248:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784191964.238015:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191964.686829:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828021376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191964.686950:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191964.687092:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828021376 00000100:00100000:1.0:1784191964.687345:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828021504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191964.687402:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191964.687451:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828021504 00000100:00100000:1.0:1784191964.687457:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828021504 00000100:00100000:1.0:1784191964.687539:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1784191964.687553:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828021504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784191964.687604:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784191964.687658:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828021504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191964.687711:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:1.0:1784191964.687741:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784191964.687793:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828021504:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784191964.687866:0:123300:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784191964.687871:0:123300:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784191964.687875:0:123300:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784191964.687881:0:123300:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 5579 00000100:00080000:1.0:1784191964.687886:0:123300:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784191964.687892:0:123300:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8af23f2d8800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191964.687916:0:123300:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af210303480 x1870858828022016/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784191964.687944:0:123300:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784191964.687948:0:123300:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784191964.687951:0:123300:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784191964.687955:0:123300:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 5579 00000100:00080000:1.0:1784191964.687958:0:123300:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784191964.687963:0:123300:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8af2029fa800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191964.687974:0:123300:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af22dc82d80 x1870858828022272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784191964.688009:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828022016:0@lo:8:kworker.0 00000100:00100000:1.0:1784191964.688046:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191964.688069:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858828022272:0@lo:8:kworker.0 00000100:00100000:1.0:1784191964.688089:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191964.688407:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828022016 00000100:00100000:1.0:1784191964.688414:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828022016 00000100:00100000:1.0:1784191964.688442:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828022272 00000100:00100000:1.0:1784191964.688445:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828022272 00000100:00100000:1.0:1784191964.688463:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1784191964.688470:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:106498:x1870858828022016:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1784191964.688494:0:162396:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784191964.688538:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:106498:x1870858828022016:12345-0@lo:8:kworker.0 Request processed in 66us (491us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784191964.688545:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1784191964.688558:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:1.0:1784191964.688561:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:106498:x1870858828022272:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1784191964.688571:0:162396:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784191964.688594:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:106498:x1870858828022272:12345-0@lo:8:kworker.0 Request processed in 31us (504us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784191964.688601:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:1.0:1784191964.688635:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828021632:0@lo:400:kworker.0 00000100:00100000:1.0:1784191964.688668:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191964.688722:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828022400:0@lo:400:kworker.0 00000100:00100000:1.0:1784191964.688748:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191964.688770:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784191964.688776:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858828022144:0@lo:400:kworker.0 00000100:00100000:1.0:1784191964.688802:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191964.688832:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828021632 00000100:00100000:1.0:1784191964.688837:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828021632 00000100:00100000:1.0:1784191964.688868:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784191964.688874:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:106502:x1870858828021632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191964.688930:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:106502:x1870858828021632:12345-0@lo:400:kworker.0 Request processed in 56us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191964.688938:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784191964.688967:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828022400 00000100:00100000:1.0:1784191964.688971:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828022400 00000100:00100000:1.0:1784191964.689008:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1784191964.689014:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828022400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191964.689044:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828022400:12345-0@lo:400:kworker.0 Request processed in 31us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191964.689050:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1784191964.689068:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828022144 00000100:00100000:1.0:1784191964.689071:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828022144 00000100:00100000:1.0:1784191964.689098:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:2.0:1784191964.689297:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828021376 00000100:00100000:2.0:1784191964.689342:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:2.0:1784191964.689350:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828021376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784191964.689671:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:2.0:1784191964.689748:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828021376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 397us (2796us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191964.689755:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:2.0:1784191964.689800:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858828021760:0@lo:400:kworker.0 00000100:00100000:2.0:1784191964.689837:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191964.689862:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858828022528:0@lo:400:kworker.0 00000100:00100000:2.0:1784191964.689884:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191964.689909:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784191964.689916:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858828021888:0@lo:400:kworker.0 00000100:00100000:2.0:1784191964.689938:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191964.689969:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828021760 00000100:00100000:2.0:1784191964.689973:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828021760 00000100:00100000:2.0:1784191964.689997:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828022528 00000100:00100000:2.0:1784191964.690010:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828022528 00000100:00100000:2.0:1784191964.690026:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828021888 00000100:00100000:2.0:1784191964.690029:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828021888 00000100:00100000:2.0:1784191964.690047:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:2.0:1784191964.690054:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858828021760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191964.690091:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858828021760:12345-0@lo:400:kworker.0 Request processed in 38us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191964.690098:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:3.0:1784191964.691396:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1784191964.691420:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858828022528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191964.691506:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858828022528:12345-0@lo:400:kworker.0 Request processed in 98us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191964.691514:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1784191964.691539:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1784191964.691547:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858828021888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191964.691571:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858828021888:12345-0@lo:400:kworker.0 Request processed in 27us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191964.691577:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1784191964.691639:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828021376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784191964.691876:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858828021888:0@lo:400:kworker.0 00000100:00100000:3.0:1784191964.691893:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858828021760:0@lo:400:kworker.0 00000100:00100000:3.0:1784191964.691906:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858828022528:0@lo:400:kworker.0 00000100:00080000:0.0:1784191964.692323:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784191964.692332:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784191964.692335:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828022016:0@lo:8:kworker.0 00000100:00080000:0.0:1784191964.692348:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784191964.692361:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784191964.692365:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858828022272:0@lo:8:kworker.0 00000100:00100000:0.0:1784191964.692416:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828021632:0@lo:400:kworker.0 00000100:00100000:0.0:1784191964.692433:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828022400:0@lo:400:kworker.0 00000100:00080000:0.0:1784191964.692468:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784191964.692475:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784191964.692479:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784191964.693327:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858828022144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191964.694707:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858828022144:12345-0@lo:400:kworker.0 Request processed in 5575us (5876us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191964.694723:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1784191964.694915:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858828022144:0@lo:400:kworker.0 00000100:00100000:2.0:1784191965.196323:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828022656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784191965.196446:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191965.196832:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828022656 00000100:00100000:1.0:1784191965.196843:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828022656 00000100:00100000:1.0:1784191965.196912:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1784191965.196923:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828022656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784191965.196955:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784191965.197025:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828022656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191965.197034:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1784191965.197114:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828022656:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784191965.260730:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191966.038658:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191966.038787:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191966.039018:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191966.039059:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191966.039093:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191966.039124:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812495488 00000100:00100000:0.0:1784191966.039139:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812495488 00000100:00100000:0.0:1784191966.039213:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 90 00000100:00100000:0.0:1784191966.039226:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1098c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812495488:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191966.039338:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1098c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812495488:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 115us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191966.039347:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 90 00000100:00100000:2.0:1784191966.039458:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812495872 00000100:00100000:2.0:1784191966.039463:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812495872 00000100:00100000:2.0:1784191966.039499:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812496000 00000100:00100000:2.0:1784191966.039503:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812496000 00000100:00100000:2.0:1784191966.039554:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 241 00000100:00100000:2.0:1784191966.039562:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812496000:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191966.039599:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812496000:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 39us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191966.039606:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 241 00000100:00100000:2.0:1784191966.039622:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 448 00000100:00100000:2.0:1784191966.039626:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:69108:x1870858812495872:12345-192.168.204.16@tcp:8:kworker.0 00010000:00020000:2.0:1784191966.039656:0:160165:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784191966.039685:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:69108:x1870858812495872:12345-192.168.204.16@tcp:8:kworker.0 Request processed in 57us (668us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784191966.039732:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 448 00000100:00080000:0.0:1784191966.039913:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784191966.040229:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812495744 00000100:00100000:3.0:1784191966.040242:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812495744 00000100:00100000:3.0:1784191966.040339:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812495616 00000100:00100000:3.0:1784191966.040343:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812495616 00000100:00080000:0.0:1784191966.040382:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784191966.040385:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784191966.040419:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 448 00000100:00100000:1.0:1784191966.040430:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812495744:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191966.040481:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812495744:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 53us (1836us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191966.040489:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 448 00000100:00100000:1.0:1784191966.040504:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 449 00000100:00100000:1.0:1784191966.040510:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812495616:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191966.040541:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812495616:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 30us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191966.040548:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 449 00010000:00010000:2.0:1784191966.284241:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191967.313418:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191968.332875:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191969.292866:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828022784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784191969.292983:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191969.293867:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828022784 00000100:00100000:3.0:1784191969.293882:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828022784 00000100:00100000:3.0:1784191969.293958:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:3.0:1784191969.294339:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828022784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784191969.294405:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:3.0:1784191969.295264:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828022784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1291us (2275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191969.295557:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828022784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784191969.301005:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00010000:00010000:0.0:1784191969.356472:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191969.803917:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784191969.803951:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828022912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784191969.804051:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191969.804107:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784191969.804121:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828023040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191969.804167:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191969.804199:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858828023168:0@lo:400:kworker.0 00000100:00080000:3.0:1784191969.804209:0:165779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784191969.804214:0:165779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784191969.804219:0:165779:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784191969.804226:0:165779:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 5584 00000100:00080000:3.0:1784191969.804233:0:165779:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784191969.804242:0:165779:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8af23f2d8800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191969.804265:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191969.804270:0:165779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af233108000 x1870858828023552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784191969.804311:0:165779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784191969.804315:0:165779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784191969.804317:0:165779:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1784191969.804318:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828023040 00000100:00080000:3.0:1784191969.804322:0:165779:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 5584 00000100:00080000:3.0:1784191969.804327:0:165779:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1784191969.804330:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828023040 00000100:00080000:3.0:1784191969.804350:0:165779:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8af2029fa800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:3.0:1784191969.804365:0:165779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af233109880 x1870858828023808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784191969.804412:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784191969.804423:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828022912 00000100:00100000:1.0:1784191969.804428:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828023040:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784191969.804429:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828022912 00000100:00100000:3.0:1784191969.804474:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00002000:00000024:1.0:1784191969.804478:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:3.0:1784191969.804484:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828022912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784191969.804521:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:1.0:1784191969.804530:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828023040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191969.804539:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784191969.804567:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828022912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191969.804570:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828023168 00000100:00100000:3.0:1784191969.804575:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1784191969.804582:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828023168 00000100:00100000:3.0:1784191969.804603:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858828023424:0@lo:400:kworker.0 00000100:00100000:1.0:1784191969.804616:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784191969.804624:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1098c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:106500:x1870858828023168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191969.804647:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191969.804674:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1098c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:106500:x1870858828023168:12345-0@lo:400:kworker.0 Request processed in 49us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191969.804679:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784191969.804683:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784191969.804716:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828023296:0@lo:400:kworker.0 00000100:00100000:3.0:1784191969.804749:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191969.804754:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828023936:0@lo:400:kworker.0 00000100:00100000:3.0:1784191969.804773:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828024064:0@lo:400:kworker.0 00000100:00100000:1.0:1784191969.804792:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191969.804805:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191969.804838:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858828023168:0@lo:400:kworker.0 00000100:00100000:3.0:1784191969.804841:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828023552:0@lo:8:kworker.0 00000100:00100000:1.0:1784191969.804865:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828023040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784191969.804875:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191969.804895:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784191969.804902:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858828023808:0@lo:8:kworker.0 00000100:00100000:1.0:1784191969.804906:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858828023680:0@lo:400:kworker.0 00000100:00100000:3.0:1784191969.804932:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191969.804969:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828023424 00000100:00100000:3.0:1784191969.804973:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828023424 00000100:00100000:3.0:1784191969.805009:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828023296 00000100:00100000:3.0:1784191969.805012:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828023296 00000100:00100000:3.0:1784191969.805045:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828024064 00000100:00100000:3.0:1784191969.805049:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828024064 00000100:00100000:3.0:1784191969.805065:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1784191969.805071:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858828023424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191969.805134:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858828023424:12345-0@lo:400:kworker.0 Request processed in 61us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191969.805135:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191969.805146:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1784191969.805162:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828023680 00000100:00100000:3.0:1784191969.805165:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828023680 00000100:00100000:3.0:1784191969.805180:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1784191969.805186:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828023296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191969.805215:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828023296:12345-0@lo:400:kworker.0 Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191969.805222:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1784191969.805234:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1784191969.805240:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828024064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191969.805267:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828024064:12345-0@lo:400:kworker.0 Request processed in 27us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191969.805273:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1784191969.805284:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1784191969.805290:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858828023680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191969.805333:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858828023680:12345-0@lo:400:kworker.0 Request processed in 42us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191969.805339:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1784191969.805365:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828023936 00000100:00100000:3.0:1784191969.805368:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828023936 00000100:00100000:3.0:1784191969.805402:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828023552 00000100:00100000:3.0:1784191969.805414:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828023552 00000100:00100000:1.0:1784191969.805420:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858828023680:0@lo:400:kworker.0 00000100:00100000:3.0:1784191969.805440:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828023808 00000100:00100000:3.0:1784191969.805444:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828023808 00000100:00100000:3.0:1784191969.805471:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1784191969.805479:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828023936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191969.805514:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828023936:12345-0@lo:400:kworker.0 Request processed in 37us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191969.805521:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1784191969.805533:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:3.0:1784191969.805537:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:106498:x1870858828023552:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1784191969.805559:0:162387:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784191969.805594:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:106498:x1870858828023552:12345-0@lo:8:kworker.0 Request processed in 55us (721us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784191969.805602:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:3.0:1784191969.805613:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1784191969.805616:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:106498:x1870858828023808:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1784191969.805626:0:162387:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784191969.805649:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:106498:x1870858828023808:12345-0@lo:8:kworker.0 Request processed in 31us (718us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784191969.805654:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00080000:3.0:1784191969.805741:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784191969.805747:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784191969.805751:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828023552:0@lo:8:kworker.0 00000100:00080000:3.0:1784191969.805761:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784191969.805765:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784191969.805768:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858828023808:0@lo:8:kworker.0 00000100:00100000:3.0:1784191969.805811:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828023296:0@lo:400:kworker.0 00000100:00100000:3.0:1784191969.805823:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828024064:0@lo:400:kworker.0 00000100:00100000:3.0:1784191969.805833:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858828023424:0@lo:400:kworker.0 00000100:00100000:3.0:1784191969.805867:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828022912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784191969.805892:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828023936:0@lo:400:kworker.0 00000100:00080000:0.0:1784191969.806157:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784191969.806163:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784191969.806166:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784191970.316195:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784191970.316226:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828024192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191970.316329:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191970.316408:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828024192 00000100:00100000:3.0:1784191970.316419:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828024192 00000100:00100000:3.0:1784191970.316492:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1784191970.316504:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828024192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784191970.316539:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:3.0:1784191970.316600:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828024192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191970.316609:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1784191970.316670:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828024192:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784191970.380055:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191971.165783:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191971.165836:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191971.165887:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191971.165928:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812496256 00000100:00100000:3.0:1784191971.165942:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812496256 00000100:00100000:3.0:1784191971.166040:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 454 00000100:00100000:3.0:1784191971.166054:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69111:x1870858812496256:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191971.166146:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812496128 00000100:00100000:0.0:1784191971.166151:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812496128 00000100:00100000:0.0:1784191971.166188:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 92 00000100:00100000:0.0:1784191971.166196:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1098c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812496128:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191971.166198:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69111:x1870858812496256:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 149us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191971.166207:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 454 00000100:00100000:0.0:1784191971.166224:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1098c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812496128:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 30us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191971.166230:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 92 00000100:00080000:0.0:1784191971.166260:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784191971.166495:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812496640 00000100:00100000:1.0:1784191971.166500:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812496640 00000100:00100000:1.0:1784191971.166555:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 243 00000100:00100000:1.0:1784191971.166563:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69109:x1870858812496640:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191971.166598:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69109:x1870858812496640:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 36us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191971.166604:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 243 00000100:00080000:3.0:1784191971.167254:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784191971.186213:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191971.186267:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191971.186408:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812496512 00000100:00100000:1.0:1784191971.186423:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812496512 00000100:00100000:1.0:1784191971.186486:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 451 00000100:00100000:1.0:1784191971.186513:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:69108:x1870858812496512:12345-192.168.204.16@tcp:8:kworker.0 00010000:00020000:1.0:1784191971.186549:0:162386:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784191971.186641:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:69108:x1870858812496512:12345-192.168.204.16@tcp:8:kworker.0 Request processed in 129us (373us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784191971.186651:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 451 00000100:00100000:3.0:1784191971.187234:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812496384 00000100:00100000:3.0:1784191971.187244:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812496384 00000100:00100000:3.0:1784191971.187338:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 455 00000100:00100000:3.0:1784191971.187348:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812496384:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191971.187415:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812496384:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 69us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191971.187422:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 455 00000100:00080000:1.0:1784191971.187613:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1784191971.404172:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191972.431212:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191973.466482:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191974.424384:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784191974.424413:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828024320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784191974.424501:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191974.424589:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828024320 00000100:00100000:3.0:1784191974.424599:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828024320 00000100:00100000:3.0:1784191974.424664:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:3.0:1784191974.424676:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828024320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784191974.424752:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:3.0:1784191974.424806:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828024320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191974.424812:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:3.0:1784191974.424877:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828024320:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784191974.480822:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191974.924249:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828024448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784191974.924347:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191974.924420:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828024448 00000100:00100000:3.0:1784191974.924428:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828024448 00000100:00100000:3.0:1784191974.924477:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:3.0:1784191974.924486:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828024448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784191974.924521:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:3.0:1784191974.924567:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828024448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191974.924573:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00100000:3.0:1784191974.924632:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828024448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784191974.925220:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858828024576:0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.925276:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191974.925322:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828024576 00000100:00100000:1.0:1784191974.925327:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828024576 00000100:00100000:1.0:1784191974.925362:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784191974.925369:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cfd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:106501:x1870858828024576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.925408:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cfd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:106501:x1870858828024576:12345-0@lo:400:kworker.0 Request processed in 40us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191974.925415:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784191974.925457:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858828024576:0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.925494:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828024704:0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.925522:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784191974.925567:0:165779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784191974.925571:0:165779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784191974.925575:0:165779:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784191974.925581:0:165779:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 5589 00000100:00080000:1.0:1784191974.925586:0:165779:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784191974.925592:0:165779:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8af23f2d8800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191974.925627:0:165779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af22dc83b80 x1870858828024960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784191974.926241:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858828025216:0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.926346:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191974.926391:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828024704 00000100:00100000:1.0:1784191974.926396:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828024704 00000100:00100000:1.0:1784191974.926442:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828025216 00000100:00100000:1.0:1784191974.926446:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828025216 00000100:00100000:1.0:1784191974.926469:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1784191974.926477:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828024704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.926521:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828024704:12345-0@lo:400:kworker.0 Request processed in 45us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191974.926528:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1784191974.926544:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:1.0:1784191974.926550:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858828025216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.926581:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858828025216:12345-0@lo:400:kworker.0 Request processed in 31us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191974.926586:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00080000:1.0:1784191974.926603:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784191974.926633:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828024704:0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.926660:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828025088:0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.927044:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191974.927070:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784191974.927079:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828024832:0@lo:400:kworker.0 00000100:00100000:3.0:1784191974.927250:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828024960:0@lo:8:kworker.0 00000100:00100000:3.0:1784191974.927422:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191974.927459:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828025088 00000100:00100000:3.0:1784191974.927464:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828025088 00000100:00100000:3.0:1784191974.927500:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828024960 00000100:00100000:3.0:1784191974.927503:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828024960 00000100:00100000:3.0:1784191974.927523:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1784191974.927530:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828025088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191974.927567:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828025088:12345-0@lo:400:kworker.0 Request processed in 37us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191974.927573:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1784191974.927586:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1784191974.927590:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:106498:x1870858828024960:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1784191974.927608:0:162392:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784191974.927643:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:106498:x1870858828024960:12345-0@lo:8:kworker.0 Request processed in 50us (220us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784191974.927657:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1784191974.927787:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191974.927977:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828025088:0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.928033:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858828025216:0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.928047:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784191974.928054:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828025344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191974.928081:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191974.928121:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828025344 00000100:00100000:1.0:1784191974.928125:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828025344 00000100:00100000:1.0:1784191974.928154:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1784191974.928171:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828025344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784191974.928195:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784191974.928232:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828025344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191974.928239:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1784191974.928283:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828025344:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784191974.928330:0:165779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784191974.928334:0:165779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784191974.928338:0:165779:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784191974.928343:0:165779:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 5589 00000100:00080000:1.0:1784191974.928347:0:165779:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784191974.928352:0:165779:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8af2029fa800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191974.928372:0:165779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af22dc81c00 x1870858828025600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784191974.928418:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858828025856:0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.928442:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191974.928480:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828024832 00000100:00100000:1.0:1784191974.928485:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828024832 00000100:00100000:1.0:1784191974.928516:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828025856 00000100:00100000:1.0:1784191974.928520:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828025856 00000100:00100000:1.0:1784191974.928539:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:1.0:1784191974.928545:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828024832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.928577:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828024832:12345-0@lo:400:kworker.0 Request processed in 33us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191974.928583:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:1.0:1784191974.928596:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1784191974.928602:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858828025856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.928633:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858828025856:12345-0@lo:400:kworker.0 Request processed in 30us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191974.928639:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1784191974.928831:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858828025856:0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.928853:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828025728:0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.928878:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191974.928905:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828024832:0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.928921:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784191974.928926:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828025472:0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.928949:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191974.932368:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828025728 00000100:00100000:1.0:1784191974.932386:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828025728 00000100:00100000:1.0:1784191974.932470:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1784191974.932481:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828025728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.932588:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828025728:12345-0@lo:400:kworker.0 Request processed in 108us (3707us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191974.932605:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1784191974.932628:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784191974.932634:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784191974.932678:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858828025600:0@lo:8:kworker.0 00000100:00100000:1.0:1784191974.932737:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784191974.932788:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784191974.932793:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784191974.932797:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828024960:0@lo:8:kworker.0 00000100:00100000:1.0:1784191974.932849:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828025728:0@lo:400:kworker.0 00000100:00100000:1.0:1784191974.932891:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828025600 00000100:00100000:1.0:1784191974.932895:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828025600 00000100:00100000:1.0:1784191974.932917:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:1.0:1784191974.932923:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:106498:x1870858828025600:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1784191974.932946:0:162395:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784191974.932981:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:106498:x1870858828025600:12345-0@lo:8:kworker.0 Request processed in 57us (244us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784191974.933272:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00080000:1.0:1784191974.933305:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784191974.933309:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784191974.933312:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858828025600:0@lo:8:kworker.0 00000100:00100000:3.0:1784191974.933492:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828025472 00000100:00100000:3.0:1784191974.933497:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828025472 00000100:00100000:3.0:1784191974.933548:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:3.0:1784191974.933556:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828025472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191974.933609:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828025472:12345-0@lo:400:kworker.0 Request processed in 54us (4658us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191974.933617:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:3.0:1784191974.933656:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828025472:0@lo:400:kworker.0 00000100:00100000:1.0:1784191975.436754:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828025984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784191975.436845:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191975.438570:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828025984 00000100:00100000:3.0:1784191975.438586:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828025984 00000100:00100000:3.0:1784191975.438662:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1784191975.438675:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828025984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784191975.438742:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:3.0:1784191975.438839:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828025984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191975.438847:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1784191975.439046:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828025984:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784191975.507849:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191976.282960:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191976.283025:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191976.283086:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812496896 00000100:00100000:0.0:1784191976.283098:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812496896 00000100:00100000:0.0:1784191976.283178:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812497024 00000100:00100000:0.0:1784191976.283182:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812497024 00000100:00100000:0.0:1784191976.283208:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 460 00000100:00100000:0.0:1784191976.283236:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69111:x1870858812496896:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191976.283332:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69111:x1870858812496896:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 100us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191976.283341:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 460 00000100:00100000:0.0:1784191976.283363:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 461 00000100:00100000:0.0:1784191976.283369:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812497024:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191976.283395:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812497024:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 26us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191976.283400:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 461 00000100:00080000:2.0:1784191976.283955:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784191976.283961:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784191976.297286:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191976.297327:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812496768 00000100:00100000:2.0:1784191976.297336:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812496768 00000100:00100000:2.0:1784191976.297391:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 94 00000100:00100000:2.0:1784191976.297420:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cfd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812496768:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191976.297499:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cfd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812496768:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 81us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191976.297508:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 94 00000100:00100000:1.0:1784191976.301656:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191976.302204:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812497280 00000100:00100000:3.0:1784191976.302217:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812497280 00000100:00100000:3.0:1784191976.302301:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 246 00000100:00100000:3.0:1784191976.302316:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69109:x1870858812497280:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191976.302424:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69109:x1870858812497280:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 93us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191976.302433:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 246 00000100:00080000:1.0:1784191976.302784:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784191976.310221:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191976.311290:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812497152 00000100:00100000:1.0:1784191976.311305:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812497152 00000100:00100000:1.0:1784191976.311371:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 454 00000100:00100000:1.0:1784191976.311381:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:69108:x1870858812497152:12345-192.168.204.16@tcp:8:kworker.0 00010000:00020000:1.0:1784191976.311428:0:160166:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784191976.311513:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:69108:x1870858812497152:12345-192.168.204.16@tcp:8:kworker.0 Request processed in 131us (1305us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784191976.311521:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 454 00010000:00010000:3.0:1784191976.525070:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784191977.547868:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784191978.574160:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191979.532315:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784191979.532340:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828026112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784191979.532425:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191979.532570:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828026112 00000100:00100000:2.0:1784191979.532579:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828026112 00000100:00100000:2.0:1784191979.532646:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:2.0:1784191979.532658:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828026112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784191979.532738:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:2.0:1784191979.532790:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828026112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191979.532797:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:1.0:1784191979.532985:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828026112:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784191979.596991:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191980.044108:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828026240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784191980.044198:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191980.044314:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828026240 00000100:00100000:3.0:1784191980.044323:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828026240 00000100:00100000:3.0:1784191980.044385:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:3.0:1784191980.044395:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828026240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784191980.044439:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:3.0:1784191980.044501:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828026240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191980.044510:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:3.0:1784191980.044565:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828026240:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1784191980.044859:0:165779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784191980.044863:0:165779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784191980.044867:0:165779:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784191980.044872:0:165779:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 5595 00000100:00080000:1.0:1784191980.044877:0:165779:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784191980.044881:0:165779:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8af23f2d8800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191980.044916:0:165779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af10ec85500 x1870858828026752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784191980.044961:0:165779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784191980.044970:0:165779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784191980.044972:0:165779:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784191980.044975:0:165779:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 5595 00000100:00080000:1.0:1784191980.044977:0:165779:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784191980.044981:0:165779:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8af2029fa800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191980.044994:0:165779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af10ec84e00 x1870858828027264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784191980.045051:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828026496:0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.045090:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191980.045114:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828027136:0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.045137:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191980.045155:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784191980.045160:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828026368:0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.045187:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191980.045209:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858828027008:0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.045231:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191980.045255:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828026752:0@lo:8:kworker.0 00000100:00100000:1.0:1784191980.045280:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191980.045298:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858828027264:0@lo:8:kworker.0 00000100:00100000:1.0:1784191980.045318:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191980.045362:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828026496 00000100:00100000:1.0:1784191980.045367:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828026496 00000100:00100000:1.0:1784191980.045407:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828027008 00000100:00100000:1.0:1784191980.045410:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828027008 00000100:00100000:1.0:1784191980.045428:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1784191980.045435:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828026496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.045486:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828026496:12345-0@lo:400:kworker.0 Request processed in 51us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191980.045493:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1784191980.045509:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1784191980.045515:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858828027008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.045540:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858828027008:12345-0@lo:400:kworker.0 Request processed in 26us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191980.045546:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1784191980.045564:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828026368 00000100:00100000:1.0:1784191980.045567:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828026368 00000100:00100000:1.0:1784191980.045594:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784191980.045600:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cfd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:106502:x1870858828026368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.045629:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cfd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:106502:x1870858828026368:12345-0@lo:400:kworker.0 Request processed in 29us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191980.045635:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784191980.045662:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828026752 00000100:00100000:1.0:1784191980.045666:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828026752 00000100:00100000:1.0:1784191980.045684:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828027264 00000100:00100000:1.0:1784191980.045711:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828027264 00000100:00100000:1.0:1784191980.045727:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1784191980.045731:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:106498:x1870858828026752:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1784191980.045751:0:162396:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784191980.045786:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:106498:x1870858828026752:12345-0@lo:8:kworker.0 Request processed in 52us (504us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784191980.045793:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1784191980.045805:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1784191980.045816:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:106498:x1870858828027264:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1784191980.045828:0:162396:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784191980.045851:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:106498:x1870858828027264:12345-0@lo:8:kworker.0 Request processed in 34us (533us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784191980.045857:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00080000:1.0:1784191980.045877:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784191980.045933:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784191980.045938:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784191980.045941:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828026752:0@lo:8:kworker.0 00000100:00080000:1.0:1784191980.045950:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784191980.045954:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784191980.045957:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858828027264:0@lo:8:kworker.0 00000100:00100000:1.0:1784191980.045985:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828026368:0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.045996:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858828027008:0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.046006:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828026496:0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.046029:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828026880:0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.046057:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191980.046076:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:106500:1870858828027520:0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.046097:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191980.046115:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784191980.046121:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828026624:0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.046139:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191980.046154:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828027392:0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.046185:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191980.046212:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828026880 00000100:00100000:1.0:1784191980.046216:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828026880 00000100:00100000:1.0:1784191980.046245:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828027392 00000100:00100000:1.0:1784191980.046248:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828027392 00000100:00100000:1.0:1784191980.046268:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1784191980.046274:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1051f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828026880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.046308:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1051f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828026880:12345-0@lo:400:kworker.0 Request processed in 34us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191980.046314:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1784191980.046446:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1784191980.046452:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828027392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.046480:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828027392:12345-0@lo:400:kworker.0 Request processed in 28us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191980.046486:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1784191980.046504:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828027520 00000100:00100000:1.0:1784191980.046507:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828027520 00000100:00100000:1.0:1784191980.046527:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828026624 00000100:00100000:1.0:1784191980.046529:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828026624 00000100:00100000:1.0:1784191980.046548:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1784191980.046553:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:106500:x1870858828027520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.046583:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:106500:x1870858828027520:12345-0@lo:400:kworker.0 Request processed in 29us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191980.046589:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1784191980.046600:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:1.0:1784191980.046606:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828026624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.046628:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828026624:12345-0@lo:400:kworker.0 Request processed in 23us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191980.046640:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:2.0:1784191980.046646:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828027136 00000100:00100000:2.0:1784191980.046649:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828027136 00000100:00080000:1.0:1784191980.046669:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784191980.046672:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784191980.046675:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:2.0:1784191980.046682:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828027136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.046706:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828026624:0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.046718:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828027392:0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.046726:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828026880:0@lo:400:kworker.0 00000100:00100000:1.0:1784191980.046735:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:106500:1870858828027520:0@lo:400:kworker.0 00000100:00100000:2.0:1784191980.046752:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828027136:12345-0@lo:400:kworker.0 Request processed in 70us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191980.046759:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:2.0:1784191980.046791:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828027136:0@lo:400:kworker.0 00000100:00100000:2.0:1784191980.046801:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784191980.046943:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828027648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784191980.046974:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191980.048225:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828027648 00000100:00100000:1.0:1784191980.048239:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828027648 00000100:00100000:1.0:1784191980.048296:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1784191980.048306:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828027648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784191980.048342:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784191980.048423:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828027648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191980.048431:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1784191980.050033:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828027648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784191980.557567:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784191980.557591:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828027776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784191980.557659:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191980.557724:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828027776 00000100:00100000:1.0:1784191980.557733:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828027776 00000100:00100000:1.0:1784191980.557790:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1784191980.557798:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828027776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784191980.557822:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2715648 granted 59446336 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784191980.557867:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828027776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191980.557894:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1784191980.557943:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828027776:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784191980.623353:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784191981.105269:0:169524:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784191981.105275:0:169524:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1784191981.105277:0:169524:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1784191981.105390:0:169524:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8af23f60d800 00000020:01000004:3.0:1784191981.105407:0:169524:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1784191981.105424:0:169524:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1784191981.105440:0:169524:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8af105a799c0) 00000020:00000080:3.0:1784191981.107105:0:169524:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1784191981.173548:0:169524:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1784191981.180852:0:169524:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1784191981.183587:0:169524:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1784191981.184462:0:169524:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1784191981.184898:0:169524:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1784191981.185137:0:169524:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1784191981.185611:0:169524:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1784191981.188240:0:169524:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784191981.188608:0:169524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1784191981.188626:0:169524:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784191981.188642:0:169524:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfeec3c2dc5a4d5e1 00000020:01000004:1.0:1784191981.188649:0:169524:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1784191981.188674:0:169524:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.116@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1784191981.188678:0:169524:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1784191981.188686:0:169524:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1784191981.189315:0:169524:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1784191981.189321:0:169524:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.116@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1784191981.201117:0:169524:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.116@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784191981.201171:0:169524:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.116@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1784191981.201176:0:169524:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784191981.201178:0:169524:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784191981.201179:0:169524:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784191981.201181:0:169524:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784191981.201182:0:169524:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784191981.201183:0:169524:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784191981.201184:0:169524:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784191981.201186:0:169524:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784191981.201187:0:169524:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784191981.201192:0:169524:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1784191981.201194:0:169524:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784191981.201196:0:169524:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784191981.201197:0:169524:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784191981.201198:0:169524:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784191981.201199:0:169524:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784191981.201206:0:169524:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784191981.201207:0:169524:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784191981.201208:0:169524:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784191981.201209:0:169524:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784191981.201239:0:169524:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784191981.201266:0:169524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828027904:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784191981.201368:0:169524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191981.201429:0:169524:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e69e300 going to sleep for 11 seconds 00000100:00100000:0.0:1784191981.201977:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828027904 00000100:00100000:0.0:1784191981.201988:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828027904 00000100:00100000:0.0:1784191981.202057:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784191981.202068:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:169524:x1870858828027904:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784191981.202107:0:167178:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784191981.202111:0:167178:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1784191981.202115:0:167178:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1784191981.202731:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:169524:x1870858828027904:12345-0@lo:253:mount.lustre.0 Request processed in 662us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191981.202741:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784191981.202841:0:169524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828027904:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784191981.202854:0:169524:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1784191981.202857:0:169524:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784191981.202859:0:169524:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784191981.202860:0:169524:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784191981.202862:0:169524:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784191981.202863:0:169524:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784191981.202864:0:169524:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784191981.202865:0:169524:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784191981.202867:0:169524:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784191981.202868:0:169524:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784191981.202902:0:169524:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8af23f60d800 from lustre-OST0000 10000000:01000000:2.0:1784191981.202930:0:169524:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1784191981.202933:0:169524:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1784191981.202942:0:169524:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8af107b719c0 local copy 00010000:00010000:2.0:1784191981.202953:0:169524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d08e000/0xfeec3c2dc5a4d309 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d310 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784191981.203062:0:169524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828028032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784191981.203099:0:169524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191981.203137:0:169524:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af23e69e180 going to sleep for 11 seconds 00000100:00100000:1.0:1784191981.203199:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828028032 00000100:00100000:1.0:1784191981.203204:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828028032 00000100:00100000:1.0:1784191981.203245:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784191981.203252:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:169524:x1870858828028032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784191981.203336:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:169524:x1870858828028032:12345-0@lo:501:mount.lustre.0 Request processed in 84us (236us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784191981.203344:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784191981.203922:0:169524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828028032:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784191981.203939:0:169524:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784191981.203965:0:169524:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784191981.203972:0:169524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10d08e000/0xfeec3c2dc5a4d309 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d310 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191981.203981:0:169524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af10d08e000/0xfeec3c2dc5a4d309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d310 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784191981.204026:0:169524:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8af23f60d800 10000000:01000000:3.0:1784191981.204030:0:169524:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784191981.204064:0:169524:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784191981.204067:0:169524:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784191981.204071:0:169524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1784191981.204074:0:169524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784191981.204102:0:169524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b8a00/0xfeec3c2dc5a4d5e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191981.204110:0:169524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af1115b8a00/0xfeec3c2dc5a4d5e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191981.204121:0:169524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af1115b8a00/0xfeec3c2dc5a4d5e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191981.204139:0:169524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828028160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784191981.204184:0:169524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191981.204354:0:169524:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10c77b840 going to sleep for 11 seconds 00000100:00100000:0.0:1784191981.205153:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828028160 00000100:00100000:0.0:1784191981.205173:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828028160 00000100:00100000:3.0:1784191981.205330:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784191981.205338:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+21:169524:x1870858828028160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784191981.205351:0:167179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191981.205366:0:167179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af1115b8c00/0xfeec3c2dc5a4d5ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d5e8 expref: -99 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191981.205389:0:167179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af1115b8c00/0xfeec3c2dc5a4d5ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d5e8 expref: 22 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191981.205399:0:167179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af1115b8c00/0xfeec3c2dc5a4d5ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d5e8 expref: 22 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191981.205408:0:167179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af1115b8c00, rc 0) 00000100:00100000:3.0:1784191981.205479:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:169524:x1870858828028160:12345-0@lo:101:mount.lustre.0 Request processed in 141us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191981.205497:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784191981.205598:0:169524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828028160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784191981.205616:0:169524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af1115b8a00/0xfeec3c2dc5a4d5e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d5ef expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.205632:0:169524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af1115b8a00/0xfeec3c2dc5a4d5e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d5ef expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784191981.207632:0:169524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 14 count 14 00000040:00080000:1.0:1784191981.210284:0:169524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784191981.211176:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:1.0:1784191981.211215:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 128 off8544 00000040:00080000:1.0:1784191981.211230:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 112 off8656 00000040:00080000:1.0:1784191981.211243:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8880 00000040:00080000:1.0:1784191981.211258:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 224 off9104 00000040:00080000:1.0:1784191981.211271:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 80 off9184 00000040:00080000:1.0:1784191981.211283:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 224 off9408 00000040:00080000:1.0:1784191981.211295:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 224 off9632 00000040:00080000:1.0:1784191981.211307:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 80 off9712 00000040:00080000:1.0:1784191981.211319:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].10, 224 off9936 00000040:00080000:1.0:1784191981.211331:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].11, 224 off10160 00000040:00080000:1.0:1784191981.211344:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].12, 120 off10280 00000040:00080000:1.0:1784191981.211362:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].13, 224 off10504 00000040:00080000:1.0:1784191981.211367:0:169524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 13 count 14 00000100:00100000:1.0:1784191981.211989:0:169524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828028288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784191981.212075:0:169524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191981.212130:0:169524:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1102ffd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784191981.212278:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828028288 00000100:00100000:2.0:1784191981.212286:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828028288 00000100:00100000:2.0:1784191981.212347:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784191981.212357:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:169524:x1870858828028288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784191981.212530:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:169524:x1870858828028288:12345-0@lo:501:mount.lustre.0 Request processed in 174us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191981.212539:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784191981.212900:0:169524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828028288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784191981.212947:0:169524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828028416:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784191981.212994:0:169524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191981.213015:0:169524:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1102ffd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784191981.213193:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828028416 00000100:00100000:2.0:1784191981.213198:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828028416 00000100:00100000:2.0:1784191981.213234:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784191981.213242:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:169524:x1870858828028416:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784191981.213365:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:169524:x1870858828028416:12345-0@lo:503:mount.lustre.0 Request processed in 124us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191981.213372:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784191981.213465:0:169524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828028416:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784191981.214001:0:169524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784191981.214234:0:169524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828028544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784191981.214290:0:169524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191981.214320:0:169524:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1102ff300 going to sleep for 11 seconds 00000100:00100000:0.0:1784191981.214406:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828028544 00000100:00100000:0.0:1784191981.214412:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828028544 00000100:00100000:0.0:1784191981.214469:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784191981.214484:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:169524:x1870858828028544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784191981.215370:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:169524:x1870858828028544:12345-0@lo:502:mount.lustre.0 Request processed in 881us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191981.215382:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784191981.216021:0:169524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828028544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784191981.217021:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:1.0:1784191981.217146:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 128 off8544 00000040:00080000:1.0:1784191981.217161:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 112 off8656 00000040:00080000:1.0:1784191981.217174:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8880 00000040:00080000:1.0:1784191981.217185:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 224 off9104 00000040:00080000:1.0:1784191981.217198:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 80 off9184 00000040:00080000:1.0:1784191981.217208:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 224 off9408 00000040:00080000:1.0:1784191981.217221:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 224 off9632 00000040:00080000:1.0:1784191981.217233:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 80 off9712 00000040:00080000:1.0:1784191981.217244:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].10, 224 off9936 00000040:00080000:1.0:1784191981.217254:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].11, 224 off10160 00000040:00080000:1.0:1784191981.217266:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].12, 120 off10280 00000100:00100000:1.0:1784191981.217620:0:169524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828028672:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784191981.223719:0:169524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191981.223864:0:169524:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1102ff300 going to sleep for 11 seconds 00000100:00100000:2.0:1784191981.224407:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828028672 00000100:00100000:2.0:1784191981.224420:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828028672 00000100:00100000:2.0:1784191981.224721:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784191981.224735:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:169524:x1870858828028672:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784191981.224966:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:169524:x1870858828028672:12345-0@lo:502:mount.lustre.0 Request processed in 234us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191981.224975:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784191981.225143:0:169524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828028672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784191981.225269:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].13, 224 off10504 00000040:00080000:0.0:1784191981.225287:0:169524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1784191981.228940:0:169528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784191981.228958:0:169528:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1784191981.228966:0:169528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784191981.228969:0:169528:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1784191981.228981:0:169528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784191981.229002:0:169528:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8af23e68cd40) 00000020:00000080:2.0:1784191981.229038:0:169528:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1784191981.229058:0:169528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784191981.229144:0:169528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af23f60d800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1784191981.229159:0:169528:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784191981.229167:0:169528:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfeec3c2dc5a4d5fd 00010000:00010000:3.0:1784191981.238525:0:169528:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00080000:3.0:1784191981.239910:0:169528:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 21474836544 srv lr: 21474836569 lx: 1870858827915392 gen 0 00000001:00080000:3.0:1784191981.239966:0:169528:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 21474836603 srv lr: 21474836569 lx: 1870858828009856 gen 0 00000001:00080000:3.0:1784191981.239981:0:169528:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a idx: 2 lr: 21474836601 srv lr: 21474836569 lx: 1870858812487552 gen 0 00000001:00000004:3.0:1784191981.240008:0:169528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 21474836603 00080000:10000000:3.0:1784191981.244274:0:169528:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xe:0x0] (8/32) registered 00000020:00000080:1.0:1784191981.253290:0:169528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1784191981.253318:0:169528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784191981.253326:0:169528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191981.253329:0:169528:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1784191981.253336:0:169528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784191981.253339:0:169528:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1784191981.253340:0:169528:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784191981.253342:0:169528:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784191981.253343:0:169528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784191981.253346:0:169528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191981.253348:0:169528:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784191981.253351:0:169528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784191981.253369:0:169528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191981.253371:0:169528:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784191981.253375:0:169528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784191981.253377:0:169528:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784191981.253379:0:169528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784191981.253382:0:169528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191981.253383:0:169528:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1784191981.253386:0:169528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784191981.253388:0:169528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191981.253389:0:169528:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784191981.253392:0:169528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1784191981.253433:0:169528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784191981.253436:0:169528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784191981.253437:0:169528:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784191981.253441:0:169528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 14 count 14 00000020:01000000:3.0:1784191981.255371:0:169524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1784191981.255414:0:169524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784191981.255440:0:169524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b8a00/0xfeec3c2dc5a4d5e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d5ef expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191981.255455:0:169524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af1115b8a00/0xfeec3c2dc5a4d5e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d5ef expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784191981.255463:0:169524:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8af23f60d800 from 1 10000000:01000000:3.0:1784191981.255467:0:169524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784191981.255508:0:169524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b8800/0xfeec3c2dc5a4d619 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191981.255517:0:169524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af1115b8800/0xfeec3c2dc5a4d619 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191981.255529:0:169524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af1115b8800/0xfeec3c2dc5a4d619 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191981.255559:0:169524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828028800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784191981.255658:0:169524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191981.255747:0:169524:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af219aaa600 going to sleep for 11 seconds 00000100:00100000:0.0:1784191981.263211:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828028800 00000100:00100000:0.0:1784191981.263229:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828028800 00000100:00100000:0.0:1784191981.263311:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784191981.263327:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:169524:x1870858828028800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784191981.263347:0:167181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191981.263370:0:167181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af2204b7000/0xfeec3c2dc5a4d620 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d619 expref: -99 pid: 167181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191981.263406:0:167181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af2204b7000/0xfeec3c2dc5a4d620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d619 expref: 23 pid: 167181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191981.263417:0:167181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af2204b7000/0xfeec3c2dc5a4d620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d619 expref: 23 pid: 167181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191981.263426:0:167181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af2204b7000, rc 0) 00000100:00100000:0.0:1784191981.263587:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:169524:x1870858828028800:12345-0@lo:101:mount.lustre.0 Request processed in 262us (7929us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191981.263595:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784191981.270957:0:169524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828028800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784191981.270995:0:169524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af1115b8800/0xfeec3c2dc5a4d619 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d620 expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191981.271011:0:169524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af1115b8800/0xfeec3c2dc5a4d619 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d620 expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784191981.287061:0:169524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 7 count 7 00000040:00080000:3.0:1784191981.288416:0:169524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784191981.288905:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].1, 224 off8416 00000040:00080000:3.0:1784191981.288931:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].2, 112 off8528 00000040:00080000:3.0:1784191981.288942:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].3, 224 off8752 00000040:00080000:3.0:1784191981.288952:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].4, 224 off8976 00000040:00080000:3.0:1784191981.288963:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].5, 112 off9088 00000040:00080000:3.0:1784191981.288980:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].6, 224 off9312 00000040:00080000:3.0:1784191981.288985:0:169524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 6 count 7 00000100:00100000:3.0:1784191981.289461:0:169524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828028928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784191981.289535:0:169524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191981.289658:0:169524:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af11183e900 going to sleep for 11 seconds 00000100:00100000:0.0:1784191981.289882:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828028928 00000100:00100000:0.0:1784191981.289904:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828028928 00000100:00100000:0.0:1784191981.289957:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784191981.289966:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:169524:x1870858828028928:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784191981.290127:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:169524:x1870858828028928:12345-0@lo:501:mount.lustre.0 Request processed in 161us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191981.290136:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784191981.290554:0:169524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828028928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784191981.290631:0:169524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828029056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784191981.290744:0:169524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191981.290777:0:169524:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af11183e900 going to sleep for 11 seconds 00000100:00100000:0.0:1784191981.291087:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828029056 00000100:00100000:0.0:1784191981.291095:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828029056 00000100:00100000:0.0:1784191981.291147:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784191981.291452:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:169524:x1870858828029056:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784191981.291613:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:169524:x1870858828029056:12345-0@lo:503:mount.lustre.0 Request processed in 457us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191981.291621:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784191981.291727:0:169524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828029056:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784191981.292214:0:169524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784191981.292299:0:169524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828029184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784191981.292475:0:169524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191981.292511:0:169524:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af11183e900 going to sleep for 11 seconds 00000100:00100000:0.0:1784191981.292834:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828029184 00000100:00100000:0.0:1784191981.292841:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828029184 00000100:00100000:0.0:1784191981.292890:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784191981.292900:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:169524:x1870858828029184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784191981.293002:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:169524:x1870858828029184:12345-0@lo:502:mount.lustre.0 Request processed in 103us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191981.293009:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784191981.293266:0:169524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828029184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784191981.293617:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:3.0:1784191981.293647:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 112 off8528 00000040:00080000:3.0:1784191981.293658:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 224 off8752 00000040:00080000:3.0:1784191981.293669:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8976 00000040:00080000:3.0:1784191981.293680:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 112 off9088 00000100:00100000:3.0:1784191981.293739:0:169524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828029312:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784191981.293781:0:169524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191981.293810:0:169524:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af11183e900 going to sleep for 11 seconds 00000100:00100000:0.0:1784191981.293949:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828029312 00000100:00100000:0.0:1784191981.293954:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828029312 00000100:00100000:0.0:1784191981.294035:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784191981.294051:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:169524:x1870858828029312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784191981.294148:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:169524:x1870858828029312:12345-0@lo:502:mount.lustre.0 Request processed in 105us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191981.294174:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784191981.294617:0:169524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828029312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784191981.294677:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 224 off9312 00000040:00080000:3.0:1784191981.294715:0:169524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:3.0:1784191981.296003:0:169532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784191981.296019:0:169532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784191981.296022:0:169532:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784191981.296030:0:169532:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8af23f60d800 00000020:00000080:3.0:1784191981.296034:0:169532:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784191981.296054:0:169532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784191981.296058:0:169532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784191981.296059:0:169532:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784191981.296062:0:169532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784191981.296065:0:169532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784191981.296066:0:169532:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784191981.296069:0:169532:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8af23f60d800 00000020:00000080:3.0:1784191981.296071:0:169532:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784191981.296151:0:169532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784191981.296179:0:169532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784191981.296180:0:169532:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784191981.296185:0:169532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 7 count 7 00000020:01000000:0.0:1784191981.299882:0:169524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1784191981.299946:0:169524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784191981.299976:0:169524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af1115b8800/0xfeec3c2dc5a4d619 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d620 expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191981.299992:0:169524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af1115b8800/0xfeec3c2dc5a4d619 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d620 expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784191981.300998:0:169524:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784191981.301008:0:169524:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8af23f60d800 10000000:01000000:0.0:1784191981.301013:0:169524:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8af23f60d800 10000000:01000000:0.0:1784191981.301018:0:169524:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784191981.301025:0:169524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8af23f60d800 from 1 10000000:01000000:0.0:1784191981.301028:0:169524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784191981.301572:0:169524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af2204b7800/0xfeec3c2dc5a4d627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191981.301586:0:169524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af2204b7800/0xfeec3c2dc5a4d627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191981.301601:0:169524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af2204b7800/0xfeec3c2dc5a4d627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191981.301631:0:169524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828029440:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784191981.302235:0:169524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191981.302297:0:169524:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111d08240 going to sleep for 11 seconds 00000100:00100000:2.0:1784191981.302435:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828029440 00000100:00100000:2.0:1784191981.302527:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828029440 00000100:00100000:2.0:1784191981.302598:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784191981.302609:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:169524:x1870858828029440:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784191981.302627:0:167176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784191981.302645:0:167176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af233127400/0xfeec3c2dc5a4d62e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d627 expref: -99 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191981.302675:0:167176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af233127400/0xfeec3c2dc5a4d62e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d627 expref: 24 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191981.302715:0:167176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af233127400/0xfeec3c2dc5a4d62e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d627 expref: 24 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191981.302724:0:167176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af233127400, rc 0) 00000100:00100000:2.0:1784191981.302772:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:169524:x1870858828029440:12345-0@lo:101:mount.lustre.0 Request processed in 165us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191981.302779:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784191981.302892:0:169524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828029440:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784191981.302925:0:169524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af2204b7800/0xfeec3c2dc5a4d627 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d62e expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191981.302935:0:169524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af2204b7800/0xfeec3c2dc5a4d627 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d62e expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784191981.311658:0:169524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 52 count 51 00000040:00080000:0.0:1784191981.312097:0:169524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784191981.312350:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:0.0:1784191981.312377:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 120 off8536 00000040:00080000:0.0:1784191981.312392:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 168 off8704 00000040:00080000:0.0:1784191981.312407:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8928 00000040:00080000:0.0:1784191981.312423:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 224 off9152 00000040:00080000:0.0:1784191981.312438:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 120 off9272 00000040:00080000:0.0:1784191981.312771:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].7, 168 off9440 00000040:00080000:0.0:1784191981.312789:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].8, 224 off9664 00000040:00080000:0.0:1784191981.312801:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].9, 224 off9888 00000040:00080000:0.0:1784191981.312886:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].10, 120 off10008 00000040:00080000:0.0:1784191981.312901:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].11, 224 off10232 00000040:00080000:0.0:1784191981.312917:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].12, 224 off10456 00000040:00080000:0.0:1784191981.312929:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].13, 88 off10544 00000040:00080000:0.0:1784191981.312940:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].14, 128 off10672 00000040:00080000:0.0:1784191981.312952:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].15, 144 off10816 00000040:00080000:0.0:1784191981.312964:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].16, 160 off10976 00000040:00080000:0.0:1784191981.312978:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].17, 224 off11200 00000040:00080000:0.0:1784191981.312992:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].18, 224 off11424 00000040:00080000:0.0:1784191981.313006:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].19, 80 off11504 00000040:00080000:0.0:1784191981.313020:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].20, 224 off11728 00000040:00080000:0.0:1784191981.313034:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].21, 224 off11952 00000040:00080000:0.0:1784191981.313117:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].22, 88 off12040 00000040:00080000:0.0:1784191981.313132:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].23, 128 off12168 00000040:00080000:0.0:1784191981.313163:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].24, 144 off12312 00000040:00080000:0.0:1784191981.313178:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].25, 160 off12472 00000040:00080000:0.0:1784191981.313193:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].26, 224 off12696 00000040:00080000:0.0:1784191981.313208:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].27, 224 off12920 00000040:00080000:0.0:1784191981.313221:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].28, 80 off13000 00000040:00080000:0.0:1784191981.313232:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].29, 224 off13224 00000040:00080000:0.0:1784191981.313248:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].30, 224 off13448 00000040:00080000:0.0:1784191981.313261:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].31, 88 off13536 00000040:00080000:0.0:1784191981.313274:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].32, 128 off13664 00000040:00080000:0.0:1784191981.313288:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].33, 144 off13808 00000040:00080000:0.0:1784191981.316260:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].34, 128 off13936 00000040:00080000:0.0:1784191981.316337:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].35, 224 off14160 00000040:00080000:0.0:1784191981.316356:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].36, 224 off14384 00000040:00080000:0.0:1784191981.316369:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].37, 80 off14464 00000040:00080000:0.0:1784191981.316389:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].38, 224 off14688 00000040:00080000:0.0:1784191981.316406:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].39, 224 off14912 00000040:00080000:0.0:1784191981.316420:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].40, 88 off15000 00000040:00080000:0.0:1784191981.316434:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].41, 128 off15128 00000040:00080000:0.0:1784191981.316448:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].42, 144 off15272 00000040:00080000:0.0:1784191981.316462:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].43, 128 off15400 00000040:00080000:0.0:1784191981.316475:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].44, 224 off15624 00000040:00080000:0.0:1784191981.316510:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].45, 224 off15848 00000040:00080000:0.0:1784191981.316524:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].46, 80 off15928 00000040:00080000:0.0:1784191981.316539:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].47, 224 off16152 00000040:00080000:0.0:1784191981.316552:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].48, 232 off16384 00000040:00080000:0.0:1784191981.316772:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].49, 224 off16608 00000040:00080000:0.0:1784191981.316794:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].50, 120 off16728 00000040:00080000:0.0:1784191981.316812:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].51, 224 off16952 00000040:00080000:0.0:1784191981.316817:0:169524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 51 count 51 00000100:00100000:0.0:1784191981.316980:0:169524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828029568:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784191981.317067:0:169524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191981.317122:0:169524:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111d08480 going to sleep for 11 seconds 00000100:00100000:2.0:1784191981.322730:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828029568 00000100:00100000:2.0:1784191981.322748:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828029568 00000100:00100000:2.0:1784191981.322819:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784191981.322830:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:169524:x1870858828029568:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784191981.323280:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:169524:x1870858828029568:12345-0@lo:501:mount.lustre.0 Request processed in 449us (6210us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191981.323289:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784191981.323420:0:169524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828029568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784191981.323496:0:169524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828029696:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784191981.323562:0:169524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191981.323608:0:169524:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1102ffcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191981.323829:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828029696 00000100:00100000:3.0:1784191981.323836:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828029696 00000100:00100000:3.0:1784191981.323888:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784191981.323898:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+25:169524:x1870858828029696:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784191981.323990:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+25:169524:x1870858828029696:12345-0@lo:503:mount.lustre.0 Request processed in 93us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191981.323997:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784191981.324163:0:169524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828029696:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784191981.324652:0:169524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784191981.324999:0:169524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828029824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784191981.325154:0:169524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191981.325334:0:169524:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1102ffcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191981.325487:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828029824 00000100:00100000:2.0:1784191981.325495:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828029824 00000100:00100000:3.0:1784191981.328176:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784191981.328207:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:169524:x1870858828029824:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784191981.328535:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:169524:x1870858828029824:12345-0@lo:502:mount.lustre.0 Request processed in 342us (3381us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191981.328543:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784191981.328714:0:169524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828029824:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784191981.328987:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:1.0:1784191981.329025:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 120 off8536 00000040:00080000:1.0:1784191981.329037:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 168 off8704 00000040:00080000:1.0:1784191981.330575:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8928 00000040:00080000:1.0:1784191981.330609:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 224 off9152 00000040:00080000:1.0:1784191981.330625:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 120 off9272 00000040:00080000:1.0:1784191981.330642:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].7, 168 off9440 00000040:00080000:1.0:1784191981.330656:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].8, 224 off9664 00000040:00080000:1.0:1784191981.330670:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].9, 224 off9888 00000040:00080000:1.0:1784191981.330682:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].10, 120 off10008 00000040:00080000:1.0:1784191981.330722:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].11, 224 off10232 00000040:00080000:1.0:1784191981.330742:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].12, 224 off10456 00000040:00080000:1.0:1784191981.330757:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].13, 88 off10544 00000040:00080000:1.0:1784191981.330772:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].14, 128 off10672 00000040:00080000:1.0:1784191981.330785:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].15, 144 off10816 00000040:00080000:1.0:1784191981.330798:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].16, 160 off10976 00000040:00080000:1.0:1784191981.330812:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].17, 224 off11200 00000040:00080000:1.0:1784191981.330826:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].18, 224 off11424 00000040:00080000:1.0:1784191981.330839:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].19, 80 off11504 00000040:00080000:1.0:1784191981.330852:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].20, 224 off11728 00000040:00080000:1.0:1784191981.330864:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].21, 224 off11952 00000040:00080000:1.0:1784191981.330893:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].22, 88 off12040 00000040:00080000:1.0:1784191981.330908:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].23, 128 off12168 00000040:00080000:1.0:1784191981.330923:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].24, 144 off12312 00000040:00080000:1.0:1784191981.330937:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].25, 160 off12472 00000040:00080000:1.0:1784191981.330951:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].26, 224 off12696 00000040:00080000:1.0:1784191981.330964:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].27, 224 off12920 00000040:00080000:1.0:1784191981.330977:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].28, 80 off13000 00000040:00080000:1.0:1784191981.330991:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].29, 224 off13224 00000040:00080000:1.0:1784191981.331005:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].30, 224 off13448 00000040:00080000:1.0:1784191981.331018:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].31, 88 off13536 00000040:00080000:1.0:1784191981.331032:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].32, 128 off13664 00000040:00080000:1.0:1784191981.336626:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].33, 144 off13808 00000040:00080000:1.0:1784191981.336679:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].34, 128 off13936 00000040:00080000:1.0:1784191981.336719:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].35, 224 off14160 00000040:00080000:1.0:1784191981.336736:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].36, 224 off14384 00000040:00080000:1.0:1784191981.336749:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].37, 80 off14464 00000040:00080000:1.0:1784191981.336781:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].38, 224 off14688 00000040:00080000:1.0:1784191981.336794:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].39, 224 off14912 00000040:00080000:1.0:1784191981.336806:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].40, 88 off15000 00000040:00080000:1.0:1784191981.336819:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].41, 128 off15128 00000040:00080000:1.0:1784191981.336831:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].42, 144 off15272 00000040:00080000:1.0:1784191981.336843:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].43, 128 off15400 00000040:00080000:1.0:1784191981.336855:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].44, 224 off15624 00000040:00080000:1.0:1784191981.336880:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].45, 224 off15848 00000040:00080000:1.0:1784191981.336896:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].46, 80 off15928 00000040:00080000:1.0:1784191981.336909:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].47, 224 off16152 00000040:00080000:1.0:1784191981.336923:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].48, 232 off16384 00000100:00100000:1.0:1784191981.337000:0:169524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828029952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784191981.339671:0:169524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191981.339804:0:169524:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1102ffcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191981.346901:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828029952 00000100:00100000:3.0:1784191981.346920:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828029952 00000100:00100000:3.0:1784191981.346995:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784191981.347006:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:169524:x1870858828029952:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784191981.347456:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:169524:x1870858828029952:12345-0@lo:502:mount.lustre.0 Request processed in 441us (7784us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191981.347466:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784191981.347649:0:169524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828029952:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784191981.347931:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].49, 224 off16608 00000040:00080000:1.0:1784191981.347961:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].50, 120 off16728 00000100:00100000:1.0:1784191981.348005:0:169524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828030080:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784191981.348059:0:169524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191981.348111:0:169524:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1102ffcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191981.348250:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828030080 00000100:00100000:2.0:1784191981.348256:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828030080 00000100:00100000:2.0:1784191981.348317:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784191981.348327:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:169524:x1870858828030080:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784191981.348436:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:169524:x1870858828030080:12345-0@lo:502:mount.lustre.0 Request processed in 111us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191981.348444:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784191981.348597:0:169524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828030080:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784191981.348646:0:169524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].51, 224 off16952 00000040:00080000:1.0:1784191981.348655:0:169524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1784191981.351392:0:169535:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1784191981.351412:0:169535:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8af10ca04d40) 00000020:00000080:1.0:1784191981.351442:0:169535:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1784191981.351741:0:169535:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af23f60d800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784191981.351746:0:169535:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af23f60d800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784191981.351760:0:169535:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af23f60d800 3 00010000:00080000:1.0:1784191981.351794:0:169535:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af10de03000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.116@tcp at head 00010000:00010000:1.0:1784191981.363214:0:169535:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000080:1.0:1784191981.363381:0:169535:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1784191981.363440:0:169535:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784191981.370627:0:169535:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xfeec3c2dc5a4d63c 00000100:00080000:1.0:1784191981.370650:0:169535:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784191981.370657:0:169535:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8af10de03000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191981.370736:0:169535:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af10ec85f80 x1870858828030208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784191981.370767:0:169535:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784191981.370847:0:165779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784191981.370852:0:165779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784191981.370854:0:165779:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784191981.370858:0:165779:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 5600 00000100:00080000:1.0:1784191981.370862:0:165779:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784191981.370866:0:165779:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8af23f2d8800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191981.370895:0:165779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af10ec86a00 x1870858828030720/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784191981.370925:0:165779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784191981.370929:0:165779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784191981.370931:0:165779:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784191981.370935:0:165779:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 5600 00000100:00080000:1.0:1784191981.370938:0:165779:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784191981.370942:0:165779:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8af2029fa800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191981.370955:0:165779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af233108700 x1870858828031232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784191981.371020:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858828030336:0@lo:400:kworker.0 00000100:00100000:3.0:1784191981.371206:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:106498:1870858828030208:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784191981.377301:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191981.377370:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828030720:0@lo:8:kworker.0 00000100:00100000:2.0:1784191981.377412:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191981.377429:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858828031232:0@lo:8:kworker.0 00000100:00100000:2.0:1784191981.377458:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191981.377924:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828030208 00000100:00100000:3.0:1784191981.377936:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828030208 00000100:00100000:3.0:1784191981.377987:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:3.0:1784191981.377996:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:106498:x1870858828030208:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1784191981.378041:0:164531:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 5601 last 0 00000020:00000080:3.0:1784191981.378172:0:164531:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xfeec3c2dc5a4d643 00000004:00100000:3.0:1784191981.378193:0:164531:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784191981.378238:0:164531:0:(import.c:65:import_set_state_nolock()) ffff8af20d952000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784191981.378321:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:106498:x1870858828030208:12345-0@lo:38:llog_process_th.0 Request processed in 325us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191981.378329:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:3.0:1784191981.378356:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828030720 00000100:00100000:3.0:1784191981.378359:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828030720 00000100:00100000:3.0:1784191981.378375:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828031232 00000100:00100000:3.0:1784191981.378377:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828031232 00000100:00100000:3.0:1784191981.378391:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:3.0:1784191981.378395:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:106498:x1870858828030720:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1784191981.378434:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:106498:x1870858828030720:12345-0@lo:8:kworker.0 Request processed in 37us (1021us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784191981.378440:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1784191981.379644:0:106498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784191981.379665:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 9 00000100:00080000:2.0:1784191981.379675:0:106498:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1784191981.379683:0:106498:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784191981.379703:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af10de03000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784191981.379715:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:106498:1870858828030208:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1784191981.379738:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784191981.379743:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784191981.379746:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828030720:0@lo:8:kworker.0 00000100:00100000:1.0:1784191981.380260:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191981.380318:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858828030976:0@lo:400:kworker.0 00000100:00100000:1.0:1784191981.380358:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191981.380388:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784191981.380394:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858828030464:0@lo:400:kworker.0 00000100:00100000:1.0:1784191981.380416:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191981.380437:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828031104:0@lo:400:kworker.0 00000100:00100000:3.0:1784191981.381185:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1784191981.381201:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:106498:x1870858828031232:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1784191981.381297:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:106498:x1870858828031232:12345-0@lo:8:kworker.0 Request processed in 97us (3836us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784191981.381305:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1784191981.381353:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828030336 00000100:00100000:3.0:1784191981.381361:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828030336 00000100:00100000:3.0:1784191981.381403:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828030976 00000100:00100000:3.0:1784191981.381406:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828030976 00000100:00100000:3.0:1784191981.381418:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828030464 00000100:00100000:3.0:1784191981.381420:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828030464 00000100:00100000:3.0:1784191981.381433:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1784191981.382189:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858828030336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191981.382259:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858828030336:12345-0@lo:400:kworker.0 Request processed in 812us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191981.382267:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1784191981.382291:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:3.0:1784191981.382298:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858828030976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191981.382329:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858828030976:12345-0@lo:400:kworker.0 Request processed in 31us (1971us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191981.382336:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:3.0:1784191981.382348:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1784191981.382354:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858828030464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191981.382383:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858828030464:12345-0@lo:400:kworker.0 Request processed in 30us (1966us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191981.382389:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1784191981.382593:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191981.382650:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858828030336:0@lo:400:kworker.0 00000100:00100000:1.0:1784191981.382664:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858828030976:0@lo:400:kworker.0 00000100:00100000:1.0:1784191981.382708:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858828030464:0@lo:400:kworker.0 00000100:00100000:1.0:1784191981.382736:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828030592:0@lo:400:kworker.0 00000100:00100000:1.0:1784191981.382764:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191981.382784:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828031360:0@lo:400:kworker.0 00000100:00100000:1.0:1784191981.382804:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191981.382828:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784191981.382836:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828030848:0@lo:400:kworker.0 00000100:00100000:1.0:1784191981.382857:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191981.382892:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858828031488:0@lo:400:kworker.0 00000100:00100000:1.0:1784191981.382917:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191981.382959:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828031488 00000100:00100000:1.0:1784191981.382980:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828031488 00000100:00100000:1.0:1784191981.383019:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1784191981.383026:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858828031488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191981.383069:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858828031488:12345-0@lo:400:kworker.0 Request processed in 44us (151us total) trans 0 rc 0/0 00000100:00080000:3.0:1784191981.383562:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784191981.383569:0:106498:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784191981.383573:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858828031232:0@lo:8:kworker.0 00000100:00100000:3.0:1784191981.383604:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828031104 00000100:00100000:3.0:1784191981.383609:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828031104 00000100:00100000:3.0:1784191981.383710:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828030592 00000100:00100000:3.0:1784191981.383714:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828030592 00000100:00100000:1.0:1784191981.386023:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:0.0:1784191981.386685:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858828031488:0@lo:400:kworker.0 00000100:00100000:2.0:1784191981.387108:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:2.0:1784191981.387128:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828031104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191981.387247:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828031104:12345-0@lo:400:kworker.0 Request processed in 127us (4652us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191981.387255:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:2.0:1784191981.387297:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:2.0:1784191981.387306:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828030592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191981.387353:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828030592:12345-0@lo:400:kworker.0 Request processed in 49us (4588us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191981.387360:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:2.0:1784191981.387391:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828030592:0@lo:400:kworker.0 00000100:00100000:0.0:1784191981.387634:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828031104:0@lo:400:kworker.0 00000100:00100000:3.0:1784191981.390143:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828031360 00000100:00100000:3.0:1784191981.390160:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828031360 00000100:00100000:3.0:1784191981.390217:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828030848 00000100:00100000:3.0:1784191981.390222:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828030848 00000100:00100000:3.0:1784191981.390255:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1784191981.390267:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828031360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191981.390417:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828031360:12345-0@lo:400:kworker.0 Request processed in 151us (7611us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191981.390426:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1784191981.391202:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1784191981.391219:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828030848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191981.391279:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828030848:12345-0@lo:400:kworker.0 Request processed in 67us (8419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191981.391286:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1784191981.392580:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828030848:0@lo:400:kworker.0 00000100:00100000:3.0:1784191981.392612:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828031360:0@lo:400:kworker.0 00000020:01000004:1.0:1784191981.392858:0:169535:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1784191981.392891:0:169535:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8af10ca019c0) 00000020:00000080:1.0:1784191981.392918:0:169535:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1784191981.395854:0:169535:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8af23f60d800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784191981.395864:0:169535:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8af23f60d800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784191981.395879:0:169535:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8af23f60d800 3 00010000:00080000:1.0:1784191981.395923:0:169535:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8af101781000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.116@tcp at head 00000100:00100000:3.0:1784191981.401660:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191981.401736:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191981.401759:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191981.401780:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191981.401823:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191981.401856:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812497408 00000100:00100000:3.0:1784191981.401881:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812497408 00000100:00100000:3.0:1784191981.401945:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 114 00000100:00100000:3.0:1784191981.401957:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812497408:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191981.402054:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812497408:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 97us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191981.402064:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 114 00000100:00100000:3.0:1784191981.402118:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812497792 00000100:00100000:3.0:1784191981.402123:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812497792 00000100:00100000:3.0:1784191981.402143:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812497920 00000100:00100000:3.0:1784191981.402146:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812497920 00000100:00100000:3.0:1784191981.402192:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 459 00000100:00100000:3.0:1784191981.402197:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:69108:x1870858812497792:12345-192.168.204.16@tcp:8:kworker.0 00000100:00100000:3.0:1784191981.402246:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:69108:x1870858812497792:12345-192.168.204.16@tcp:8:kworker.0 Request processed in 47us (464us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784191981.402252:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 459 00000100:00100000:3.0:1784191981.402288:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 460 00000100:00100000:3.0:1784191981.402295:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69108:x1870858812497920:12345-192.168.204.16@tcp:9:kworker.0 00000020:00000080:3.0:1784191981.402323:0:162396:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4b4e0 00000100:00080000:3.0:1784191981.402332:0:162396:0:(import.c:65:import_set_state_nolock()) ffff8af204c7c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784191981.402392:0:162396:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869281 00000100:00100000:3.0:1784191981.402538:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+2:69108:x1870858812497920:12345-192.168.204.16@tcp:9:kworker.0 Request processed in 242us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191981.402546:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 460 00000100:00080000:3.0:1784191981.402731:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784191981.402751:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191981.402765:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812497536 00000100:00100000:3.0:1784191981.402770:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812497536 00000100:00100000:3.0:1784191981.402814:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812497664 00000100:00100000:3.0:1784191981.402818:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812497664 00000100:00100000:3.0:1784191981.402841:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 470 00000100:00100000:3.0:1784191981.402847:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69111:x1870858812497536:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191981.402902:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69111:x1870858812497536:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 54us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191981.402910:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 470 00000100:00100000:3.0:1784191981.402924:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 471 00000100:00100000:3.0:1784191981.402930:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812497664:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191981.403019:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812497664:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 88us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191981.403027:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 471 00000100:00080000:3.0:1784191981.403098:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784191981.403102:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784191981.407947:0:169535:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000080:1.0:1784191981.408628:0:169535:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1784191981.408681:0:169535:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784191981.408711:0:169535:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xfeec3c2dc5a4d651 00000100:00080000:1.0:1784191981.408722:0:169535:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784191981.408728:0:169535:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8af101781000 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191981.408766:0:169535:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af111a8c700 x1870858828031616/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784191981.409312:0:169535:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1784191981.410002:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:106498:1870858828031616:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784191981.410529:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191981.410653:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828031616 00000100:00100000:3.0:1784191981.410663:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828031616 00000100:00100000:3.0:1784191981.410728:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:3.0:1784191981.410738:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:106498:x1870858828031616:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1784191981.410779:0:158667:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 5601 last 0 00000020:00000080:3.0:1784191981.410841:0:158667:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xfeec3c2dc5a4d658 00000004:00100000:3.0:1784191981.410860:0:158667:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784191981.410912:0:158667:0:(import.c:65:import_set_state_nolock()) ffff8af109020000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784191981.410986:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:106498:x1870858828031616:12345-0@lo:38:llog_process_th.0 Request processed in 247us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191981.410995:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:3.0:1784191981.411046:0:106498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784191981.411058:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 6 00000100:00080000:3.0:1784191981.411067:0:106498:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000040:00080000:1.0:1784191981.413838:0:169535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 52 count 51 00000100:00080000:3.0:1784191981.416265:0:106498:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784191981.416276:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af101781000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784191981.416290:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:106498:1870858828031616:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1784191981.416748:0:169524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1784191981.416807:0:169524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784191981.416839:0:169524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af2204b7800/0xfeec3c2dc5a4d627 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d62e expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191981.416853:0:169524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af2204b7800/0xfeec3c2dc5a4d627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d62e expref: -99 pid: 169524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784191981.416935:0:169524:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784191981.416937:0:169524:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784191981.416938:0:169524:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784191981.416939:0:169524:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784191981.416940:0:169524:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784191981.416941:0:169524:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784191981.416943:0:169524:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784191981.416945:0:169524:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784191981.416947:0:169524:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784191981.416953:0:169524:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1784191981.416956:0:169524:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784191981.416963:0:169524:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784191981.416964:0:169524:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784191981.416965:0:169524:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784191981.416966:0:169524:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784191981.416966:0:169524:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784191981.416967:0:169524:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784191981.416968:0:169524:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784191981.416969:0:169524:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784191981.417005:0:169524:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784191981.417032:0:169524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828031744:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784191981.418394:0:169524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191981.419462:0:169524:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af10fb5a780 going to sleep for 11 seconds 00000100:00100000:3.0:1784191981.422374:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828031744 00000100:00100000:3.0:1784191981.422389:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828031744 00000100:00100000:3.0:1784191981.424914:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1784191981.424935:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:169524:x1870858828031744:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784191981.424976:0:167181:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784191981.424990:0:167181:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784191981.433777:0:167181:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784191981.433805:0:167181:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1784191981.433915:0:167180:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784191981.433921:0:167180:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784191981.433947:0:167180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8af2204b6600/0xfeec3c2dc5a4d65f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191981.433969:0:167180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af10d08f600/0xfeec3c2dc5a4d25a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d253 expref: 24 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191981.433977:0:167180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af10d08ea00/0xfeec3c2dc5a4d276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d26f expref: 24 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191981.433987:0:167180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8af10de3f600/0xfeec3c2dc5a4d31e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3a5 expref: 9 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191981.433997:0:167180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8af2204b6600/0xfeec3c2dc5a4d65f lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191981.434054:0:167180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af10de3f600/0xfeec3c2dc5a4d31e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3a5 expref: 9 pid: 167179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191981.434071:0:167180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af10de3f600/0xfeec3c2dc5a4d31e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3a5 expref: 9 pid: 167179 timeout: 5701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784191981.434176:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:169524:x1870858828031744:12345-0@lo:253:mount.lustre.0 Request processed in 9245us (15786us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191981.434188:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1784191981.434226:0:169524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:169524:1870858828031744:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784191981.434243:0:169524:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1784191981.434247:0:169524:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784191981.434249:0:169524:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784191981.434251:0:169524:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784191981.434252:0:169524:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784191981.434254:0:169524:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784191981.434255:0:169524:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784191981.434256:0:169524:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784191981.434259:0:169524:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784191981.434261:0:169524:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784191981.434286:0:169524:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1784191981.434946:0:167180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:167180:1870858828031872:192.168.204.16@tcp:104: 00010000:00010000:0.0:1784191981.435042:0:167180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af10d08ea00/0xfeec3c2dc5a4d276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeec3c2dc5a4d26f expref: 23 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191981.435052:0:167180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af10d08ea00/0xfeec3c2dc5a4d276 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeec3c2dc5a4d26f expref: 23 pid: 167178 timeout: 5701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191981.435207:0:167180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:167180:1870858828032000:0@lo:104: 00000100:00100000:0.0:1784191981.435245:0:167180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784191981.435299:0:167180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8af10d08f600/0xfeec3c2dc5a4d25a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfeec3c2dc5a4d253 expref: 23 pid: 167176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191981.435309:0:167180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8af10d08f600/0xfeec3c2dc5a4d25a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfeec3c2dc5a4d253 expref: 23 pid: 167176 timeout: 5701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191981.435317:0:167180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109199500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:167180:1870858828032128:0@lo:104: 00000100:00100000:0.0:1784191981.435338:0:167180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191981.435362:0:167180:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af111d08480 going to sleep for 11 seconds 00000100:00100000:1.0:1784191981.435410:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828032000 00000100:00100000:1.0:1784191981.435418:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828032000 00000100:00100000:1.0:1784191981.435457:0:158648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828032128 00000100:00100000:1.0:1784191981.435460:0:158648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828032128 00000100:00100000:1.0:1784191981.435474:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784191981.435483:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+4:167180:x1870858828032000:12345-0@lo:104: 00010000:00010000:1.0:1784191981.435505:0:158648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.116@tcp lock: ffff8af10d08f800/0xfeec3c2dc5a4d26f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeec3c2dc5a4d276 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.435580:0:158648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784191981.435586:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+4:167180:x1870858828032000:12345-0@lo:104: Request processed in 103us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191981.435593:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784191981.435613:0:158648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784191981.435620:0:158648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+3:167180:x1870858828032128:12345-0@lo:104: 00010000:00010000:1.0:1784191981.435629:0:158648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.116@tcp lock: ffff8af1115b9a00/0xfeec3c2dc5a4d253 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeec3c2dc5a4d25a expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.435664:0:158648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784191981.435670:0:158648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+3:167180:x1870858828032128:12345-0@lo:104: Request processed in 51us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191981.435676:0:158648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:1.0:1784191981.435713:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784191981.435720:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.116@tcp lock: ffff8af10d08f800/0xfeec3c2dc5a4d26f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeec3c2dc5a4d276 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.435728:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af10d08f800 already unused, calling callback (ffffffffc1384c20) 10000000:00010000:1.0:1784191981.435732:0:160901:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.116@tcp lock: ffff8af10d08f800/0xfeec3c2dc5a4d26f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeec3c2dc5a4d276 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.435741:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af10d08f800/0xfeec3c2dc5a4d26f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeec3c2dc5a4d276 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191981.435748:0:160901:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af10d08f800/0xfeec3c2dc5a4d26f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeec3c2dc5a4d276 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191981.435762:0:160901:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784191981.435793:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.116@tcp lock: ffff8af10d08f800/0xfeec3c2dc5a4d26f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeec3c2dc5a4d276 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.435800:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191981.435822:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.116@tcp lock: ffff8af10d08f800/0xfeec3c2dc5a4d26f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeec3c2dc5a4d276 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.435828:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af10d08f800/0xfeec3c2dc5a4d26f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeec3c2dc5a4d276 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.435843:0:160901:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784191981.435845:0:160901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.116@tcp lock: ffff8af1115b9a00/0xfeec3c2dc5a4d253 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfeec3c2dc5a4d25a expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.435850:0:160901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af1115b9a00 already unused, calling callback (ffffffffc1384c20) 10000000:00010000:1.0:1784191981.435853:0:160901:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.116@tcp lock: ffff8af1115b9a00/0xfeec3c2dc5a4d253 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfeec3c2dc5a4d25a expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.435860:0:160901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.116@tcp lock: ffff8af1115b9a00/0xfeec3c2dc5a4d253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfeec3c2dc5a4d25a expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784191981.435876:0:160901:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.116@tcp lock: ffff8af1115b9a00/0xfeec3c2dc5a4d253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfeec3c2dc5a4d25a expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191981.435883:0:160901:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784191981.435897:0:160901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.116@tcp lock: ffff8af1115b9a00/0xfeec3c2dc5a4d253 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeec3c2dc5a4d25a expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.435903:0:160901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784191981.435917:0:160901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.116@tcp lock: ffff8af1115b9a00/0xfeec3c2dc5a4d253 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeec3c2dc5a4d25a expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.435922:0:160901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.116@tcp lock: ffff8af1115b9a00/0xfeec3c2dc5a4d253 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfeec3c2dc5a4d25a expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.435940:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191981.435941:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784191981.435943:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191981.435959:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858828032256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191981.435993:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191981.436024:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784191981.436030:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858828032384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191981.436052:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191981.436084:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828032256 00000100:00100000:1.0:1784191981.436089:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828032256 00010000:00010000:1.0:1784191981.436122:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af10d08ea00/0xfeec3c2dc5a4d276 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeec3c2dc5a4d26f expref: 24 pid: 167178 timeout: 5701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191981.436145:0:158651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828032384 00000100:00100000:1.0:1784191981.436149:0:158651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828032384 00010000:00010000:1.0:1784191981.436160:0:158651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af10d08f600/0xfeec3c2dc5a4d25a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeec3c2dc5a4d253 expref: 25 pid: 167176 timeout: 5701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191981.436177:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1784191981.436183:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+25:106499:x1870858828032256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191981.436195:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191981.436200:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af10d08ea00/0xfeec3c2dc5a4d276 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeec3c2dc5a4d26f expref: 25 pid: 167178 timeout: 5701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.436220:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af10d08ea00/0xfeec3c2dc5a4d276 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeec3c2dc5a4d26f expref: 25 pid: 167178 timeout: 5701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.436240:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191981.436271:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+25:106499:x1870858828032256:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191981.436278:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1784191981.436293:0:158651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1784191981.436298:0:158651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858828032384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784191981.436306:0:158651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191981.436310:0:158651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af10d08f600/0xfeec3c2dc5a4d25a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfeec3c2dc5a4d253 expref: 24 pid: 167176 timeout: 5701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.436317:0:158651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af10d08f600/0xfeec3c2dc5a4d25a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfeec3c2dc5a4d253 expref: 24 pid: 167176 timeout: 5701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.436327:0:158651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191981.436348:0:158651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858828032384:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191981.436355:0:158651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1784191981.436398:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858828032384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784191981.436406:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858828032256:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784191981.436583:0:167180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af10d08ea00/0xfeec3c2dc5a4d276 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeec3c2dc5a4d26f expref: 23 pid: 167178 timeout: 5701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191981.436595:0:167180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:167180:1870858828032000:0@lo:104: 00010000:00010000:0.0:1784191981.436603:0:167180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af10d08f600/0xfeec3c2dc5a4d25a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfeec3c2dc5a4d253 expref: 22 pid: 167176 timeout: 5701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191981.436610:0:167180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109199500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:167180:1870858828032128:0@lo:104: 00010000:00010000:3.0:1784191981.438507:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191981.439652:0:167180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:167180:1870858828031872:192.168.204.16@tcp:104: 00000100:00100000:3.0:1784191981.439670:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1784191981.439710:0:167180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8af2204b6600/0xfeec3c2dc5a4d65f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191981.439860:0:165501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812498048 00000100:00100000:1.0:1784191981.439878:0:165501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812498048 00010000:00010000:1.0:1784191981.440722:0:165501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8af10de3f600/0xfeec3c2dc5a4d31e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3a5 expref: 10 pid: 167179 timeout: 5701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191981.440864:0:165501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 214 00000100:00100000:1.0:1784191981.440888:0:165501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812498048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784191981.440907:0:165501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784191981.440914:0:165501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8af10de3f600/0xfeec3c2dc5a4d31e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3a5 expref: 10 pid: 167179 timeout: 5701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.440928:0:165501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8af10de3f600/0xfeec3c2dc5a4d31e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3a5 expref: 10 pid: 167179 timeout: 5701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.440953:0:165501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af10de3f600/0xfeec3c2dc5a4d31e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c3a5 expref: 10 pid: 167179 timeout: 5701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.440974:0:165501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8af2204b6600/0xfeec3c2dc5a4d65f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.440984:0:165501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af2204b6600/0xfeec3c2dc5a4d65f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784191981.441003:0:165501:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007082260s 00010000:00010000:1.0:1784191981.441008:0:165501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af2204b6600/0xfeec3c2dc5a4d65f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.441015:0:165501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8af2204b6600/0xfeec3c2dc5a4d65f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.441023:0:165501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8af2204b6600/0xfeec3c2dc5a4d65f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.441031:0:165501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8af2204b6600/0xfeec3c2dc5a4d65f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.441056:0:165501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8af2204b6600 already unused, calling callback (ffffffffc0d7c230) 00010000:00010000:1.0:1784191981.441061:0:165501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8af2204b6600/0xfeec3c2dc5a4d65f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.441070:0:165501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8af2204b6600/0xfeec3c2dc5a4d65f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.441091:0:165501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8af2204b6600/0xfeec3c2dc5a4d65f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191981.441112:0:165501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784191981.441175:0:165501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+9:69110:x1870858812498048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 290us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191981.441183:0:165501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 214 00010000:00010000:0.0:1784191981.441183:0:167180:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8af2204b6600/0xfeec3c2dc5a4d65f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191981.441191:0:167180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8af2204b6600/0xfeec3c2dc5a4d65f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191981.441204:0:167180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8af2204b6600/0xfeec3c2dc5a4d65f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1784191981.458776:0:169524:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 21474836603 00010000:00080000:2.0:1784191981.460302:0:169541:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-OST0000: started recovery thread pid 169541 00010000:02000000:2.0:1784191981.460328:0:169541:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00000020:01000004:0.0:1784191981.460723:0:169524:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784191981.460791:0:169524:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784191981.460815:0:169524:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1784191981.460851:0:169524:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1784191981.462210:0:169524:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784191981.462499:0:169524:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:2.0:1784191981.474631:0:169541:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:2.0:1784191981.474643:0:169541:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00010000:2.0:1784191981.646032:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784191982.374171:0:169590:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784191982.374418:0:169590:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1784191982.479132:0:158662:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784191982.479142:0:158662:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8af109051000 from 42 10000000:01000000:0.0:1784191982.479147:0:158662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784191982.479206:0:158662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af2204b6e00/0xfeec3c2dc5a4d666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191982.479219:0:158662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af2204b6e00/0xfeec3c2dc5a4d666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191982.479230:0:158662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af2204b6e00/0xfeec3c2dc5a4d666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191982.479260:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858828032512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784191982.479349:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191982.479396:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af110ef36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784191982.480404:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828032512 00000100:00100000:3.0:1784191982.480414:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828032512 00000100:00100000:3.0:1784191982.480480:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1784191982.480492:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+22:158662:x1870858828032512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784191982.480507:0:167178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191982.480527:0:167178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af20c0aa400/0xfeec3c2dc5a4d66d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d666 expref: -99 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191982.480554:0:167178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af20c0aa400/0xfeec3c2dc5a4d66d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d666 expref: 23 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191982.480563:0:167178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af20c0aa400/0xfeec3c2dc5a4d66d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d666 expref: 23 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191982.480572:0:167178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20c0aa400, rc 0) 00000100:00100000:3.0:1784191982.480635:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:158662:x1870858828032512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191982.480642:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784191982.484166:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858828032512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784191982.484205:0:158662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af2204b6e00/0xfeec3c2dc5a4d666 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d66d expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191982.484221:0:158662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af2204b6e00/0xfeec3c2dc5a4d666 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d66d expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191982.484303:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858828032640:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784191982.484367:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191982.484461:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af110ef36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784191982.486269:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828032640 00000100:00100000:2.0:1784191982.486282:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828032640 00000100:00100000:3.0:1784191982.486708:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784191982.486719:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dea9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:158662:x1870858828032640:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784191982.486746:0:167176:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784191982.486762:0:167176:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784191982.486834:0:167176:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 42 00000100:00100000:3.0:1784191982.486979:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dea9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:158662:x1870858828032640:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 261us (2610us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191982.486987:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784191982.487378:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858828032640:0@lo:256:ll_cfg_requeue.0 00000100:00080000:1.0:1784191982.487432:0:158662:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8af2029fa800 already not connected (conn 7, was 0): DISCONN 00010000:00080000:1.0:1784191982.487443:0:158662:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8af2029fa800@lustre-OST0000-osc-MDT0000: found existing conn 192.168.204.116@tcp, moved to head 00000100:00080000:1.0:1784191982.487786:0:158662:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784191982.487794:0:158662:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8af2029fa800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:1.0:1784191982.487833:0:158662:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af111a8c000 x1870858828032768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:1.0:1784191982.487898:0:158662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784191982.487909:0:158662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af2204b6e00/0xfeec3c2dc5a4d666 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d66d expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191982.487920:0:158662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af2204b6e00/0xfeec3c2dc5a4d666 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d66d expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784191982.487938:0:158662:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784191982.487940:0:158662:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8af22dcd8000 from 42 10000000:01000000:1.0:1784191982.487943:0:158662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784191982.487968:0:158662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10de3e800/0xfeec3c2dc5a4d674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191982.487977:0:158662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.116@tcp lock: ffff8af10de3e800/0xfeec3c2dc5a4d674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191982.487986:0:158662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.116@tcp lock: ffff8af10de3e800/0xfeec3c2dc5a4d674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191982.488008:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858828032896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784191982.488073:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191982.488117:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1102ffe40 going to sleep for 11 seconds 00000100:00100000:0.0:1784191982.488327:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828032896 00000100:00100000:0.0:1784191982.488335:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828032896 00000100:00100000:0.0:1784191982.488382:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784191982.488390:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22deaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+23:158662:x1870858828032896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784191982.488403:0:167178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784191982.488417:0:167178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af2204b7c00/0xfeec3c2dc5a4d67b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfeec3c2dc5a4d674 expref: -99 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191982.488440:0:167178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af2204b7c00/0xfeec3c2dc5a4d67b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d674 expref: 24 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191982.488462:0:167178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af2204b7c00/0xfeec3c2dc5a4d67b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfeec3c2dc5a4d674 expref: 24 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784191982.488471:0:167178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af2204b7c00, rc 0) 00000100:00100000:0.0:1784191982.488508:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22deaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:158662:x1870858828032896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191982.488514:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784191982.488654:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858828032768:0@lo:8:ll_cfg_requeue.0 00000100:00100000:3.0:1784191982.488709:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191982.488797:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828032768 00000100:00100000:0.0:1784191982.488802:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828032768 00000100:00100000:0.0:1784191982.488823:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:0.0:1784191982.488828:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:106498:x1870858828032768:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1784191982.488863:0:162389:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8af10c3aa800, cookie 0xfeec3c2dc5a4d60b 00010000:00080000:0.0:1784191982.488877:0:162389:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff8af10c3aa800 cur 5602 last 1784191981 00010000:02000400:0.0:1784191982.488886:0:162389:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00000100:00100000:1.0:1784191982.492361:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858828032896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784191982.492402:0:158662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.116@tcp lock: ffff8af10de3e800/0xfeec3c2dc5a4d674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d67b expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784191982.492417:0:158662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.116@tcp lock: ffff8af10de3e800/0xfeec3c2dc5a4d674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfeec3c2dc5a4d67b expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784191982.492525:0:158662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858828033024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784191982.492602:0:158662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191982.492650:0:158662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af1102ffe40 going to sleep for 11 seconds 00000100:00100000:3.0:1784191982.494606:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828033024 00000100:00100000:3.0:1784191982.494620:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828033024 00000100:00100000:3.0:1784191982.494702:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784191982.494713:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10efef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:158662:x1870858828033024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784191982.494743:0:167176:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784191982.494763:0:167176:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784191982.494779:0:167176:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 42 00000100:00100000:3.0:1784191982.494948:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10efef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:158662:x1870858828033024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 236us (2344us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191982.494956:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784191982.495758:0:158662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:158662:1870858828033024:0@lo:256:ll_cfg_requeue.0 00000100:00080000:2.0:1784191982.496929:0:158662:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8af23f2d8800 already not connected (conn 7, was 0): DISCONN 00010000:00080000:2.0:1784191982.496943:0:158662:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8af23f2d8800@lustre-OST0000-osc-MDT0001: found existing conn 192.168.204.116@tcp, moved to head 00000100:00080000:2.0:1784191982.496949:0:158662:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784191982.496957:0:158662:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8af23f2d8800 using connection 192.168.204.116@tcp/0@lo 00000100:00100000:2.0:1784191982.496995:0:158662:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8af106b87800 x1870858828033152/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:0.0:1784191982.497216:0:162389:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:0.0:1784191982.497256:0:162389:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8af10c3aa800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1784191982.497261:0:162389:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1784191982.497264:0:162389:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1784191982.497398:0:162389:0:(import.c:65:import_set_state_nolock()) ffff8af233c52800 : changing import state from RECOVER to FULL 10000000:01000000:2.0:1784191982.497793:0:158662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784191982.497805:0:158662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.116@tcp lock: ffff8af10de3e800/0xfeec3c2dc5a4d674 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d67b expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784191982.497816:0:158662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.116@tcp lock: ffff8af10de3e800/0xfeec3c2dc5a4d674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfeec3c2dc5a4d67b expref: -99 pid: 158662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784191982.497932:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:106498:x1870858828032768:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 9101us (9242us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191982.497943:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:3.0:1784191982.498649:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828033152:0@lo:8:ll_cfg_requeue.0 00000100:00100000:3.0:1784191982.501622:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1784191982.501798:0:106498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af111a8c000 x1870858828032768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784192007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784191982.501820:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 6 00000100:00080000:3.0:1784191982.501833:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1784191982.501839:0:106498:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1784191982.501842:0:106498:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836603 gen 2 00000100:00080000:3.0:1784191982.501855:0:106498:0:(recover.c:53:ptlrpc_replay_next()) import ffff8af2029fa800 from lustre-OST0000_UUID committed 21474836603 last 0 00000100:00080000:3.0:1784191982.501859:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1784191982.503652:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858828032768:0@lo:8:ll_cfg_requeue.0 00010000:00080000:3.0:1784191982.503748:0:169597:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:3.0:1784191982.503760:0:169597:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:3.0:1784191982.503778:0:169597:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:3.0:1784191982.503818:0:169597:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1784191982.503962:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858828033280:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1784191982.504055:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191982.509988:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828033152 00000100:00100000:1.0:1784191982.510003:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828033152 00000100:00100000:1.0:1784191982.511609:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828033280 00000100:00100000:1.0:1784191982.511620:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828033280 00000100:00100000:1.0:1784191982.511673:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1784191982.511684:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:106498:x1870858828033280:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1784191982.511728:0:162395:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff8af109199500 x1870858828033280/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:153/0 lens 224/0 e 0 to 0 dl 1784191993 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784191982.511750:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:106498:x1870858828033280:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 70us (7696us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784191982.511758:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1784191982.511897:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1784191982.511904:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:106498:x1870858828033152:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1784191982.511940:0:162387:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8af10c3aa000, cookie 0xfeec3c2dc5a4d604 00010000:00080000:0.0:1784191982.511947:0:162387:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8af10c3aa000 cur 5602 last 1784191981 00002000:00100000:0.0:1784191982.511969:0:162387:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8af10c3aa000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1784191982.511974:0:162387:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1784191982.511977:0:162387:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1784191982.512030:0:162387:0:(import.c:65:import_set_state_nolock()) ffff8af233c57800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784191982.512120:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:106498:x1870858828033152:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 214us (10506us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191982.512135:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00010000:00080000:0.0:1784191982.512180:0:106498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af106b87800 x1870858828033152/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784192007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784191982.512195:0:106498:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 6 00000100:00080000:0.0:1784191982.512205:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1784191982.512209:0:106498:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1784191982.512211:0:106498:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836544 gen 2 00000100:00080000:0.0:1784191982.512214:0:106498:0:(recover.c:53:ptlrpc_replay_next()) import ffff8af23f2d8800 from lustre-OST0000_UUID committed 21474836544 last 0 00000100:00080000:0.0:1784191982.512217:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1784191982.512318:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828033152:0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1784191982.512341:0:169599:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:0.0:1784191982.512344:0:169599:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:0.0:1784191982.512349:0:169599:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:0.0:1784191982.512389:0:169599:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1784191982.512424:0:106498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828033408:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1784191982.512475:0:106498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191982.512757:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828033408 00000100:00100000:1.0:1784191982.512762:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828033408 00000100:00100000:1.0:1784191982.512886:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1784191982.512892:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:106498:x1870858828033408:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1784191982.512904:0:162395:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff8af10919b800 x1870858828033408/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:153/0 lens 224/0 e 0 to 0 dl 1784191993 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784191982.512914:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:106498:x1870858828033408:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 24us (441us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784191982.512919:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00010000:00080000:2.0:1784191982.513576:0:169541:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00010000:3.0:1784191982.668217:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191983.012608:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191983.012846:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812498176 00000100:00100000:3.0:1784191983.012857:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812498176 00000100:00100000:3.0:1784191983.012917:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 120 00000100:00100000:3.0:1784191983.012929:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10efecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+9:122642:x1870858812498176:12345-192.168.204.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784191983.012949:0:167178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784191983.012973:0:167178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8af20c0aba00/0xfeec3c2dc5a4d682 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0b8454c8b8c423 expref: -99 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191983.013068:0:167178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8af20c0aba00/0xfeec3c2dc5a4d682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c423 expref: 10 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191983.013086:0:167178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8af20c0aba00/0xfeec3c2dc5a4d682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0xc0b8454c8b8c423 expref: 10 pid: 167178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784191983.013097:0:167178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8af20c0aba00, rc 0) 00000100:00100000:3.0:1784191983.013168:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10efecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:122642:x1870858812498176:12345-192.168.204.16@tcp:101:ll_cfg_requeue.0 Request processed in 241us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191983.013175:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 120 00000100:00100000:3.0:1784191983.018788:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191983.018834:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812498304 00000100:00100000:3.0:1784191983.018854:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812498304 00000100:00100000:3.0:1784191983.018906:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 121 00000100:00100000:3.0:1784191983.018917:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10efec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:122642:x1870858812498304:12345-192.168.204.16@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784191983.018958:0:167176:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1784191983.018975:0:167176:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784191983.018978:0:167176:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 42 00000100:00100000:0.0:1784191983.023366:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10efec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:122642:x1870858812498304:12345-192.168.204.16@tcp:256:ll_cfg_requeue.0 Request processed in 4438us (4575us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191983.023382:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 121 00000100:00100000:0.0:1784191983.030179:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191983.030224:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812498432 00000100:00100000:0.0:1784191983.030235:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812498432 00000100:00100000:0.0:1784191983.030282:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 463 00000100:00100000:0.0:1784191983.030290:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:69108:x1870858812498432:12345-192.168.204.16@tcp:8:ll_cfg_requeue.0 00010000:00080000:0.0:1784191983.030348:0:162394:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '62ac9b09-d016-4ae6-b1b1-fe120a3abe0a' at ffff8af10c3a9000, cookie 0xfeec3c2dc5a4d612 00010000:00080000:0.0:1784191983.030355:0:162394:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp recovering/t0 exp ffff8af10c3a9000 cur 5603 last 1784191981 00002000:00100000:0.0:1784191983.030378:0:162394:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a/ffff8af10c3a9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784191983.030402:0:162394:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784191983.030548:0:162394:0:(import.c:65:import_set_state_nolock()) ffff8af104add800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784191983.030635:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69108:x1870858812498432:12345-192.168.204.16@tcp:8:ll_cfg_requeue.0 Request processed in 344us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191983.030642:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 463 00010000:00080000:1.0:1784191983.032323:0:169541:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:1.0:1784191983.032332:0:169541:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 21474836604 00010000:00080000:1.0:1784191983.032337:0:169541:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 21474836604 00010000:00080000:1.0:1784191983.032341:0:169541:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 21474836604 00000100:00100000:3.0:1784191983.035300:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191983.044777:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812498560 00000100:00100000:0.0:1784191983.044796:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812498560 00000100:00100000:0.0:1784191983.044877:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 253 00000100:00100000:0.0:1784191983.044890:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69108:x1870858812498560:12345-192.168.204.16@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1784191983.044922:0:162385:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff8af233108700 x1870858812498560/t0(0) o400->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:154/0 lens 224/0 e 0 to 0 dl 1784191994 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784191983.044944:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69108:x1870858812498560:12345-192.168.204.16@tcp:400:ldlm_lock_repla.0 Request processed in 57us (9655us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784191983.044952:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 253 00010000:00080000:0.0:1784191983.044976:0:169541:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 21474836604 00010000:00080000:0.0:1784191983.044980:0:169541:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00010000:00080000:0.0:1784191983.044986:0:169541:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1784191983.044990:0:169541:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1784191983.045455:0:169541:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803776 00000001:00100000:2.0:1784191983.060033:0:169525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000001:00100000:2.0:1784191983.060049:0:169525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1784191983.060053:0:169525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1784191983.061737:0:169541:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:0.0:1784191983.061770:0:169541:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8af109199500 x1870858828033280/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:153/0 lens 224/0 e 0 to 0 dl 1784191993 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1784191983.061919:0:169541:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8af10919b800 x1870858828033408/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:153/0 lens 224/0 e 0 to 0 dl 1784191993 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1784191983.061961:0:169541:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.16@tcp: req@ffff8af233108700 x1870858812498560/t0(0) o400->62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp:154/0 lens 224/0 e 0 to 0 dl 1784191994 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1784191983.062027:0:169541:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. 00002000:00080000:0.0:1784191983.071632:0:169541:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1784191983.071643:0:169541:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00010000:00080000:1.0:1784191983.072855:0:106498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af109198a80 x1870858828033408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784191998 ref 1 fl Rpc:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784191983.072881:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1784191983.072889:0:106498:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff8af109198a80 x1870858828033408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784191998 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784191983.072910:0:106498:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8af109198a80 x1870858828033408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784191998 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784191983.072917:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af23f2d8800 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:1.0:1784191983.072935:0:106498:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:1.0:1784191983.072938:0:106498:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784191983.076185:0:165490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:165490:1870858828033664:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1784191983.076278:0:165490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191983.076317:0:165490:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af110ef3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191983.076339:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828033536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784191983.076372:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191983.076420:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828033664 00000100:00100000:0.0:1784191983.076431:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828033664 00000100:00100000:0.0:1784191983.076511:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1784191983.078136:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:165490:x1870858828033664:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1784191983.078455:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828033536 00000100:00100000:0.0:1784191983.078464:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828033536 00000100:00100000:0.0:1784191983.079730:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1784191983.079766:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828033536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784191983.079796:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 38084608 avail 30916608 00000100:00100000:0.0:1784191983.079910:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828033536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 158us (3535us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191983.079918:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00010000:00080000:2.0:1784191983.083032:0:106501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10919b100 x1870858828033536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784191999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784191983.083065:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828033536:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784191983.085792:0:106498:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000cc974cf2): req@ffff8af23310aa00 x1870858828019968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/224 e 0 to 0 dl 1784191975 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784191983.085819:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:106498:1870858828033408:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1784191983.086785:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191983.086856:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828019968 00000100:00100000:1.0:1784191983.086866:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828019968 00000100:00100000:1.0:1784191983.086921:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1784191983.086931:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828019968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784191983.086956:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 38084608 avail 30916608 00000100:00100000:1.0:1784191983.087004:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828019968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (221us total) trans 0 rc 0/0 00002000:00080000:3.0:1784191983.087288:0:162396:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1784191983.087295:0:162396:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0xc1:0x0] 00000100:00100000:3.0:1784191983.087359:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+6:165490:x1870858828033664:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9244us (11079us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191983.087369:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00010000:00080000:0.0:1784191983.087463:0:165490:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10919ad80 x1870858828033664/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784191999 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784191983.087487:0:165490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:165490:1870858828033664:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1784191983.087518:0:165490:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0xc1:0x0] 00010000:00080000:3.0:1784191983.088857:0:106498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af233108000 x1870858828033280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784191998 ref 1 fl Rpc:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784191983.088874:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1784191983.088881:0:106498:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff8af233108000 x1870858828033280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784191998 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784191983.088889:0:106498:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8af233108000 x1870858828033280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784191998 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784191983.088897:0:106498:0:(import.c:65:import_set_state_nolock()) ffff8af2029fa800 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:3.0:1784191983.088917:0:106498:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:3.0:1784191983.088920:0:106498:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1784191983.088925:0:106498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:106498:1870858828033280:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1784191983.089173:0:167190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:167190:1870858828033920:0@lo:7:osp-pre-0-0.0 00000100:00100000:0.0:1784191983.089237:0:167190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191983.089265:0:167190:0:(client.c:2702:ptlrpc_set_wait()) set ffff8af110ef3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784191983.089278:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784191983.089287:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828033792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784191983.089312:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191983.089344:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828033920 00000100:00100000:0.0:1784191983.089352:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828033920 00000100:00100000:0.0:1784191983.089399:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1784191983.089408:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:167190:x1870858828033920:12345-0@lo:7:osp-pre-0-0.0 00000100:00100000:1.0:1784191983.091049:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1784191983.091086:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828033792 00000100:00100000:1.0:1784191983.091093:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828033792 00000100:00100000:1.0:1784191983.091120:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1784191983.091127:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:106501:x1870858828033792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784191983.091149:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 38084608 avail 30916608 00000100:00100000:1.0:1784191983.091289:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:106501:x1870858828033792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (1976us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191983.091297:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00010000:00080000:1.0:1784191983.091350:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af23310aa00 x1870858828019968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784191999 ref 1 fl Rpc:RQU/202/0 rc -107/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784191983.091370:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828019968:0@lo:13:osp-pre-0-1.0 00002000:00080000:0.0:1784191983.092174:0:162386:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1784191983.092182:0:162386:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0x2a1:0x0] 00000100:00100000:0.0:1784191983.092239:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:167190:x1870858828033920:12345-0@lo:7:osp-pre-0-0.0 Request processed in 2829us (3001us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191983.092249:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00010000:00080000:1.0:1784191983.092958:0:167190:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af109198e00 x1870858828033920/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784191999 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784191983.092973:0:167190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:167190:1870858828033920:0@lo:7:osp-pre-0-0.0 00000004:00080000:1.0:1784191983.092989:0:167190:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x280000401:0x2a1:0x0] 00010000:00080000:3.0:1784191983.093684:0:106501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10919ad80 x1870858828033792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784191999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784191983.093722:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828033792:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784191983.698874:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191984.659742:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828034048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784191984.659827:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191984.659896:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828034048 00000100:00100000:2.0:1784191984.659906:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828034048 00000100:00100000:2.0:1784191984.659976:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:2.0:1784191984.659985:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828034048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784191984.660034:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:0.0:1784191984.660195:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828034048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784191984.660229:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828034048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 245us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191984.660239:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00010000:00010000:3.0:1784191984.716386:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191985.164377:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828034176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784191985.164458:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191985.164884:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828034304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784191985.164917:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191985.164962:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828034304 00000100:00100000:3.0:1784191985.164970:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828034304 00000100:00100000:3.0:1784191985.165020:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:3.0:1784191985.165028:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828034304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784191985.165067:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:3.0:1784191985.165117:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828034304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191985.165125:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00100000:3.0:1784191985.165180:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828034304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784191985.165521:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828034176 00000100:00100000:2.0:1784191985.165527:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828034176 00000100:00100000:2.0:1784191985.165578:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1784191985.165586:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828034176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784191985.165610:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:2.0:1784191985.165663:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828034176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191985.165669:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:3.0:1784191985.165785:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784191985.165825:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828034176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784191985.676360:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784191985.676386:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828034432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784191985.676457:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191985.676546:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828034432 00000100:00100000:3.0:1784191985.676556:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828034432 00000100:00100000:3.0:1784191985.676637:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1784191985.676648:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828034432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784191985.676673:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:3.0:1784191985.677088:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828034432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 441us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191985.677096:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1784191985.677151:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828034432:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784191985.677349:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784191985.746318:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191986.523627:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191986.523663:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191986.523719:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191986.523750:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191986.523804:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812498816 00000100:00100000:0.0:1784191986.523828:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812498816 00000100:00100000:0.0:1784191986.523908:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812498944 00000100:00100000:0.0:1784191986.523911:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812498944 00000100:00100000:0.0:1784191986.523937:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 472 00000100:00100000:0.0:1784191986.523949:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69111:x1870858812498816:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191986.524043:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69111:x1870858812498816:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 96us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191986.524050:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 472 00000100:00100000:0.0:1784191986.524071:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 473 00000100:00100000:0.0:1784191986.524076:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812498944:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191986.524102:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812498944:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 26us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191986.524110:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 473 00000100:00100000:0.0:1784191986.524132:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812498688 00000100:00100000:0.0:1784191986.524135:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812498688 00000100:00100000:0.0:1784191986.524163:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 122 00000100:00100000:0.0:1784191986.524170:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10efec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812498688:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191986.524197:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10efec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812498688:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 27us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191986.524203:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 122 00000100:00080000:0.0:1784191986.524231:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784191986.524236:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784191986.528791:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812499072 00000100:00100000:2.0:1784191986.528809:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812499072 00000100:00100000:2.0:1784191986.528896:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 254 00000100:00100000:2.0:1784191986.528909:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812499072:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191986.529001:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812499072:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 94us (5248us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191986.529009:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 254 00000100:00080000:2.0:1784191986.529033:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1784191986.701439:0:160977:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000020:00000080:2.0:1784191986.701462:0:160977:0:(genops.c:906:class_export_put()) final put ffff8af204c79800/62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000020:00000080:0.0:1784191986.705508:0:123300:0:(genops.c:865:class_export_destroy()) destroying export ffff8af204c79800/62ac9b09-d016-4ae6-b1b1-fe120a3abe0a for lustre-OST0001 00000020:00000080:0.0:1784191986.706264:0:123300:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af204c7c000 for lustre-OST0001 00000100:00100000:0.0:1784191986.706289:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858828034560:0@lo:400:kworker.0 00000100:00100000:0.0:1784191986.707059:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191986.707779:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858828034816:0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.707842:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191986.707908:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858828035328:0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.707933:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191986.707966:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858828035840:0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.707988:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191986.708015:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784191986.708022:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828034944:0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.708051:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191986.708076:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828035456:0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.708098:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191986.708117:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858828035968:0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.708224:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191986.708255:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858828034688:0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.708280:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191986.708297:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828035200:0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.708336:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191986.708355:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828035712:0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.708375:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191986.708409:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828034816 00000100:00100000:1.0:1784191986.708418:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828034816 00000100:00100000:1.0:1784191986.708483:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828035328 00000100:00100000:1.0:1784191986.708486:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828035328 00000100:00100000:1.0:1784191986.708499:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828035840 00000100:00100000:1.0:1784191986.708502:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828035840 00000100:00100000:1.0:1784191986.708511:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828035968 00000100:00100000:1.0:1784191986.708513:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828035968 00000100:00100000:1.0:1784191986.708526:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828034688 00000100:00100000:1.0:1784191986.708528:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828034688 00000100:00100000:1.0:1784191986.708544:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1784191986.708553:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858828034816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.708614:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858828034816:12345-0@lo:400:kworker.0 Request processed in 62us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191986.708622:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1784191986.708642:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1784191986.708647:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858828035328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.708679:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858828035328:12345-0@lo:400:kworker.0 Request processed in 31us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191986.708684:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1784191986.708721:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1784191986.708726:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858828035840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.708753:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858828035840:12345-0@lo:400:kworker.0 Request processed in 27us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191986.708777:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1784191986.708791:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1784191986.708798:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858828035968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.708829:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858828035968:12345-0@lo:400:kworker.0 Request processed in 32us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191986.708835:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1784191986.708852:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1784191986.708858:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858828034688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.708891:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858828034688:12345-0@lo:400:kworker.0 Request processed in 33us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191986.708896:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1784191986.708918:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828034944 00000100:00100000:1.0:1784191986.708921:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828034944 00000100:00100000:1.0:1784191986.708951:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828035456 00000100:00100000:1.0:1784191986.708954:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828035456 00000100:00100000:1.0:1784191986.708971:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:1.0:1784191986.708975:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828034944:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784191986.709272:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784191986.709277:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784191986.709292:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:3.0:1784191986.709302:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828035456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191986.709541:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828034560 00000100:00100000:2.0:1784191986.709547:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828034560 00000100:00100000:2.0:1784191986.709674:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784191986.709682:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10efee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858828034560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.709840:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828034944:12345-0@lo:400:kworker.0 Request processed in 863us (1787us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191986.709849:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00100000:1.0:1784191986.709873:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828035200 00000100:00100000:1.0:1784191986.709877:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828035200 00000100:00100000:1.0:1784191986.709917:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828035712 00000100:00100000:1.0:1784191986.709920:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828035712 00000100:00100000:1.0:1784191986.710542:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1784191986.710556:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828035200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.710627:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828035200:12345-0@lo:400:kworker.0 Request processed in 76us (2290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191986.710634:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1784191986.710650:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1784191986.710656:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828035712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.710706:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828035712:12345-0@lo:400:kworker.0 Request processed in 31us (2311us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191986.710712:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1784191986.710778:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858828034688:0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.710797:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828035200:0@lo:400:kworker.0 00000100:00100000:3.0:1784191986.710806:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828035456:12345-0@lo:400:kworker.0 Request processed in 1504us (2703us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191986.710811:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828035712:0@lo:400:kworker.0 00000100:00100000:3.0:1784191986.710821:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:1.0:1784191986.710865:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828034944:0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.710880:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828035456:0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.710897:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858828035968:0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.710914:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858828034816:0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.710927:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858828035328:0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.710951:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858828035840:0@lo:400:kworker.0 00000100:00100000:0.0:1784191986.713790:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828035072:0@lo:400:kworker.0 00000100:00100000:0.0:1784191986.713867:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191986.713908:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828035584:0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.714070:0:162390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828035072 00000100:00100000:1.0:1784191986.714079:0:162390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828035072 00000100:00100000:1.0:1784191986.714223:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1784191986.714302:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828035072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.714373:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828035072:12345-0@lo:400:kworker.0 Request processed in 141us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191986.714380:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:1.0:1784191986.714404:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191986.715134:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191986.715186:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858828036096:0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.715230:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828035584 00000100:00100000:0.0:1784191986.715233:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191986.715248:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828035584 00010000:00080000:0.0:1784191986.715284:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af20cf25880 x1870858828035072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784191986.715296:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1784191986.715302:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828035072:0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.715306:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828035584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191986.715356:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828035584:12345-0@lo:400:kworker.0 Request processed in 53us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191986.715363:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:1.0:1784191986.715380:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784191986.715845:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10efee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858828034560:12345-0@lo:400:kworker.0 Request processed in 6162us (8788us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191986.715855:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784191986.716539:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828036096 00000100:00100000:0.0:1784191986.716547:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828036096 00000100:00100000:0.0:1784191986.716757:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:0.0:1784191986.716777:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858828036096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191986.716842:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858828036096:12345-0@lo:400:kworker.0 Request processed in 76us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191986.716849:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:0.0:1784191986.716888:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858828034560:0@lo:400:kworker.0 00010000:00080000:0.0:1784191986.716906:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af20cf25500 x1870858828035584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784191986.716917:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828035584:0@lo:400:kworker.0 00000100:00100000:0.0:1784191986.716929:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858828036096:0@lo:400:kworker.0 00000100:00080000:1.0:1784191986.717076:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1784191986.774342:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784191987.788599:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191988.236532:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828036224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784191988.236623:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191988.236832:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828036224 00000100:00100000:2.0:1784191988.236841:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828036224 00000100:00100000:2.0:1784191988.236908:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1784191988.236918:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828036224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784191988.236948:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 38084608 avail 30916608 00000100:00080000:0.0:1784191988.237068:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191988.241399:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828036352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784191988.241494:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191988.241560:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828036352 00000100:00100000:0.0:1784191988.241571:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828036352 00000100:00100000:0.0:1784191988.241625:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1784191988.241634:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828036352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784191988.241662:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 38084608 avail 30916608 00000100:00100000:0.0:1784191988.241728:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828036352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191988.241735:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00080000:0.0:1784191988.241772:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784191988.241802:0:106501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af20cf25500 x1870858828036352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784191988.241823:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828036352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784191988.251066:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828036224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 14125us (14419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191988.251085:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00010000:00080000:1.0:1784191988.251536:0:106500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af20cf27480 x1870858828036224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784191988.251574:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828036224:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784191988.811881:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784191989.148103:0:169882:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1784191989.772149:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828036480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784191989.772228:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191989.775345:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828036480 00000100:00100000:3.0:1784191989.775361:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828036480 00000100:00100000:3.0:1784191989.775426:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:3.0:1784191989.775437:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828036480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784191989.775478:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:3.0:1784191989.775608:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828036480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 173us (3380us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191989.775616:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:0.0:1784191989.780280:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828036480:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784191989.836751:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191990.283891:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784191990.283919:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828036608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784191990.284001:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191990.284197:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784191990.284208:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828036736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191990.284245:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191990.284281:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828036608 00000100:00100000:0.0:1784191990.284290:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828036608 00000100:00100000:0.0:1784191990.284353:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1784191990.284366:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828036608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784191990.284399:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:0.0:1784191990.284440:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828036608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191990.284457:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1784191990.284483:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828036736 00000100:00100000:0.0:1784191990.284487:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828036736 00000100:00100000:0.0:1784191990.284511:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:0.0:1784191990.284517:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828036736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784191990.284546:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:0.0:1784191990.284586:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828036736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191990.284592:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00080000:0.0:1784191990.284608:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784191990.284647:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828036736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784191990.284750:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828036608:0@lo:13:osp-pre-1-1.0 00000020:00000004:3.0:1784191990.524087:0:169934:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784191990.524417:0:169934:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784191990.797335:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784191990.797371:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828036864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784191990.797473:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191990.797547:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828036864 00000100:00100000:0.0:1784191990.797554:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828036864 00000100:00100000:0.0:1784191990.797614:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1784191990.797622:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828036864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784191990.797649:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:0.0:1784191990.797733:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828036864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191990.797741:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:0.0:1784191990.797766:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784191990.797807:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828036864:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784191990.861581:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191991.640648:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191991.640744:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812499200 00000100:00100000:0.0:1784191991.640749:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191991.640759:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812499200 00000100:00100000:0.0:1784191991.640789:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191991.640827:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191991.640835:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 124 00000100:00100000:3.0:1784191991.640848:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2028c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812499200:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191991.640856:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812499328 00000100:00100000:0.0:1784191991.640863:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812499328 00000100:00100000:0.0:1784191991.640915:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812499456 00000100:00100000:0.0:1784191991.640919:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812499456 00000100:00100000:0.0:1784191991.640946:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 480 00000100:00100000:3.0:1784191991.640958:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2028c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812499200:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 109us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191991.640959:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69111:x1870858812499328:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191991.640973:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 124 00000100:00100000:0.0:1784191991.641001:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69111:x1870858812499328:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 45us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191991.641009:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 480 00000100:00100000:0.0:1784191991.641030:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 481 00000100:00100000:0.0:1784191991.641036:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812499456:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784191991.641064:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812499456:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 28us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191991.641070:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 481 00000100:00080000:0.0:1784191991.641095:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784191991.641100:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784191991.642597:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812499584 00000100:00100000:1.0:1784191991.642615:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812499584 00000100:00100000:1.0:1784191991.642728:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 259 00000100:00100000:1.0:1784191991.642741:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812499584:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784191991.642827:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812499584:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 89us (2079us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191991.642835:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 259 00000100:00080000:0.0:1784191991.643227:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:2.0:1784191991.692230:0:169984:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784191991.692475:0:169984:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784191991.820016:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828036992:0@lo:400:kworker.0 00000100:00100000:2.0:1784191991.820108:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191991.820790:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828037376:0@lo:400:kworker.0 00000100:00100000:1.0:1784191991.820829:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191991.820872:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828037376 00000100:00100000:1.0:1784191991.820880:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828037376 00000100:00100000:1.0:1784191991.820922:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:1.0:1784191991.820930:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828037376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191991.820978:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828037376:12345-0@lo:400:kworker.0 Request processed in 49us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191991.820986:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:1.0:1784191991.821025:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828037376:0@lo:400:kworker.0 00000100:00100000:1.0:1784191991.823419:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828037248:0@lo:400:kworker.0 00000100:00100000:1.0:1784191991.823501:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191991.823553:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784191991.823560:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858828037120:0@lo:400:kworker.0 00000100:00100000:1.0:1784191991.823584:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191991.823626:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828037248 00000100:00100000:1.0:1784191991.823634:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828037248 00000100:00100000:1.0:1784191991.823723:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828037120 00000100:00100000:1.0:1784191991.823726:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828037120 00000100:00100000:1.0:1784191991.823752:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1784191991.823760:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828037248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191991.823815:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828037248:12345-0@lo:400:kworker.0 Request processed in 56us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191991.823823:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1784191991.823839:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:1.0:1784191991.823845:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858828037120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784191991.823888:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858828037120:12345-0@lo:400:kworker.0 Request processed in 43us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191991.823893:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00080000:1.0:1784191991.823915:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784191991.823919:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784191991.823954:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858828037120:0@lo:400:kworker.0 00000100:00100000:1.0:1784191991.823964:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828037248:0@lo:400:kworker.0 00000100:00100000:2.0:1784191991.824342:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828036992 00000100:00100000:2.0:1784191991.824404:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828036992 00000100:00100000:2.0:1784191991.824441:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1784191991.824448:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2028c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828036992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191991.824487:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2028c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828036992:12345-0@lo:400:kworker.0 Request processed in 40us (4379us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191991.824501:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1784191991.824545:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828036992:0@lo:400:kworker.0 00000100:00100000:0.0:1784191991.825102:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784191991.825114:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828037504:0@lo:400:kworker.0 00000100:00100000:0.0:1784191991.825151:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191991.825235:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828037632:0@lo:400:kworker.0 00000100:00100000:0.0:1784191991.825267:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191991.825296:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828037504 00000100:00100000:0.0:1784191991.825300:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828037504 00000100:00100000:0.0:1784191991.825343:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828037632 00000100:00100000:0.0:1784191991.825346:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828037632 00000100:00100000:0.0:1784191991.825494:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1784191991.825501:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828037504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191991.825545:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828037504:12345-0@lo:400:kworker.0 Request processed in 44us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191991.825551:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1784191991.825567:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1784191991.825573:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828037632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191991.825602:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828037632:12345-0@lo:400:kworker.0 Request processed in 30us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191991.825608:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:0.0:1784191991.825623:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784191991.825649:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828037632:0@lo:400:kworker.0 00010000:00080000:0.0:1784191991.825684:0:106501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22dfaa300 x1870858828037504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784191991.825719:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828037504:0@lo:400:kworker.0 00000100:00100000:0.0:1784191991.825751:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784191991.825757:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858828037760:0@lo:400:kworker.0 00000100:00100000:0.0:1784191991.825785:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191991.825811:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828037760 00000100:00100000:0.0:1784191991.825814:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828037760 00000100:00100000:0.0:1784191991.825842:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1784191991.825848:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858828037760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191991.825884:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858828037760:12345-0@lo:400:kworker.0 Request processed in 36us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191991.825900:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1784191991.825930:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858828037760:0@lo:400:kworker.0 00000100:00100000:0.0:1784191991.825958:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828037888:0@lo:400:kworker.0 00000100:00100000:0.0:1784191991.825982:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191991.826008:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828037888 00000100:00100000:0.0:1784191991.826012:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828037888 00000100:00100000:0.0:1784191991.826037:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:0.0:1784191991.826043:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828037888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191991.826083:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828037888:12345-0@lo:400:kworker.0 Request processed in 40us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191991.826089:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00100000:0.0:1784191991.826113:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828037888:0@lo:400:kworker.0 00000100:00100000:0.0:1784191991.826137:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784191991.826142:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828038016:0@lo:400:kworker.0 00000100:00100000:0.0:1784191991.826163:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191991.826198:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828038144:0@lo:400:kworker.0 00000100:00100000:0.0:1784191991.826218:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191991.826535:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784191991.826544:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858828038272:0@lo:400:kworker.0 00000100:00100000:0.0:1784191991.826568:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191991.826649:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828038016 00000100:00100000:2.0:1784191991.826653:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828038016 00000100:00100000:2.0:1784191991.826712:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828038144 00000100:00100000:2.0:1784191991.826715:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828038144 00000100:00100000:2.0:1784191991.826738:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1784191991.826744:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828038016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191991.826784:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828038016:12345-0@lo:400:kworker.0 Request processed in 40us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191991.826790:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1784191991.826803:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1784191991.826808:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828038144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191991.826833:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828038144:12345-0@lo:400:kworker.0 Request processed in 25us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191991.826839:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:2.0:1784191991.826859:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784191991.826883:0:106501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22dfaa300 x1870858828038016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784191991.826893:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828038016:0@lo:400:kworker.0 00000100:00100000:0.0:1784191991.827018:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828038144:0@lo:400:kworker.0 00000100:00100000:2.0:1784191991.827114:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858828038400:0@lo:400:kworker.0 00000100:00100000:2.0:1784191991.827144:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191991.827509:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784191991.827516:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:106501:1870858828038528:0@lo:400:kworker.0 00000100:00100000:2.0:1784191991.827564:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191991.827628:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828038272 00000100:00100000:3.0:1784191991.827634:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828038272 00000100:00100000:3.0:1784191991.827709:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828038400 00000100:00100000:3.0:1784191991.827713:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828038400 00000100:00100000:3.0:1784191991.827744:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:3.0:1784191991.827751:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858828038272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191991.827800:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858828038272:12345-0@lo:400:kworker.0 Request processed in 50us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191991.827806:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:3.0:1784191991.827821:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1784191991.827826:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858828038400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784191991.827853:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858828038400:12345-0@lo:400:kworker.0 Request processed in 27us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191991.827859:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:2.0:1784191991.828925:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858828038400:0@lo:400:kworker.0 00000100:00080000:2.0:1784191991.828959:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784191991.830587:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858828038272:0@lo:400:kworker.0 00000100:00100000:0.0:1784191991.831013:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828038528 00000100:00100000:0.0:1784191991.831024:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828038528 00000100:00100000:0.0:1784191991.831101:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:0.0:1784191991.831119:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106501:x1870858828038528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784191991.831209:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106501:x1870858828038528:12345-0@lo:400:kworker.0 Request processed in 92us (3643us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191991.831229:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:0.0:1784191991.831279:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:106501:1870858828038528:0@lo:400:kworker.0 00000100:00080000:3.0:1784191991.831607:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784191991.864969:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191991.865106:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812499712 00000100:00100000:3.0:1784191991.865120:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812499712 00000100:00100000:3.0:1784191991.865197:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 830 00000100:00100000:3.0:1784191991.865208:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125705:x1870858812499712:12345-192.168.204.16@tcp:41:lfs.0 00000004:00000024:3.0:1784191991.865278:0:158667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:3.0:1784191991.865386:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:125705:x1870858812499712:12345-192.168.204.16@tcp:41:lfs.0 Request processed in 179us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191991.865394:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 830 00000100:00100000:1.0:1784191991.870530:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784191991.870745:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812499840 00000100:00100000:3.0:1784191991.870755:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812499840 00000100:00100000:3.0:1784191991.870816:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 831 00000100:00100000:3.0:1784191991.870826:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:125705:x1870858812499840:12345-192.168.204.16@tcp:41:lfs.0 00000004:00000024:3.0:1784191991.870883:0:158665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:3.0:1784191991.870974:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:125705:x1870858812499840:12345-192.168.204.16@tcp:41:lfs.0 Request processed in 149us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191991.870981:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 831 00000100:00100000:3.0:1784191991.876493:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191991.877394:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812499968 00000100:00100000:0.0:1784191991.877419:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812499968 00000100:00100000:0.0:1784191991.877503:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 243 00000100:00100000:0.0:1784191991.877514:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:125705:x1870858812499968:12345-192.168.204.16@tcp:13:lfs.0 00002000:00000024:0.0:1784191991.877550:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 38084608 avail 30916608 00000100:00100000:0.0:1784191991.877647:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:125705:x1870858812499968:12345-192.168.204.16@tcp:13:lfs.0 Request processed in 134us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191991.877655:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 243 00000100:00100000:0.0:1784191991.879875:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784191991.880373:0:162390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812500096 00000100:00100000:1.0:1784191991.880383:0:162390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812500096 00000100:00100000:1.0:1784191991.880430:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 466 00000100:00100000:1.0:1784191991.880437:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:69108:x1870858812500096:12345-192.168.204.16@tcp:8:lfs.0 00010000:00080000:1.0:1784191991.880474:0:162390:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a@192.168.204.16@tcp t0 exp 0000000000000000 cur 5612 last 0 00000020:00000080:1.0:1784191991.880505:0:162390:0:(genops.c:1406:class_connect()) connect: client 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a, cookie 0xfeec3c2dc5a4d689 00002000:00100000:1.0:1784191991.880517:0:162390:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a/ffff8af101783800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 59170816 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784191991.880534:0:162390:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784191991.880623:0:162390:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784191991.880657:0:162390:0:(import.c:65:import_set_state_nolock()) ffff8af101784800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784191991.880760:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69108:x1870858812500096:12345-192.168.204.16@tcp:8:lfs.0 Request processed in 321us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191991.880768:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 466 00010000:00010000:3.0:1784191991.884827:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191991.887157:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784191991.887235:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812500224 00000100:00100000:0.0:1784191991.887258:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812500224 00000100:00080000:3.0:1784191991.887337:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784191991.887351:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 244 00000100:00100000:0.0:1784191991.887363:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:125705:x1870858812500224:12345-192.168.204.16@tcp:13:lfs.0 00002000:00000024:0.0:1784191991.887394:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7816256 pending 0 free 67768320 avail 60600320 00000100:00100000:0.0:1784191991.887483:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:125705:x1870858812500224:12345-192.168.204.16@tcp:13:lfs.0 Request processed in 122us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191991.887491:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 244 00010000:00010000:2.0:1784191992.909944:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191993.356067:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828038656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784191993.356152:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191993.356303:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828038656 00000100:00100000:0.0:1784191993.356312:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828038656 00000100:00100000:0.0:1784191993.356396:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1784191993.356409:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828038656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784191993.356452:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 38084608 avail 30916608 00000100:00100000:0.0:1784191993.356513:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828038656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191993.356521:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00010000:00080000:0.0:1784191993.356599:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22dfa8380 x1870858828038656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784191993.356618:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828038656:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784191993.356972:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784191993.357151:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784191993.357226:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828038784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784191993.357262:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191993.366060:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828038784 00000100:00100000:0.0:1784191993.366077:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828038784 00000100:00100000:0.0:1784191993.366254:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1784191993.366267:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828038784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784191993.366307:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 38084608 avail 30916608 00000100:00100000:0.0:1784191993.366411:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828038784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (9147us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191993.366418:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00010000:00080000:2.0:1784191993.367767:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22dfa8380 x1870858828038784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784191993.367793:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828038784:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784191993.374931:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784191993.932027:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784191994.828194:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828039296:0@lo:400:kworker.0 00000100:00100000:1.0:1784191994.828289:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191994.828337:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828039808:0@lo:400:kworker.0 00000100:00100000:1.0:1784191994.828360:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191994.828378:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858828040320:0@lo:400:kworker.0 00000100:00100000:1.0:1784191994.828403:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191994.828432:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784191994.828439:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828039168:0@lo:400:kworker.0 00000100:00100000:1.0:1784191994.828462:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191994.828482:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858828039680:0@lo:400:kworker.0 00000100:00100000:1.0:1784191994.828502:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191994.828518:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:106500:1870858828040192:0@lo:400:kworker.0 00000100:00100000:1.0:1784191994.828552:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191994.828592:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828039296 00000100:00100000:1.0:1784191994.828601:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828039296 00000100:00100000:1.0:1784191994.828677:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828039808 00000100:00100000:1.0:1784191994.828680:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828039808 00000100:00100000:1.0:1784191994.828736:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1784191994.828746:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828039296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.829185:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828039040:0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.829223:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191994.829244:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20cf24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828039552:0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.829268:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191994.829287:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828040064:0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.829317:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191994.829339:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1784191994.829346:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828038912:0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.829375:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191994.829404:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828039424:0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.829442:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191994.829457:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828039936:0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.829478:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191994.829498:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828040448:0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.829517:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784191994.829560:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828039552 00000100:00100000:2.0:1784191994.829566:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828039552 00000100:00100000:2.0:1784191994.829610:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828040064 00000100:00100000:2.0:1784191994.829799:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828040064 00000100:00100000:2.0:1784191994.829831:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828039424 00000100:00100000:2.0:1784191994.829834:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828039424 00000100:00100000:2.0:1784191994.829851:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828039936 00000100:00100000:2.0:1784191994.829854:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828039936 00000100:00100000:2.0:1784191994.829870:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1784191994.829877:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828039552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.829921:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828039552:12345-0@lo:400:kworker.0 Request processed in 44us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191994.829928:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1784191994.829945:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1784191994.829950:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828040064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.829978:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828040064:12345-0@lo:400:kworker.0 Request processed in 27us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191994.829984:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1784191994.829995:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1784191994.830000:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828039424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.830025:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828039424:12345-0@lo:400:kworker.0 Request processed in 25us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191994.830040:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1784191994.830052:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1784191994.830058:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828039936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.830087:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828039936:12345-0@lo:400:kworker.0 Request processed in 29us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191994.830093:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1784191994.830116:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828038912 00000100:00100000:2.0:1784191994.830120:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828038912 00000100:00100000:2.0:1784191994.830144:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1784191994.830150:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10138c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828038912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.830196:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10138c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828038912:12345-0@lo:400:kworker.0 Request processed in 45us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191994.830203:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1784191994.830236:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784191994.830272:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828038912:0@lo:400:kworker.0 00010000:00080000:2.0:1784191994.830287:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22dc82680 x1870858828039424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784191994.830298:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828039424:0@lo:400:kworker.0 00010000:00080000:2.0:1784191994.830308:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22de46300 x1870858828039936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784191994.830323:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828039936:0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.830336:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828039552:0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.830344:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828040064:0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.830416:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828040320 00000100:00100000:2.0:1784191994.830420:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828040320 00000100:00100000:2.0:1784191994.830450:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828039168 00000100:00100000:2.0:1784191994.830453:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828039168 00000100:00100000:2.0:1784191994.830465:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828039680 00000100:00100000:2.0:1784191994.830468:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828039680 00000100:00100000:2.0:1784191994.830478:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828040192 00000100:00100000:2.0:1784191994.830480:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828040192 00000100:00100000:2.0:1784191994.830489:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828039040 00000100:00100000:2.0:1784191994.830491:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828039040 00000100:00100000:2.0:1784191994.830500:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828040448 00000100:00100000:2.0:1784191994.830503:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828040448 00000100:00100000:2.0:1784191994.830515:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1784191994.830521:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858828040320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.830575:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858828040320:12345-0@lo:400:kworker.0 Request processed in 53us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191994.830582:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1784191994.830594:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1784191994.830599:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828039168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.830644:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828039168:12345-0@lo:400:kworker.0 Request processed in 44us (2181us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191994.830650:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1784191994.830661:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1784191994.830666:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858828039680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.830718:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858828039680:12345-0@lo:400:kworker.0 Request processed in 51us (2214us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191994.830724:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1784191994.830736:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:2.0:1784191994.830748:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106500:x1870858828040192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.830779:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106500:x1870858828040192:12345-0@lo:400:kworker.0 Request processed in 32us (2226us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191994.830785:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:2.0:1784191994.830797:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:2.0:1784191994.830803:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828039040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.830834:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828039040:12345-0@lo:400:kworker.0 Request processed in 31us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191994.830840:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:2.0:1784191994.830854:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1784191994.830860:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828040448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.830886:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828040448:12345-0@lo:400:kworker.0 Request processed in 27us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191994.830892:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1784191994.830926:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:2.0:1784191994.830935:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828039808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.830965:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828039808:12345-0@lo:400:kworker.0 Request processed in 33us (2604us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191994.830972:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00080000:2.0:1784191994.830991:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784191994.830995:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784191994.831014:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828040448:0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.831025:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828039040:0@lo:400:kworker.0 00000100:00100000:1.0:1784191994.831923:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828039296:12345-0@lo:400:kworker.0 Request processed in 3173us (3628us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191994.831934:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1784191994.831986:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828039168:0@lo:400:kworker.0 00000100:00100000:1.0:1784191994.831999:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20cf27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858828039680:0@lo:400:kworker.0 00000100:00100000:1.0:1784191994.832009:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:106500:1870858828040192:0@lo:400:kworker.0 00000100:00100000:1.0:1784191994.832032:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828039296:0@lo:400:kworker.0 00000100:00100000:1.0:1784191994.832041:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828039808:0@lo:400:kworker.0 00000100:00100000:1.0:1784191994.832051:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858828040320:0@lo:400:kworker.0 00000100:00100000:2.0:1784191994.907079:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828040576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784191994.907163:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784191994.907640:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828040576 00000100:00100000:3.0:1784191994.907649:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828040576 00000100:00100000:3.0:1784191994.907719:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:3.0:1784191994.907729:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828040576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784191994.907771:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:3.0:1784191994.907908:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828040576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 180us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191994.907916:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00100000:1.0:1784191994.908249:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828040576:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784191994.971304:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784191995.413490:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828040704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784191995.413573:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191995.413627:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784191995.413635:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828040832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191995.413664:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784191995.413728:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828040704 00000100:00100000:0.0:1784191995.413736:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828040704 00000100:00100000:0.0:1784191995.413784:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1784191995.413793:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828040704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784191995.413825:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7816256 pending 0 free 67768320 avail 60600320 00000100:00100000:0.0:1784191995.413897:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828040704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191995.413905:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1784191995.413932:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828040832 00000100:00100000:0.0:1784191995.413935:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828040832 00000100:00100000:0.0:1784191995.413962:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:0.0:1784191995.413969:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828040832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784191995.413995:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:0.0:1784191995.414027:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828040832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1784191995.414034:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00100000:0.0:1784191995.414095:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828040832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784191995.414112:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828040704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784191995.933799:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784191995.933844:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828040960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784191995.933924:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191995.934539:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828040960 00000100:00100000:1.0:1784191995.934552:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828040960 00000100:00100000:1.0:1784191995.934627:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1784191995.934638:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828040960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784191995.934669:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7816256 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784191995.934756:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828040960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191995.934764:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1784191995.935012:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828040960:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784191995.981221:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784191996.756386:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191996.756445:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191996.756479:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191996.756509:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191996.756530:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784191996.756558:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812500864 00000100:00100000:2.0:1784191996.756568:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812500864 00000100:00100000:2.0:1784191996.756643:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812500736 00000100:00100000:2.0:1784191996.756647:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812500736 00000100:00100000:2.0:1784191996.756673:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 268 00000100:00100000:2.0:1784191996.756685:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69110:x1870858812500864:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191996.757029:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69110:x1870858812500864:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 343us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191996.757038:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 268 00000100:00100000:2.0:1784191996.757061:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 269 00000100:00100000:2.0:1784191996.757068:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812500736:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191996.757096:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812500736:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 29us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191996.757102:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 269 00000100:00100000:2.0:1784191996.757127:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812500608 00000100:00100000:2.0:1784191996.757131:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812500608 00000100:00100000:2.0:1784191996.757242:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812500480 00000100:00100000:2.0:1784191996.757246:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812500480 00000100:00100000:2.0:1784191996.757273:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 494 00000100:00100000:2.0:1784191996.757279:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812500608:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191996.757338:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812500608:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 59us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191996.757344:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 494 00000100:00100000:2.0:1784191996.757358:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 495 00000100:00100000:2.0:1784191996.757364:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812500480:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784191996.757388:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812500480:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 25us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1784191996.757395:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 495 00000100:00080000:2.0:1784191996.757500:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784191996.757505:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784191996.757508:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784191996.757510:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784191996.758046:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812500352 00000100:00100000:3.0:1784191996.758062:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812500352 00000100:00100000:3.0:1784191996.758097:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 127 00000100:00100000:3.0:1784191996.758104:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10138d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812500352:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784191996.758139:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10138d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812500352:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 35us (1780us total) trans 0 rc 0/0 00000100:00100000:3.0:1784191996.758146:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 127 00010000:00010000:3.0:1784191997.004552:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784191997.966723:0:160977:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00010000:00010000:2.0:1784191998.028074:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784191998.477266:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828041088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784191998.477365:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191998.477531:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828041088 00000100:00100000:1.0:1784191998.477541:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828041088 00000100:00100000:1.0:1784191998.477618:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1784191998.477629:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828041088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784191998.477662:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 38084608 avail 30916608 00000100:00100000:1.0:1784191998.477736:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828041088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191998.477744:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00080000:3.0:1784191998.477938:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784191998.477971:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22de45880 x1870858828041088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784191998.477990:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828041088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784191998.480984:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784191998.481012:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828041216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784191998.481087:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784191998.481303:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828041216 00000100:00100000:1.0:1784191998.481312:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828041216 00000100:00100000:1.0:1784191998.481502:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1784191998.481519:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828041216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784191998.481541:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 38084608 avail 30916608 00000100:00100000:1.0:1784191998.481599:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828041216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1784191998.481606:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:3.0:1784191998.481672:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784191998.481718:0:106500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22de46d80 x1870858828041216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784191998.481737:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828041216:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1784191998.612204:0:170227:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 00000001:02000400:0.0:1784191998.925718:0:170251:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1784191999.062832:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784192000.012061:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828041344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784192000.012154:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192000.012394:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828041600:0@lo:400:kworker.0 00000100:00100000:0.0:1784192000.012428:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192000.012456:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828042112:0@lo:400:kworker.0 00000100:00100000:0.0:1784192000.012481:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192000.012514:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828042624:0@lo:400:kworker.0 00000100:00100000:0.0:1784192000.012547:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192000.012566:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1784192000.012572:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828041472:0@lo:400:kworker.0 00000100:00100000:0.0:1784192000.012603:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192000.012621:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828041984:0@lo:400:kworker.0 00000100:00100000:0.0:1784192000.012671:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192000.012715:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828042496:0@lo:400:kworker.0 00000100:00100000:0.0:1784192000.012737:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192000.012765:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828041600 00000100:00100000:0.0:1784192000.012772:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828041600 00000100:00100000:0.0:1784192000.012820:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828042624 00000100:00100000:0.0:1784192000.012823:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828042624 00000100:00100000:0.0:1784192000.012840:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:0.0:1784192000.012849:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828041600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192000.012898:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828041600:12345-0@lo:400:kworker.0 Request processed in 50us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192000.012906:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:0.0:1784192000.012925:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:0.0:1784192000.012931:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828042624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192000.012957:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828042624:12345-0@lo:400:kworker.0 Request processed in 26us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192000.012963:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:0.0:1784192000.012981:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828042112 00000100:00100000:0.0:1784192000.012985:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828042112 00000100:00100000:0.0:1784192000.013006:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828041984 00000100:00100000:0.0:1784192000.013009:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828041984 00000100:00100000:0.0:1784192000.013021:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828042496 00000100:00100000:0.0:1784192000.013022:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828042496 00000100:00100000:0.0:1784192000.013038:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1784192000.013043:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828042112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192000.013072:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828042112:12345-0@lo:400:kworker.0 Request processed in 29us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192000.013087:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1784192000.013098:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1784192000.013104:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828041984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192000.013132:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828041984:12345-0@lo:400:kworker.0 Request processed in 28us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192000.013138:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1784192000.013149:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1784192000.013154:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828042496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192000.013179:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828042496:12345-0@lo:400:kworker.0 Request processed in 25us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192000.013185:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:0.0:1784192000.013207:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784192000.013211:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784192000.013214:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784192000.013243:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22dfaad80 x1870858828041984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192000.013258:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828041984:0@lo:400:kworker.0 00000100:00100000:0.0:1784192000.013271:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828042496:0@lo:400:kworker.0 00000100:00100000:0.0:1784192000.013280:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828041600:0@lo:400:kworker.0 00000100:00100000:0.0:1784192000.013289:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828042112:0@lo:400:kworker.0 00000100:00100000:0.0:1784192000.013298:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828042624:0@lo:400:kworker.0 00000100:00100000:1.0:1784192000.013470:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828041344 00000100:00100000:1.0:1784192000.013475:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828041344 00000100:00100000:1.0:1784192000.013535:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:1.0:1784192000.013543:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828041344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784192000.013573:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:1.0:1784192000.013613:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828041344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192000.013619:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:2.0:1784192000.013772:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828041472 00000100:00100000:2.0:1784192000.013777:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828041472 00000100:00100000:2.0:1784192000.013804:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1784192000.013810:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af206f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828041472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192000.013848:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af206f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828041472:12345-0@lo:400:kworker.0 Request processed in 39us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192000.013855:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1784192000.013898:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858828041728:0@lo:400:kworker.0 00000100:00100000:2.0:1784192000.013922:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192000.013940:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858828042240:0@lo:400:kworker.0 00000100:00100000:2.0:1784192000.013970:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192000.014001:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858828042752:0@lo:400:kworker.0 00000100:00100000:2.0:1784192000.014022:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192000.014041:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784192000.014047:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828041856:0@lo:400:kworker.0 00000100:00100000:2.0:1784192000.014069:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192000.014094:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828042368:0@lo:400:kworker.0 00000100:00100000:2.0:1784192000.014115:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192000.014134:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858828042880:0@lo:400:kworker.0 00000100:00100000:2.0:1784192000.014153:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192000.014176:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828041728 00000100:00100000:2.0:1784192000.014180:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828041728 00000100:00100000:2.0:1784192000.014208:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828042240 00000100:00100000:2.0:1784192000.014211:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828042240 00000100:00100000:2.0:1784192000.014221:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828042752 00000100:00100000:2.0:1784192000.014224:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828042752 00000100:00100000:2.0:1784192000.014235:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828042880 00000100:00100000:2.0:1784192000.014237:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828042880 00000100:00100000:2.0:1784192000.014249:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1784192000.014254:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858828041728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192000.014288:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858828041728:12345-0@lo:400:kworker.0 Request processed in 34us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192000.014294:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1784192000.014310:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:2.0:1784192000.014316:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858828042240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192000.014345:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858828042240:12345-0@lo:400:kworker.0 Request processed in 30us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192000.014361:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:2.0:1784192000.014375:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1784192000.014381:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858828042752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192000.014411:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858828042752:12345-0@lo:400:kworker.0 Request processed in 31us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192000.014416:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1784192000.014427:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:2.0:1784192000.014432:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858828042880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192000.014456:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858828042880:12345-0@lo:400:kworker.0 Request processed in 24us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192000.014460:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:2.0:1784192000.014476:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828041856 00000100:00100000:2.0:1784192000.014479:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828041856 00000100:00100000:2.0:1784192000.014501:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:2.0:1784192000.014506:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828041856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192000.014546:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828041856:12345-0@lo:400:kworker.0 Request processed in 39us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192000.014552:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:2.0:1784192000.014569:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828042368 00000100:00100000:2.0:1784192000.014572:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828042368 00000100:00100000:2.0:1784192000.014596:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1784192000.014602:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828042368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192000.014629:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828042368:12345-0@lo:400:kworker.0 Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192000.014635:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:2.0:1784192000.014666:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784192000.014669:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784192000.014671:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784192000.014721:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828041344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784192000.014747:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828041856:0@lo:400:kworker.0 00010000:00080000:2.0:1784192000.014757:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22dfa9c00 x1870858828042368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784192000.014766:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828042368:0@lo:400:kworker.0 00000100:00100000:2.0:1784192000.014774:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858828042880:0@lo:400:kworker.0 00000100:00100000:2.0:1784192000.014781:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858828041728:0@lo:400:kworker.0 00000100:00100000:2.0:1784192000.014790:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858828042240:0@lo:400:kworker.0 00000100:00100000:2.0:1784192000.014798:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858828042752:0@lo:400:kworker.0 00000100:00100000:2.0:1784192000.014827:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828041472:0@lo:400:kworker.0 00010000:00010000:3.0:1784192000.089477:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784192000.524103:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784192000.524133:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828043008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784192000.524214:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192000.524471:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784192000.524483:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828043136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784192000.524532:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192000.524645:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828043008 00000100:00100000:2.0:1784192000.524650:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828043136 00000100:00100000:2.0:1784192000.524655:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828043136 00000100:00100000:0.0:1784192000.524655:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828043008 00000100:00100000:0.0:1784192000.524725:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1784192000.524734:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:0.0:1784192000.524734:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828043008:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784192000.524740:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828043136:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:0.0:1784192000.524771:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7816256 pending 0 free 67768320 avail 60600320 00000004:00000024:2.0:1784192000.524772:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:2.0:1784192000.524824:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828043136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192000.524825:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828043008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192000.524833:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00100000:0.0:1784192000.524833:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1784192000.524969:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828043136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784192000.534937:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828043008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784192001.043755:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784192001.043779:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828043264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784192001.043848:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192001.043901:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828043264 00000100:00100000:1.0:1784192001.043910:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828043264 00000100:00100000:1.0:1784192001.043961:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1784192001.043970:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828043264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784192001.043995:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7816256 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784192001.044039:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828043264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192001.044064:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1784192001.044116:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828043264:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784192001.100042:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784192001.880189:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784192001.880254:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784192001.880288:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784192001.880313:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784192001.880341:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784192001.880372:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812501376 00000100:00100000:2.0:1784192001.880381:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812501376 00000100:00100000:2.0:1784192001.880449:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812501504 00000100:00100000:2.0:1784192001.880452:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812501504 00000100:00100000:2.0:1784192001.880477:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 274 00000100:00100000:2.0:1784192001.880495:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812501376:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784192001.880570:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69110:x1870858812501376:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 76us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192001.880577:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 274 00000100:00100000:2.0:1784192001.880597:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 275 00000100:00100000:2.0:1784192001.880603:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812501504:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784192001.880626:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812501504:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 24us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192001.880632:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 275 00000100:00100000:2.0:1784192001.880650:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812501120 00000100:00100000:2.0:1784192001.880653:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812501120 00000100:00100000:2.0:1784192001.880731:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812501248 00000100:00100000:2.0:1784192001.880734:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812501248 00000100:00100000:2.0:1784192001.880755:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 502 00000100:00100000:2.0:1784192001.880762:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812501120:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784192001.880790:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812501120:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 29us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192001.880807:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 502 00000100:00100000:2.0:1784192001.880820:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 503 00000100:00100000:2.0:1784192001.880827:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69110:x1870858812501248:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784192001.880852:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69110:x1870858812501248:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 26us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192001.880858:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 503 00000100:00080000:2.0:1784192001.880879:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784192001.880883:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784192001.880887:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784192001.880889:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784192001.881249:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812500992 00000100:00100000:0.0:1784192001.881256:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812500992 00000100:00100000:0.0:1784192001.881285:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 129 00000100:00100000:0.0:1784192001.881292:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69112:x1870858812500992:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784192001.881326:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69112:x1870858812500992:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 35us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192001.881333:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 129 00010000:00010000:2.0:1784192002.124146:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784192003.156090:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784192003.596018:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784192003.596041:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af1016bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828043520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784192003.596119:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192003.596208:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828043520 00000100:00100000:0.0:1784192003.596217:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828043520 00000100:00100000:0.0:1784192003.596276:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1784192003.596285:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828043520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784192003.596322:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 38084608 avail 30916608 00000100:00100000:0.0:1784192003.596389:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828043520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192003.596396:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00010000:00080000:0.0:1784192003.596437:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af1016bfb80 x1870858828043520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192003.596478:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af1016bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828043520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784192003.597136:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828043392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784192003.597193:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784192003.597239:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784192003.602416:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828043392 00000100:00100000:0.0:1784192003.602433:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828043392 00000100:00100000:0.0:1784192003.602526:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1784192003.602537:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828043392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784192003.602565:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 38084608 avail 30916608 00000100:00100000:0.0:1784192003.602651:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828043392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (5467us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192003.602659:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00080000:2.0:1784192003.602885:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784192003.606836:0:106500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af101684e00 x1870858828043392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784192003.606869:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828043392:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784192004.176589:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784192005.131905:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784192005.131936:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828043648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784192005.132017:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192005.132082:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828043648 00000100:00100000:2.0:1784192005.132090:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828043648 00000100:00100000:2.0:1784192005.132146:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:2.0:1784192005.132162:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828043648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784192005.132204:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:2.0:1784192005.132589:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828043648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 434us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192005.132597:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:0.0:1784192005.132670:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828043648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784192005.133239:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858828043776:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.133281:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192005.133310:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828044288:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.133333:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192005.133362:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828044800:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.133381:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192005.133400:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784192005.133406:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858828043904:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.133443:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192005.133462:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828044416:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.133481:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192005.133496:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858828044928:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.133514:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192005.133549:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828043776 00000100:00100000:0.0:1784192005.133554:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828043776 00000100:00100000:0.0:1784192005.133587:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784192005.133594:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1014f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858828043776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.133635:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1014f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858828043776:12345-0@lo:400:kworker.0 Request processed in 41us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192005.133643:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784192005.133670:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828044288 00000100:00100000:0.0:1784192005.133673:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828044288 00000100:00100000:0.0:1784192005.133721:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828044800 00000100:00100000:0.0:1784192005.133724:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828044800 00000100:00100000:0.0:1784192005.133742:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828044416 00000100:00100000:0.0:1784192005.133745:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828044416 00000100:00100000:0.0:1784192005.133763:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1784192005.133770:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828044288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.133800:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828044288:12345-0@lo:400:kworker.0 Request processed in 31us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192005.133807:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1784192005.133818:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1784192005.133823:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828044800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.133865:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828044800:12345-0@lo:400:kworker.0 Request processed in 41us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192005.133871:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1784192005.133882:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1784192005.133887:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828044416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.133911:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828044416:12345-0@lo:400:kworker.0 Request processed in 24us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192005.133926:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1784192005.133949:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828043904 00000100:00100000:0.0:1784192005.133953:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828043904 00000100:00100000:0.0:1784192005.133980:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828044928 00000100:00100000:0.0:1784192005.133983:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828044928 00000100:00100000:0.0:1784192005.133999:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:0.0:1784192005.134004:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858828043904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134031:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858828043904:12345-0@lo:400:kworker.0 Request processed in 27us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192005.134036:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:0.0:1784192005.134046:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1784192005.134051:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858828044928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134078:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858828044928:12345-0@lo:400:kworker.0 Request processed in 27us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192005.134084:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00080000:0.0:1784192005.134106:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784192005.134111:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784192005.134112:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784192005.134135:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828044160:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134176:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192005.134195:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828044672:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134215:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192005.134232:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828045184:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134252:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192005.134269:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1784192005.134275:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858828044032:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134303:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192005.134318:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858828044544:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134335:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192005.134348:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858828045056:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134371:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192005.134396:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828044160 00000100:00100000:0.0:1784192005.134400:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828044160 00000100:00100000:0.0:1784192005.134439:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:0.0:1784192005.134445:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828044160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134478:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828044160:12345-0@lo:400:kworker.0 Request processed in 33us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192005.134484:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:0.0:1784192005.134500:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828045184 00000100:00100000:0.0:1784192005.134503:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828045184 00000100:00100000:0.0:1784192005.134525:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828044032 00000100:00100000:0.0:1784192005.134528:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828044032 00000100:00100000:0.0:1784192005.134539:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828044544 00000100:00100000:0.0:1784192005.134541:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828044544 00000100:00100000:0.0:1784192005.134550:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828045056 00000100:00100000:0.0:1784192005.134551:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828045056 00000100:00100000:0.0:1784192005.134563:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1784192005.134569:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828045184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134595:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828045184:12345-0@lo:400:kworker.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192005.134601:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1784192005.134610:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1784192005.134615:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858828044032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134646:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858828044032:12345-0@lo:400:kworker.0 Request processed in 31us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192005.134652:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1784192005.134664:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:0.0:1784192005.134670:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858828044544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134711:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858828044544:12345-0@lo:400:kworker.0 Request processed in 42us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192005.134716:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:0.0:1784192005.134726:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:0.0:1784192005.134731:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858828045056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134753:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858828045056:12345-0@lo:400:kworker.0 Request processed in 22us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192005.134758:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00080000:0.0:1784192005.134776:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784192005.134779:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784192005.134811:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858828044032:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134822:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858828044544:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134829:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858828045056:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134837:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828044160:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134845:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828045184:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134879:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858828043904:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134888:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828044416:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134910:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858828044928:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134918:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858828043776:0@lo:400:kworker.0 00010000:00080000:0.0:1784192005.134930:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af2331d6d80 x1870858828044288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192005.134941:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828044288:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134952:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828044800:0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.134994:0:162390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828044672 00000100:00100000:0.0:1784192005.134997:0:162390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828044672 00000100:00100000:0.0:1784192005.135036:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1784192005.135043:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1016bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828044672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192005.135076:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1016bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828044672:12345-0@lo:400:kworker.0 Request processed in 33us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192005.135081:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00010000:00080000:0.0:1784192005.135108:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af2331d5500 x1870858828044672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192005.135117:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828044672:0@lo:400:kworker.0 00000100:00080000:3.0:1784192005.144865:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784192005.203831:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784192005.643943:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784192005.643967:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828045312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784192005.644038:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192005.644091:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828045312 00000100:00100000:3.0:1784192005.644099:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828045312 00000100:00100000:3.0:1784192005.644164:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1784192005.644173:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828045312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784192005.644213:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7816256 pending 0 free 67768320 avail 60600320 00000100:00100000:3.0:1784192005.644260:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828045312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192005.644268:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1784192005.644315:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828045312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784192005.646480:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784192005.646504:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828045440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784192005.646570:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192005.646635:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828045440 00000100:00100000:3.0:1784192005.646642:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828045440 00000100:00100000:3.0:1784192005.646717:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:3.0:1784192005.646727:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828045440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784192005.646761:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:3.0:1784192005.646804:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828045440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192005.646811:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:3.0:1784192005.646878:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828045440:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1784192005.904232:0:170494:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 00000100:00100000:1.0:1784192006.155883:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784192006.155907:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828045568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784192006.155978:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192006.156032:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828045568 00000100:00100000:1.0:1784192006.156039:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828045568 00000100:00100000:1.0:1784192006.156088:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1784192006.156097:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828045568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784192006.156121:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7816256 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784192006.156165:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828045568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192006.156173:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1784192006.156222:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828045568:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784192006.225231:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784192006.473042:0:170518:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec 00000100:00100000:2.0:1784192007.002138:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784192007.002206:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784192007.002244:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784192007.002279:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784192007.002283:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812501632 00000100:00100000:3.0:1784192007.002294:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812501632 00000100:00100000:2.0:1784192007.002320:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784192007.002345:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812501760 00000100:00100000:2.0:1784192007.002350:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812501760 00000100:00100000:3.0:1784192007.002369:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 131 00000100:00100000:3.0:1784192007.002382:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1014f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69111:x1870858812501632:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784192007.002410:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812501888 00000100:00100000:2.0:1784192007.002414:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812501888 00000100:00100000:2.0:1784192007.002437:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 510 00000100:00100000:2.0:1784192007.002445:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69109:x1870858812501760:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784192007.002468:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1014f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69111:x1870858812501632:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 88us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192007.002477:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 131 00000100:00100000:2.0:1784192007.002492:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69109:x1870858812501760:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 47us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192007.002500:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 510 00000100:00080000:3.0:1784192007.002511:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784192007.002517:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784192007.002520:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 511 00000100:00100000:2.0:1784192007.002527:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812501888:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784192007.002550:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812501888:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 23us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192007.002556:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 511 00000100:00100000:1.0:1784192007.004157:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812502016 00000100:00100000:1.0:1784192007.004170:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812502016 00000100:00100000:1.0:1784192007.004248:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812502144 00000100:00100000:1.0:1784192007.004252:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812502144 00000100:00100000:1.0:1784192007.004276:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 280 00000100:00100000:1.0:1784192007.004294:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812502016:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784192007.004358:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812502016:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 73us (2229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192007.004365:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 280 00000100:00100000:1.0:1784192007.004409:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 281 00000100:00100000:1.0:1784192007.004416:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812502144:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784192007.004444:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69111:x1870858812502144:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 29us (2206us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192007.004449:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 281 00000100:00080000:3.0:1784192007.004522:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784192007.004526:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784192007.246770:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784192008.271633:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784192008.717375:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784192008.717398:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828045696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784192008.717471:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192008.719377:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828045696 00000100:00100000:3.0:1784192008.719387:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828045696 00000100:00100000:3.0:1784192008.719447:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1784192008.719459:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828045696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784192008.719490:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 38084608 avail 30916608 00000100:00100000:3.0:1784192008.719572:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828045696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (2100us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192008.719579:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:3.0:1784192008.719601:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784192008.719641:0:106501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22dfab800 x1870858828045696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784192008.719662:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828045696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784192008.719819:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828045824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784192008.719862:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192008.719909:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828045824 00000100:00100000:1.0:1784192008.719913:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828045824 00000100:00100000:1.0:1784192008.719945:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1784192008.719951:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828045824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784192008.719961:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 38084608 avail 30916608 00000100:00100000:1.0:1784192008.719991:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828045824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192008.719996:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:1.0:1784192008.720010:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784192008.720029:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af101686a00 x1870858828045824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784192008.720055:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828045824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784192009.292235:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784192010.252935:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784192010.252959:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828045952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784192010.253104:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192010.253193:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828045952 00000100:00100000:0.0:1784192010.253200:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828045952 00000100:00100000:0.0:1784192010.253246:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:0.0:1784192010.253255:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828045952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784192010.253290:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:0.0:1784192010.253349:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828045952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192010.253356:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:0.0:1784192010.253407:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828045952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784192010.253914:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828046208:0@lo:400:kworker.0 00000100:00100000:1.0:1784192010.253948:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192010.253973:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828046720:0@lo:400:kworker.0 00000100:00100000:3.0:1784192010.254108:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828046464:0@lo:400:kworker.0 00000100:00100000:3.0:1784192010.254139:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192010.254266:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828046976:0@lo:400:kworker.0 00000100:00100000:3.0:1784192010.254292:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192010.254315:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858828047488:0@lo:400:kworker.0 00000100:00100000:3.0:1784192010.254345:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192010.254365:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784192010.254371:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828046336:0@lo:400:kworker.0 00000100:00100000:3.0:1784192010.254390:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192010.254405:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858828046848:0@lo:400:kworker.0 00000100:00100000:3.0:1784192010.254423:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192010.254441:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858828047360:0@lo:400:kworker.0 00000100:00100000:3.0:1784192010.254459:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192010.254485:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828046464 00000100:00100000:3.0:1784192010.254489:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828046464 00000100:00100000:3.0:1784192010.254520:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:3.0:1784192010.254527:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828046464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192010.254572:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828046464:12345-0@lo:400:kworker.0 Request processed in 45us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192010.254579:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:3.0:1784192010.254601:0:162385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828046976 00000100:00100000:3.0:1784192010.254603:0:162385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828046976 00000100:00100000:3.0:1784192010.254637:0:162385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1784192010.254644:0:162385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828046976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192010.254676:0:162385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828046976:12345-0@lo:400:kworker.0 Request processed in 33us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192010.254723:0:162385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1784192010.254743:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828046208 00000100:00100000:3.0:1784192010.254746:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828046208 00000100:00100000:0.0:1784192010.255103:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858828046080:0@lo:400:kworker.0 00000100:00100000:0.0:1784192010.255140:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192010.255183:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828046592:0@lo:400:kworker.0 00000100:00100000:0.0:1784192010.255205:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192010.255224:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828047104:0@lo:400:kworker.0 00000100:00100000:0.0:1784192010.255243:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192010.255275:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828047488 00000100:00100000:0.0:1784192010.255278:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828047488 00000100:00100000:0.0:1784192010.255301:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828046336 00000100:00100000:0.0:1784192010.255304:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828046336 00000100:00100000:0.0:1784192010.255317:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828046848 00000100:00100000:0.0:1784192010.255319:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828046848 00000100:00100000:0.0:1784192010.255341:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828047360 00000100:00100000:0.0:1784192010.255344:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828047360 00000100:00100000:0.0:1784192010.255358:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1784192010.255364:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858828047488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192010.255398:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858828047488:12345-0@lo:400:kworker.0 Request processed in 34us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192010.255414:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1784192010.255429:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1784192010.255434:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828046336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192010.255467:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828046336:12345-0@lo:400:kworker.0 Request processed in 33us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192010.255473:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1784192010.255485:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1784192010.255491:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858828046848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192010.255518:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858828046848:12345-0@lo:400:kworker.0 Request processed in 27us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192010.255524:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1784192010.255536:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:0.0:1784192010.255541:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858828047360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192010.255569:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858828047360:12345-0@lo:400:kworker.0 Request processed in 28us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192010.255575:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:0.0:1784192010.255597:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828046080 00000100:00100000:0.0:1784192010.255600:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828046080 00000100:00100000:0.0:1784192010.255626:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1784192010.255631:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1017d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858828046080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192010.255664:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1017d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858828046080:12345-0@lo:400:kworker.0 Request processed in 32us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192010.255671:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1784192010.255724:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828046592 00000100:00100000:0.0:1784192010.255728:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828046592 00000100:00100000:1.0:1784192010.256177:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192010.257050:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:3.0:1784192010.257063:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828046208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192010.257128:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828046208:12345-0@lo:400:kworker.0 Request processed in 70us (3178us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192010.257134:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00080000:3.0:1784192010.257183:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784192010.257188:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784192010.257191:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784192010.261152:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828047232:0@lo:400:kworker.0 00000100:00100000:1.0:1784192010.261236:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192010.261289:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828046208:0@lo:400:kworker.0 00000100:00100000:2.0:1784192010.266860:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828046336:0@lo:400:kworker.0 00000100:00100000:2.0:1784192010.266879:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858828046848:0@lo:400:kworker.0 00000100:00100000:2.0:1784192010.266902:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858828047360:0@lo:400:kworker.0 00000100:00100000:2.0:1784192010.266913:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828046464:0@lo:400:kworker.0 00010000:00080000:2.0:1784192010.266927:0:106500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10b67d180 x1870858828046976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784192010.266936:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828046976:0@lo:400:kworker.0 00000100:00100000:2.0:1784192010.266947:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858828047488:0@lo:400:kworker.0 00000100:00100000:0.0:1784192010.267319:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828047104 00000100:00100000:0.0:1784192010.267335:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828047104 00000100:00100000:0.0:1784192010.267406:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828046720 00000100:00100000:0.0:1784192010.267410:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828046720 00000100:00100000:0.0:1784192010.267429:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1784192010.267436:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828046592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192010.267509:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828046592:12345-0@lo:400:kworker.0 Request processed in 73us (12303us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192010.267516:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1784192010.267531:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1784192010.267536:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828047104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192010.267561:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828047104:12345-0@lo:400:kworker.0 Request processed in 26us (12317us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192010.267566:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1784192010.267575:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1784192010.267579:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828046720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192010.267609:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828046720:12345-0@lo:400:kworker.0 Request processed in 29us (11432us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192010.267614:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1784192010.267678:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828046720:0@lo:400:kworker.0 00000100:00080000:2.0:1784192010.267873:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784192010.267924:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828047232 00000100:00100000:0.0:1784192010.267928:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828047232 00000100:00100000:0.0:1784192010.268001:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:0.0:1784192010.268008:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828047232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192010.268045:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828047232:12345-0@lo:400:kworker.0 Request processed in 38us (6811us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192010.268062:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1784192010.270714:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858828046080:0@lo:400:kworker.0 00010000:00080000:3.0:1784192010.270742:0:106501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22de44a80 x1870858828046592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784192010.270763:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828046592:0@lo:400:kworker.0 00000100:00100000:3.0:1784192010.270778:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828047104:0@lo:400:kworker.0 00000100:00100000:2.0:1784192010.273856:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828047232:0@lo:400:kworker.0 00010000:00010000:2.0:1784192010.317984:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784192010.765520:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784192010.765544:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828047616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784192010.765613:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192010.766155:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828047616 00000100:00100000:0.0:1784192010.766162:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828047616 00000100:00100000:0.0:1784192010.766209:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:0.0:1784192010.766218:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828047616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784192010.766265:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:0.0:1784192010.766313:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828047616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192010.766330:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00100000:2.0:1784192010.766497:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dfaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828047744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784192010.766527:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192010.766572:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828047616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784192010.766603:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828047744 00000100:00100000:2.0:1784192010.766606:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828047744 00000100:00100000:2.0:1784192010.766634:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1784192010.766640:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828047744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784192010.766660:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7816256 pending 0 free 67768320 avail 60600320 00000100:00100000:2.0:1784192010.766711:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828047744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192010.766717:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1784192010.766779:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dfaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828047744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784192011.276099:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784192011.281446:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828047872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784192011.281539:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192011.281854:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828047872 00000100:00100000:1.0:1784192011.281861:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828047872 00000100:00100000:1.0:1784192011.281911:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1784192011.281921:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828047872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784192011.281945:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 7816256 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784192011.281999:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828047872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192011.282006:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1784192011.283796:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828047872:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784192011.339894:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784192012.120033:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784192012.120104:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784192012.134529:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784192012.134563:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784192012.134616:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784192012.134653:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812502272 00000100:00100000:1.0:1784192012.134662:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812502272 00000100:00100000:1.0:1784192012.134734:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 133 00000100:00100000:1.0:1784192012.134744:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812502272:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784192012.134819:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69110:x1870858812502272:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 75us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192012.134826:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 133 00000100:00100000:0.0:1784192012.138256:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812502528 00000100:00100000:0.0:1784192012.138271:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812502528 00000100:00100000:0.0:1784192012.138303:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812502656 00000100:00100000:0.0:1784192012.138307:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812502656 00000100:00100000:0.0:1784192012.138367:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812502784 00000100:00100000:0.0:1784192012.138371:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812502784 00000100:00100000:0.0:1784192012.138399:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 467 00000100:00100000:0.0:1784192012.138410:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69108:x1870858812502656:12345-192.168.204.16@tcp:9:kworker.0 00000020:00000080:0.0:1784192012.138444:0:162398:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4d612 00000100:00080000:0.0:1784192012.138454:0:162398:0:(import.c:65:import_set_state_nolock()) ffff8af104add800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1784192012.138477:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784192012.138481:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:0.0:1784192012.138495:0:162398:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803776 00000100:00100000:1.0:1784192012.138766:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 468 00000100:00100000:1.0:1784192012.138775:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+5:69108:x1870858812502784:12345-192.168.204.16@tcp:9:kworker.0 00000020:00000080:1.0:1784192012.138796:0:162390:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xfeec3c2dc5a4d689 00000100:00080000:1.0:1784192012.138801:0:162390:0:(import.c:65:import_set_state_nolock()) ffff8af101784800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784192012.138815:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+2:69108:x1870858812502656:12345-192.168.204.16@tcp:9:kworker.0 Request processed in 407us (4250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192012.138824:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 467 00000001:00000004:1.0:1784192012.138835:0:162390:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869281 00010000:00010000:0.0:1784192012.138877:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784192012.138912:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+2:69108:x1870858812502784:12345-192.168.204.16@tcp:9:kworker.0 Request processed in 139us (4295us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192012.138918:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 468 00000100:00080000:1.0:1784192012.138958:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784192012.138984:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812502400 00000100:00100000:1.0:1784192012.138988:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812502400 00000100:00080000:1.0:1784192012.139001:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784192012.139022:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 518 00000100:00100000:1.0:1784192012.139028:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812502528:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784192012.139058:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812502528:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 30us (19033us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192012.139064:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 518 00000100:00100000:1.0:1784192012.139682:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 519 00000100:00100000:1.0:1784192012.139716:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69110:x1870858812502400:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784192012.139753:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69110:x1870858812502400:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 64us (19649us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192012.139760:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 519 00010000:00010000:2.0:1784192012.141832:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784192012.374907:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784192013.388147:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784192013.836285:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828048000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784192013.836365:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192013.836450:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828048000 00000100:00100000:3.0:1784192013.836459:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828048000 00000100:00100000:3.0:1784192013.836514:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1784192013.836525:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828048000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784192013.836558:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:3.0:1784192013.836603:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828048000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192013.836611:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:3.0:1784192013.836648:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784192013.836679:0:106500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af101686300 x1870858828048000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784192013.836720:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af101686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828048000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784192013.836892:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784192013.836903:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828048128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784192013.836935:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192013.836971:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828048128 00000100:00100000:2.0:1784192013.836975:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828048128 00000100:00100000:2.0:1784192013.837007:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1784192013.837013:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828048128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784192013.837024:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:2.0:1784192013.837055:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828048128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192013.837061:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00080000:2.0:1784192013.837077:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784192013.837095:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af2331d6680 x1870858828048128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784192013.837107:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828048128:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784192014.415527:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784192015.372356:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828048256:0@lo:400:kworker.0 00000100:00100000:0.0:1784192015.372428:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192015.372495:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828048768:0@lo:400:kworker.0 00000100:00100000:0.0:1784192015.372523:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192015.372541:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828049280:0@lo:400:kworker.0 00000100:00100000:0.0:1784192015.372560:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192015.372579:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828049792:0@lo:400:kworker.0 00000100:00100000:0.0:1784192015.372616:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192015.372639:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1784192015.372645:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828048640:0@lo:400:kworker.0 00000100:00100000:0.0:1784192015.372669:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192015.372944:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828049152:0@lo:400:kworker.0 00000100:00100000:0.0:1784192015.372971:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192015.372987:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858828049664:0@lo:400:kworker.0 00000100:00100000:0.0:1784192015.373006:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192015.373034:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828048768 00000100:00100000:0.0:1784192015.373040:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828048768 00000100:00100000:0.0:1784192015.373088:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828049280 00000100:00100000:0.0:1784192015.373091:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828049280 00000100:00100000:0.0:1784192015.373115:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1784192015.373124:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828048768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192015.373175:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828048768:12345-0@lo:400:kworker.0 Request processed in 52us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192015.373183:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1784192015.373200:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1784192015.373207:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dfab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828049280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192015.373247:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dfab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828049280:12345-0@lo:400:kworker.0 Request processed in 42us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192015.373264:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1784192015.373285:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828049792 00000100:00100000:0.0:1784192015.373289:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828049792 00000100:00100000:0.0:1784192015.373315:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828049664 00000100:00100000:0.0:1784192015.373318:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828049664 00000100:00100000:0.0:1784192015.373334:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1784192015.373340:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828049792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192015.373368:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828049792:12345-0@lo:400:kworker.0 Request processed in 28us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192015.373375:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1784192015.373386:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1784192015.373392:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858828049664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192015.373416:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858828049664:12345-0@lo:400:kworker.0 Request processed in 25us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192015.373422:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00080000:0.0:1784192015.373454:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784192015.373458:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784192015.373460:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784192015.373502:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858828049664:0@lo:400:kworker.0 00010000:00080000:0.0:1784192015.373517:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af2331d5180 x1870858828048768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192015.373527:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828048768:0@lo:400:kworker.0 00010000:00080000:0.0:1784192015.373536:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af104c78000 x1870858828049280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192015.373543:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828049280:0@lo:400:kworker.0 00000100:00100000:0.0:1784192015.373565:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828049792:0@lo:400:kworker.0 00000100:00100000:2.0:1784192015.373670:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828048256 00000100:00100000:2.0:1784192015.373674:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828048256 00000100:00100000:2.0:1784192015.373741:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1784192015.373749:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1014f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828048256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192015.373788:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1014f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828048256:12345-0@lo:400:kworker.0 Request processed in 40us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192015.374212:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784192015.374487:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858828048384:0@lo:400:kworker.0 00000100:00100000:3.0:1784192015.374524:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192015.374555:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828048896:0@lo:400:kworker.0 00000100:00100000:3.0:1784192015.374579:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192015.374612:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828049408:0@lo:400:kworker.0 00000100:00100000:3.0:1784192015.374633:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192015.374652:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828049920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784192015.374673:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192015.374956:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784192015.374963:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858828048512:0@lo:400:kworker.0 00000100:00100000:3.0:1784192015.374989:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192015.375008:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858828049024:0@lo:400:kworker.0 00000100:00100000:3.0:1784192015.375029:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192015.375060:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858828049536:0@lo:400:kworker.0 00000100:00100000:3.0:1784192015.375082:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192015.375118:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828048640 00000100:00100000:3.0:1784192015.375123:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828048640 00000100:00100000:3.0:1784192015.375154:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828049152 00000100:00100000:3.0:1784192015.375157:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828049152 00000100:00100000:3.0:1784192015.375167:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828049920 00000100:00100000:3.0:1784192015.375169:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828049920 00000100:00100000:3.0:1784192015.375181:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:3.0:1784192015.375187:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828048640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192015.375241:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828048640:12345-0@lo:400:kworker.0 Request processed in 42us (2559us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192015.375248:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:3.0:1784192015.375263:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:3.0:1784192015.375269:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:106502:x1870858828049152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192015.375297:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:106502:x1870858828049152:12345-0@lo:400:kworker.0 Request processed in 28us (2324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192015.375303:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00100000:3.0:1784192015.375313:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:3.0:1784192015.375318:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828049920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784192015.375342:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:3.0:1784192015.375374:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828049920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192015.375381:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:3.0:1784192015.375401:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828048384 00000100:00100000:3.0:1784192015.375404:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828048384 00000100:00100000:3.0:1784192015.375434:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828048512 00000100:00100000:3.0:1784192015.375442:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828048512 00000100:00100000:3.0:1784192015.375458:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828049024 00000100:00100000:3.0:1784192015.375460:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828049024 00000100:00100000:3.0:1784192015.375468:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828049536 00000100:00100000:3.0:1784192015.375470:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828049536 00000100:00100000:3.0:1784192015.375479:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1784192015.375484:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858828048384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192015.375516:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858828048384:12345-0@lo:400:kworker.0 Request processed in 31us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192015.375523:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1784192015.375534:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1784192015.375539:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858828048512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192015.375565:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858828048512:12345-0@lo:400:kworker.0 Request processed in 26us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192015.375571:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1784192015.375581:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:3.0:1784192015.375587:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858828049024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192015.375612:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858828049024:12345-0@lo:400:kworker.0 Request processed in 26us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192015.375617:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:3.0:1784192015.375627:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1784192015.375633:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858828049536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192015.375658:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858828049536:12345-0@lo:400:kworker.0 Request processed in 25us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192015.375664:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1784192015.376046:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828048896 00000100:00100000:1.0:1784192015.376051:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828048896 00000100:00100000:1.0:1784192015.376080:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828049408 00000100:00100000:1.0:1784192015.376083:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828049408 00000100:00100000:1.0:1784192015.376102:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1784192015.376108:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828048896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192015.376155:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828048896:12345-0@lo:400:kworker.0 Request processed in 48us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192015.376162:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1784192015.376174:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1784192015.376179:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af101684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828049408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192015.376203:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af101684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828049408:12345-0@lo:400:kworker.0 Request processed in 24us (1569us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192015.376209:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1784192015.376590:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858828048512:0@lo:400:kworker.0 00000100:00100000:1.0:1784192015.376601:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858828049024:0@lo:400:kworker.0 00000100:00100000:1.0:1784192015.376611:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858828049536:0@lo:400:kworker.0 00000100:00100000:1.0:1784192015.376621:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858828048384:0@lo:400:kworker.0 00000100:00100000:1.0:1784192015.376631:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828048896:0@lo:400:kworker.0 00000100:00100000:1.0:1784192015.376640:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828049408:0@lo:400:kworker.0 00000100:00100000:1.0:1784192015.376656:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828049920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784192015.377083:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828048640:0@lo:400:kworker.0 00000100:00100000:0.0:1784192015.377095:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828049152:0@lo:400:kworker.0 00000100:00100000:0.0:1784192015.377103:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828048256:0@lo:400:kworker.0 00000100:00080000:1.0:1784192015.377402:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784192015.377408:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784192015.377411:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784192015.436198:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784192015.886550:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784192015.886576:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828050048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784192015.886659:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192015.886736:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828050048 00000100:00100000:1.0:1784192015.886743:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828050048 00000100:00100000:1.0:1784192015.886801:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:1.0:1784192015.886809:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828050048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784192015.886865:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:1.0:1784192015.886912:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828050048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192015.886918:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:1.0:1784192015.886964:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828050048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784192015.887153:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784192015.887163:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828050176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784192015.887195:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192015.887238:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828050176 00000100:00100000:0.0:1784192015.887242:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828050176 00000100:00100000:0.0:1784192015.887272:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1784192015.887279:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828050176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784192015.887300:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:0.0:1784192015.887333:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828050176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192015.887340:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1784192015.887373:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828050176:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1784192016.330205:0:170714:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state FULL osc.lustre-OST0000-osc-ffff9e79d8526800.ost_server_uuid 50 00000100:00100000:2.0:1784192016.398955:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784192016.398980:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828050304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784192016.399050:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192016.399315:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828050304 00000100:00100000:1.0:1784192016.399322:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828050304 00000100:00100000:1.0:1784192016.399385:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1784192016.399395:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828050304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784192016.399420:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784192016.399480:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828050304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192016.399488:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1784192016.399612:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828050304:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784192016.463138:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784192017.238415:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784192017.238511:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812502912 00000100:00100000:3.0:1784192017.238534:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812502912 00000100:00100000:3.0:1784192017.238594:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 135 00000100:00100000:3.0:1784192017.238605:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1014f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69112:x1870858812502912:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784192017.238728:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1014f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69112:x1870858812502912:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 123us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192017.238736:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 135 00000100:00100000:0.0:1784192017.243299:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784192017.243340:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784192017.243446:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812503040 00000100:00100000:3.0:1784192017.243456:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812503040 00000100:00100000:3.0:1784192017.243534:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812503168 00000100:00100000:3.0:1784192017.243538:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812503168 00000100:00100000:3.0:1784192017.243561:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 526 00000100:00100000:3.0:1784192017.243572:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69109:x1870858812503040:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784192017.243654:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69109:x1870858812503040:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 84us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192017.243662:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 526 00000100:00100000:3.0:1784192017.243717:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 527 00000100:00100000:3.0:1784192017.243724:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69110:x1870858812503168:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784192017.243748:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69110:x1870858812503168:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 26us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192017.243754:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 527 00000100:00080000:0.0:1784192017.244351:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784192017.244356:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784192017.484222:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784192017.937368:0:160977:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000020:00000080:1.0:1784192017.937378:0:160977:0:(genops.c:906:class_export_put()) final put ffff8af101783800/62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000020:00000080:0.0:1784192017.937772:0:70119:0:(genops.c:865:class_export_destroy()) destroying export ffff8af101783800/62ac9b09-d016-4ae6-b1b1-fe120a3abe0a for lustre-OST0001 00000020:00000080:0.0:1784192017.937831:0:70119:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af101784800 for lustre-OST0001 00000001:00100000:2.0:1784192017.943560:0:169525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000020:00000080:2.0:1784192017.943569:0:169525:0:(genops.c:906:class_export_put()) final put ffff8af10c3a9000/62ac9b09-d016-4ae6-b1b1-fe120a3abe0a 00000020:00000080:3.0:1784192017.943668:0:165779:0:(genops.c:865:class_export_destroy()) destroying export ffff8af10c3a9000/62ac9b09-d016-4ae6-b1b1-fe120a3abe0a for lustre-OST0000 00000020:00000080:3.0:1784192017.943754:0:165779:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8af104add800 for lustre-OST0000 00010000:00010000:0.0:1784192018.508060:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784192018.956084:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828050432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784192018.956159:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192018.956390:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828050432 00000100:00100000:0.0:1784192018.956411:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828050432 00000100:00100000:0.0:1784192018.956480:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1784192018.956491:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828050432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784192018.956536:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:0.0:1784192018.956583:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828050432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192018.956590:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00010000:00080000:1.0:1784192018.956949:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af104c78380 x1870858828050432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784192018.956968:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828050432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784192018.956987:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784192018.956993:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10b67e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828050560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784192018.957028:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784192018.957355:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784192018.957991:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828050560 00000100:00100000:0.0:1784192018.957999:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828050560 00000100:00100000:0.0:1784192018.958064:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1784192018.958072:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828050560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784192018.958091:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:0.0:1784192018.958155:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828050560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192018.958173:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00010000:00080000:3.0:1784192018.958261:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10b67e300 x1870858828050560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784192018.958278:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10b67e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828050560:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784192018.958426:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784192019.534578:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784192020.493032:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828050816:0@lo:400:kworker.0 00000100:00100000:1.0:1784192020.493108:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192020.493189:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828051328:0@lo:400:kworker.0 00000100:00100000:1.0:1784192020.493216:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192020.493236:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828051840:0@lo:400:kworker.0 00000100:00100000:1.0:1784192020.493255:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192020.493281:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1784192020.493300:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828050688:0@lo:400:kworker.0 00000100:00100000:1.0:1784192020.493329:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192020.493352:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828051200:0@lo:400:kworker.0 00000100:00100000:1.0:1784192020.493374:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192020.493545:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828051712:0@lo:400:kworker.0 00000100:00100000:1.0:1784192020.493570:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192020.493584:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828052224:0@lo:400:kworker.0 00000100:00100000:1.0:1784192020.493607:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192020.493651:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828050816 00000100:00100000:1.0:1784192020.493658:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828050816 00000100:00100000:1.0:1784192020.493734:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828052224 00000100:00100000:1.0:1784192020.493738:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828052224 00000100:00100000:1.0:1784192020.493762:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1784192020.493770:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828050816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192020.493822:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828050816:12345-0@lo:400:kworker.0 Request processed in 51us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192020.493830:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1784192020.493864:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1784192020.493870:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828052224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192020.493900:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828052224:12345-0@lo:400:kworker.0 Request processed in 30us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192020.493906:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1784192020.493924:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828051328 00000100:00100000:1.0:1784192020.493928:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828051328 00000100:00100000:1.0:1784192020.493951:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828051840 00000100:00100000:1.0:1784192020.493953:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828051840 00000100:00100000:1.0:1784192020.493967:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828051200 00000100:00100000:1.0:1784192020.493969:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828051200 00000100:00100000:1.0:1784192020.493986:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828051712 00000100:00100000:1.0:1784192020.493988:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828051712 00000100:00100000:1.0:1784192020.494004:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1784192020.494010:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828051328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192020.494040:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828051328:12345-0@lo:400:kworker.0 Request processed in 30us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192020.494047:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1784192020.494060:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1784192020.494065:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828051840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192020.494092:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828051840:12345-0@lo:400:kworker.0 Request processed in 27us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192020.494097:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1784192020.494107:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1784192020.494112:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828051200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192020.494151:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828051200:12345-0@lo:400:kworker.0 Request processed in 39us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192020.494166:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1784192020.494551:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1784192020.494560:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10b67ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828051712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192020.494612:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10b67ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828051712:12345-0@lo:400:kworker.0 Request processed in 53us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192020.494618:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1784192020.494678:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828052352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784192020.494726:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784192020.494763:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af233156d80 x1870858828051200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192020.494776:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828051200:0@lo:400:kworker.0 00010000:00080000:0.0:1784192020.494787:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af233155f80 x1870858828051712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192020.494805:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828051712:0@lo:400:kworker.0 00000100:00100000:0.0:1784192020.494819:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828052224:0@lo:400:kworker.0 00000100:00100000:0.0:1784192020.494829:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828050816:0@lo:400:kworker.0 00000100:00100000:0.0:1784192020.494838:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828051328:0@lo:400:kworker.0 00000100:00100000:0.0:1784192020.494847:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828051840:0@lo:400:kworker.0 00000100:00100000:0.0:1784192020.494905:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828052352 00000100:00100000:0.0:1784192020.494909:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828052352 00000100:00100000:0.0:1784192020.494937:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:0.0:1784192020.494943:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828052352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784192020.494969:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:0.0:1784192020.495008:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828052352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192020.495014:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:0.0:1784192020.495049:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828052352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784192020.496321:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828050688 00000100:00100000:2.0:1784192020.496331:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828050688 00000100:00100000:2.0:1784192020.496379:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1784192020.496396:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828050688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192020.496474:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828050688:12345-0@lo:400:kworker.0 Request processed in 79us (3143us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192020.496480:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1784192020.496516:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784192020.496521:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784192020.496524:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784192020.496527:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784192020.496732:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828051072:0@lo:400:kworker.0 00000100:00100000:3.0:1784192020.496771:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192020.496813:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828051584:0@lo:400:kworker.0 00000100:00100000:3.0:1784192020.496834:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192020.496855:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858828052096:0@lo:400:kworker.0 00000100:00100000:3.0:1784192020.496879:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192020.496901:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784192020.496907:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828050944:0@lo:400:kworker.0 00000100:00100000:3.0:1784192020.496928:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192020.496947:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858828051456:0@lo:400:kworker.0 00000100:00100000:3.0:1784192020.496967:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192020.496987:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:106500:1870858828051968:0@lo:400:kworker.0 00000100:00100000:3.0:1784192020.497007:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192020.497038:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828051072 00000100:00100000:3.0:1784192020.497042:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828051072 00000100:00100000:3.0:1784192020.497069:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828051584 00000100:00100000:3.0:1784192020.497072:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828051584 00000100:00100000:3.0:1784192020.497092:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:3.0:1784192020.497098:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828051072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192020.497150:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828051072:12345-0@lo:400:kworker.0 Request processed in 52us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192020.497158:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00100000:3.0:1784192020.497171:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1784192020.497176:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828051584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192020.497201:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828051584:12345-0@lo:400:kworker.0 Request processed in 25us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192020.497218:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1784192020.497237:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828052096 00000100:00100000:3.0:1784192020.497240:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828052096 00000100:00100000:3.0:1784192020.497267:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828050944 00000100:00100000:3.0:1784192020.497270:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828050944 00000100:00100000:3.0:1784192020.497292:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828051456 00000100:00100000:3.0:1784192020.497296:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828051456 00000100:00100000:3.0:1784192020.497307:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828051968 00000100:00100000:3.0:1784192020.497309:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828051968 00000100:00100000:3.0:1784192020.497323:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1784192020.497328:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858828052096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192020.497374:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858828052096:12345-0@lo:400:kworker.0 Request processed in 45us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192020.497450:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1784192020.497466:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:3.0:1784192020.497472:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828050944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192020.497503:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828050944:12345-0@lo:400:kworker.0 Request processed in 32us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192020.497508:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:3.0:1784192020.497519:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:3.0:1784192020.497525:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858828051456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192020.497552:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858828051456:12345-0@lo:400:kworker.0 Request processed in 28us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192020.497558:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:3.0:1784192020.497569:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1784192020.497575:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106500:x1870858828051968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192020.497616:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:106500:x1870858828051968:12345-0@lo:400:kworker.0 Request processed in 41us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192020.497622:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1784192020.497673:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828050944:0@lo:400:kworker.0 00000100:00100000:3.0:1784192020.497685:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858828051456:0@lo:400:kworker.0 00000100:00100000:3.0:1784192020.497731:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:106500:1870858828051968:0@lo:400:kworker.0 00000100:00100000:3.0:1784192020.497740:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828051072:0@lo:400:kworker.0 00000100:00100000:3.0:1784192020.497748:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828051584:0@lo:400:kworker.0 00000100:00100000:3.0:1784192020.497757:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858828052096:0@lo:400:kworker.0 00000100:00100000:1.0:1784192020.498565:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233154700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828050688:0@lo:400:kworker.0 00000100:00080000:2.0:1784192020.498645:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784192020.498649:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784192020.561743:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784192021.004215:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828052480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784192021.004299:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192021.004417:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828052480 00000100:00100000:0.0:1784192021.004433:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828052480 00000100:00100000:0.0:1784192021.004489:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1784192021.004498:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828052480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784192021.004526:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:0.0:1784192021.004575:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828052480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192021.004582:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1784192021.004647:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828052480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784192021.007722:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828052608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784192021.007797:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192021.007889:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828052608 00000100:00100000:3.0:1784192021.007905:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828052608 00000100:00100000:3.0:1784192021.007997:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:3.0:1784192021.008010:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828052608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784192021.008064:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:3.0:1784192021.008188:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828052608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 181us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192021.008197:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:0.0:1784192021.009735:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828052608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784192021.518314:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828052736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784192021.518404:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192021.518571:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828052736 00000100:00100000:0.0:1784192021.518579:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828052736 00000100:00100000:0.0:1784192021.518646:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1784192021.518656:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828052736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784192021.518681:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:0.0:1784192021.539434:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828052736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 20768us (21019us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192021.539452:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1784192021.539864:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828052736:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784192021.580033:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784192022.356243:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784192022.356311:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784192022.356440:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812503296 00000100:00100000:3.0:1784192022.356451:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812503296 00000100:00100000:3.0:1784192022.356523:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 137 00000100:00100000:1.0:1784192022.356533:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812503424 00000100:00100000:3.0:1784192022.356534:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69111:x1870858812503296:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784192022.356541:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812503424 00000100:00100000:3.0:1784192022.356610:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69111:x1870858812503296:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 76us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192022.356620:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 137 00000100:00100000:1.0:1784192022.356620:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 534 00000100:00100000:1.0:1784192022.356635:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812503424:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784192022.356674:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812503424:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 45us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192022.356681:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 534 00000100:00080000:2.0:1784192022.357066:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784192022.365608:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784192022.365807:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812503552 00000100:00100000:3.0:1784192022.365817:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812503552 00000100:00100000:3.0:1784192022.365896:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 535 00000100:00100000:3.0:1784192022.365906:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69110:x1870858812503552:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784192022.365993:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69110:x1870858812503552:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 88us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192022.366000:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 535 00000100:00080000:2.0:1784192022.367311:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784192022.603893:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784192023.629332:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784192024.078123:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828052864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784192024.078211:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192024.078479:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828052864 00000100:00100000:1.0:1784192024.078488:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828052864 00000100:00100000:1.0:1784192024.078559:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1784192024.078569:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828052864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784192024.078599:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:1.0:1784192024.078646:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828052864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192024.078653:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00010000:00080000:1.0:1784192024.078713:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22de45c00 x1870858828052864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784192024.079013:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784192024.079062:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828052864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784192024.080653:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828052992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784192024.080760:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192024.080943:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828052992 00000100:00100000:2.0:1784192024.080950:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828052992 00000100:00100000:2.0:1784192024.081013:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1784192024.081022:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828052992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784192024.081042:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:2.0:1784192024.081098:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828052992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192024.081105:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:3.0:1784192024.081220:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784192024.082599:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af104c7aa00 x1870858828052992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192024.082622:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828052992:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784192024.655031:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784192025.614044:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828053120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784192025.614129:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192025.614245:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828053632:0@lo:400:kworker.0 00000100:00100000:2.0:1784192025.614288:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192025.614294:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828053376:0@lo:400:kworker.0 00000100:00100000:2.0:1784192025.614333:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828054144:0@lo:400:kworker.0 00000100:00100000:2.0:1784192025.614376:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192025.614396:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192025.614409:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858828054656:0@lo:400:kworker.0 00000100:00100000:1.0:1784192025.614447:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828053888:0@lo:400:kworker.0 00000100:00100000:2.0:1784192025.614461:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192025.614569:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828053120 00000100:00100000:0.0:1784192025.614577:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828053120 00000100:00100000:0.0:1784192025.614621:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828053632 00000100:00100000:0.0:1784192025.614624:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828053632 00000100:00100000:0.0:1784192025.614656:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:0.0:1784192025.614665:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828053120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784192025.614729:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:2.0:1784192025.614799:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784192025.614808:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828053504:0@lo:400:kworker.0 00000100:00100000:3.0:1784192025.616222:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:3.0:1784192025.616247:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828053632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192025.628408:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192025.628507:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828054400:0@lo:400:kworker.0 00000100:00100000:1.0:1784192025.628709:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192025.628721:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828053120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 14016us (14551us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192025.628739:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00000100:00100000:1.0:1784192025.628754:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784192025.628770:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828053248:0@lo:400:kworker.0 00000100:00100000:1.0:1784192025.628814:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192025.628832:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828054144 00000100:00100000:1.0:1784192025.628858:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828053760:0@lo:400:kworker.0 00000100:00100000:1.0:1784192025.628883:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192025.628902:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828054272:0@lo:400:kworker.0 00000100:00100000:1.0:1784192025.628923:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192025.630738:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828053376 00000100:00100000:1.0:1784192025.630755:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828053376 00000100:00100000:1.0:1784192025.630853:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828054656 00000100:00100000:1.0:1784192025.630856:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828054656 00000100:00100000:1.0:1784192025.630878:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828054400 00000100:00100000:1.0:1784192025.630881:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828054400 00000100:00100000:1.0:1784192025.630903:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:1.0:1784192025.630913:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828053376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192025.631022:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828053376:12345-0@lo:400:kworker.0 Request processed in 110us (16628us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192025.631030:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:1.0:1784192025.631063:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:1.0:1784192025.631070:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858828054656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192025.631105:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858828054656:12345-0@lo:400:kworker.0 Request processed in 35us (16651us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192025.631130:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:1.0:1784192025.631142:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:1.0:1784192025.631148:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828054400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192025.631176:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828054400:12345-0@lo:400:kworker.0 Request processed in 29us (2494us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192025.631182:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:1.0:1784192025.631222:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828053888 00000100:00100000:1.0:1784192025.631226:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828053888 00000100:00100000:1.0:1784192025.631254:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828053760 00000100:00100000:1.0:1784192025.631256:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828053760 00000100:00100000:1.0:1784192025.631270:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828054272 00000100:00100000:1.0:1784192025.631273:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828054272 00000100:00100000:1.0:1784192025.631289:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1784192025.631295:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828053888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192025.631344:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828053888:12345-0@lo:400:kworker.0 Request processed in 49us (2949us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192025.631350:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1784192025.631360:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1784192025.631365:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828053760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192025.631390:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828053760:12345-0@lo:400:kworker.0 Request processed in 25us (2505us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192025.631395:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1784192025.631404:0:162394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1784192025.631409:0:162394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828054272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192025.631432:0:162394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828054272:12345-0@lo:400:kworker.0 Request processed in 24us (2508us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192025.631447:0:162394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1784192025.631489:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828053248 00000100:00100000:1.0:1784192025.631492:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828053248 00000100:00100000:1.0:1784192025.631524:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784192025.631530:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828053248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192025.631562:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828053248:12345-0@lo:400:kworker.0 Request processed in 32us (2749us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192025.631568:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784192025.631628:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828053248:0@lo:400:kworker.0 00000100:00100000:0.0:1784192025.632286:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828054144 00000100:00100000:0.0:1784192025.632367:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1784192025.632379:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1051f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828054144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192025.632476:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1051f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828054144:12345-0@lo:400:kworker.0 Request processed in 98us (18097us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192025.632485:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00010000:00080000:1.0:1784192025.632496:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10ec80700 x1870858828053760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784192025.632518:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828053760:0@lo:400:kworker.0 00000100:00100000:1.0:1784192025.632545:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828054272:0@lo:400:kworker.0 00000100:00100000:1.0:1784192025.632563:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828053376:0@lo:400:kworker.0 00000100:00100000:1.0:1784192025.632585:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828053888:0@lo:400:kworker.0 00000100:00100000:1.0:1784192025.632612:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828054400:0@lo:400:kworker.0 00000100:00080000:1.0:1784192025.632883:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784192025.632890:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784192025.632894:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784192025.632913:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192025.632959:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858828054016:0@lo:400:kworker.0 00000100:00100000:2.0:1784192025.632993:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192025.633013:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858828054528:0@lo:400:kworker.0 00000100:00100000:2.0:1784192025.633069:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192025.633111:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858828054656:0@lo:400:kworker.0 00010000:00080000:2.0:1784192025.633127:0:106500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10ec83480 x1870858828054144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784192025.633137:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828054144:0@lo:400:kworker.0 00000100:00100000:2.0:1784192025.633159:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828053120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784192025.633205:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828053504 00000100:00100000:1.0:1784192025.633214:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828053504 00000100:00100000:2.0:1784192025.633215:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828054016 00000100:00100000:2.0:1784192025.633238:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828054016 00000100:00100000:1.0:1784192025.633267:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828054528 00000100:00100000:1.0:1784192025.633272:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828054528 00000100:00100000:2.0:1784192025.633290:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:1.0:1784192025.633424:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:1.0:1784192025.633443:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858828054016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192025.633514:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858828054016:12345-0@lo:400:kworker.0 Request processed in 72us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192025.633522:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:1.0:1784192025.633537:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:1.0:1784192025.633543:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858828054528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192025.633557:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828053504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192025.633580:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858828054528:12345-0@lo:400:kworker.0 Request processed in 34us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192025.633587:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00080000:1.0:1784192025.633613:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784192025.633619:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784192025.633632:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828053504:12345-0@lo:400:kworker.0 Request processed in 330us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192025.633653:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1784192025.635821:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828053632:12345-0@lo:400:kworker.0 Request processed in 19575us (21522us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192025.635839:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00100000:2.0:1784192025.644607:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828053504:0@lo:400:kworker.0 00000100:00100000:2.0:1784192025.644629:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858828054016:0@lo:400:kworker.0 00000100:00100000:2.0:1784192025.644652:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858828054528:0@lo:400:kworker.0 00000100:00100000:2.0:1784192025.644666:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828053632:0@lo:400:kworker.0 00010000:00010000:3.0:1784192025.677394:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784192026.123993:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828054784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784192026.124116:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192026.124336:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828054912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784192026.124424:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192026.124472:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828054912 00000100:00100000:1.0:1784192026.124485:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828054912 00000100:00100000:1.0:1784192026.124548:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1784192026.124558:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828054912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784192026.124598:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784192026.124648:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828054912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192026.124656:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1784192026.126939:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828054784 00000100:00100000:0.0:1784192026.126962:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828054784 00000100:00100000:0.0:1784192026.127034:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:0.0:1784192026.127045:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828054784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784192026.127091:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:0.0:1784192026.127422:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828054784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 378us (3305us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192026.127431:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:2.0:1784192026.127585:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828054784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784192026.128075:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828054912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784192026.636726:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828055040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784192026.636808:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192026.636932:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828055040 00000100:00100000:0.0:1784192026.636949:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828055040 00000100:00100000:0.0:1784192026.637051:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1784192026.637062:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828055040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784192026.637094:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:0.0:1784192026.643129:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828055040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6051us (6303us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192026.643131:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828055040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784192026.643161:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00010000:00010000:0.0:1784192026.700222:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784192027.477051:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784192027.477660:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812503936 00000100:00100000:1.0:1784192027.477671:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812503936 00000100:00100000:1.0:1784192027.477927:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 542 00000100:00100000:1.0:1784192027.477941:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812503936:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784192027.478046:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812503936:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 109us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192027.478075:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 542 00000100:00080000:2.0:1784192027.478149:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784192027.478784:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784192027.490863:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784192027.490902:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812503680 00000100:00100000:3.0:1784192027.490913:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812503680 00000100:00100000:3.0:1784192027.490965:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 139 00000100:00100000:3.0:1784192027.490976:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812503680:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784192027.491065:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812503680:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 91us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192027.491073:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 139 00000100:00100000:0.0:1784192027.493092:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812503808 00000100:00100000:0.0:1784192027.493117:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812503808 00000100:00100000:0.0:1784192027.493960:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 543 00000100:00100000:0.0:1784192027.493972:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812503808:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784192027.494085:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812503808:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 115us (15302us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192027.494093:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 543 00000100:00080000:3.0:1784192027.494461:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784192027.729474:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784192028.748055:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784192029.195929:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828055168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784192029.196026:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192029.196226:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784192029.196238:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828055296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784192029.196267:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192029.196396:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828055168 00000100:00100000:2.0:1784192029.196420:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828055168 00000100:00100000:2.0:1784192029.196800:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828055296 00000100:00100000:2.0:1784192029.196829:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828055296 00000100:00100000:3.0:1784192029.196879:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1784192029.196892:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828055168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784192029.196929:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:3.0:1784192029.196996:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828055168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192029.197004:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00010000:00080000:3.0:1784192029.197056:0:106500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10ec82a00 x1870858828055168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784192029.197085:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828055168:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784192029.203243:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784192029.203851:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1784192029.203866:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828055296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784192029.203901:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:2.0:1784192029.204225:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828055296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 361us (7954us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192029.204234:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00010000:00080000:1.0:1784192029.210530:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af104c7a680 x1870858828055296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784192029.210572:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828055296:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784192029.772064:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784192030.735240:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858828055552:0@lo:400:kworker.0 00000100:00100000:0.0:1784192030.735327:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192030.735396:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828056064:0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.735421:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828055552 00000100:00100000:0.0:1784192030.735424:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192030.735429:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828055552 00000100:00100000:0.0:1784192030.735441:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828056576:0@lo:400:kworker.0 00000100:00100000:0.0:1784192030.735460:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192030.735480:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784192030.735484:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858828055680:0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.735490:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:1.0:1784192030.735500:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858828055552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192030.735506:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192030.735525:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858828056192:0@lo:400:kworker.0 00000100:00100000:0.0:1784192030.735544:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192030.735551:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858828055552:12345-0@lo:400:kworker.0 Request processed in 54us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192030.735557:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858828056704:0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.735559:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:1.0:1784192030.735576:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828055680 00000100:00100000:0.0:1784192030.735577:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192030.735578:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828055680 00000100:00100000:1.0:1784192030.735593:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828056192 00000100:00100000:1.0:1784192030.735595:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828056192 00000100:00100000:1.0:1784192030.735603:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828056704 00000100:00100000:1.0:1784192030.735605:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828056704 00000100:00100000:0.0:1784192030.735614:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858828055552:0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.735615:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:1.0:1784192030.735620:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858828055680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192030.735647:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828056064 00000100:00100000:0.0:1784192030.735650:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828056064 00000100:00100000:1.0:1784192030.735651:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858828055680:12345-0@lo:400:kworker.0 Request processed in 31us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192030.735656:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:1.0:1784192030.735667:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:1.0:1784192030.735672:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858828056192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192030.735675:0:162398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828056576 00000100:00100000:1.0:1784192030.735717:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858828056192:12345-0@lo:400:kworker.0 Request processed in 45us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192030.735724:0:162398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828056576 00000100:00100000:1.0:1784192030.735728:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:1.0:1784192030.735740:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1784192030.735745:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858828056704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192030.735748:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1784192030.735753:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828056064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.735773:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858828056704:12345-0@lo:400:kworker.0 Request processed in 27us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192030.735776:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828056064:12345-0@lo:400:kworker.0 Request processed in 24us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192030.735779:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1784192030.735781:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1784192030.735791:0:162398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1784192030.735796:0:162398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828056576:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784192030.735821:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784192030.735822:0:162398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828056576:12345-0@lo:400:kworker.0 Request processed in 25us (360us total) trans 0 rc 0/0 00000100:00080000:1.0:1784192030.735827:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784192030.735827:0:162398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:1.0:1784192030.735829:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784192030.735839:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828055424:0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.735869:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192030.735885:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858828055680:0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.735890:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828055936:0@lo:400:kworker.0 00000100:00100000:0.0:1784192030.735894:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858828056192:0@lo:400:kworker.0 00000100:00100000:0.0:1784192030.735903:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858828056704:0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.735908:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192030.735911:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828056064:0@lo:400:kworker.0 00000100:00100000:0.0:1784192030.735919:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828056576:0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.735923:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828056448:0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.735956:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192030.735965:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828055424 00000100:00100000:0.0:1784192030.735968:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828055424 00000100:00100000:1.0:1784192030.735973:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828056960:0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.735994:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192030.735994:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784192030.736006:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828055424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.736010:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784192030.736015:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828055808:0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.736036:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192030.736036:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828055424:12345-0@lo:400:kworker.0 Request processed in 36us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192030.736042:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784192030.736052:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828056320:0@lo:400:kworker.0 00000100:00100000:0.0:1784192030.736067:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828055936 00000100:00100000:1.0:1784192030.736070:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192030.736076:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828055936 00000100:00100000:1.0:1784192030.736084:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858828056832:0@lo:400:kworker.0 00000100:00100000:0.0:1784192030.736098:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828056448 00000100:00100000:0.0:1784192030.736101:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828056448 00000100:00100000:1.0:1784192030.736102:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192030.736116:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1784192030.736121:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828055936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.736129:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828055424:0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.736152:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1784192030.736153:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828055936:12345-0@lo:400:kworker.0 Request processed in 33us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192030.736158:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828056448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192030.736159:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00010000:00080000:0.0:1784192030.736187:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10ec82300 x1870858828055936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192030.736198:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828055936:0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.736200:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828056448:12345-0@lo:400:kworker.0 Request processed in 43us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192030.736206:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00010000:00080000:0.0:1784192030.736207:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22de46300 x1870858828056448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192030.736214:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828056448:0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.736229:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828055808 00000100:00100000:0.0:1784192030.736231:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828056960 00000100:00100000:1.0:1784192030.736232:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828055808 00000100:00100000:0.0:1784192030.736232:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828056960 00000100:00100000:1.0:1784192030.736255:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828056320 00000100:00100000:0.0:1784192030.736255:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828056832 00000100:00100000:1.0:1784192030.736257:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828056320 00000100:00100000:0.0:1784192030.736257:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828056832 00000100:00100000:0.0:1784192030.736269:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:1.0:1784192030.736272:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:0.0:1784192030.736274:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828056960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.736277:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828055808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.736307:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828055808:12345-0@lo:400:kworker.0 Request processed in 29us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192030.736313:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00000100:00100000:1.0:1784192030.736328:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:1.0:1784192030.736333:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828056320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192030.736401:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:2.0:1784192030.736411:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858828056832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192030.737346:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784192030.737363:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828057088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784192030.737401:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192030.737445:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828057088 00000100:00100000:3.0:1784192030.737450:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828057088 00000100:00100000:3.0:1784192030.737481:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:3.0:1784192030.737487:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:106500:x1870858828057088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784192030.737527:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:3.0:1784192030.737569:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:106500:x1870858828057088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192030.737576:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:3.0:1784192030.737630:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828057088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784192030.737728:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828056960:12345-0@lo:400:kworker.0 Request processed in 1452us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192030.737736:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00080000:0.0:1784192030.737771:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784192030.737776:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784192030.737797:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828055808:0@lo:400:kworker.0 00000100:00100000:1.0:1784192030.738126:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828056320:12345-0@lo:400:kworker.0 Request processed in 1790us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192030.738134:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1784192030.738793:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828056320:0@lo:400:kworker.0 00000100:00100000:3.0:1784192030.739156:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858828056832:0@lo:400:kworker.0 00000100:00100000:2.0:1784192030.739157:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858828056832:12345-0@lo:400:kworker.0 Request processed in 2746us (3052us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192030.739167:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1784192030.739307:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828056960:0@lo:400:kworker.0 00010000:00010000:0.0:1784192030.796387:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784192031.244079:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784192031.244111:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828057216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784192031.244204:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192031.244312:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784192031.244325:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828057344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784192031.244374:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192031.244529:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828057216 00000100:00100000:2.0:1784192031.244539:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828057216 00000100:00100000:2.0:1784192031.244604:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:2.0:1784192031.244615:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828057216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784192031.244652:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:2.0:1784192031.244725:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828057216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192031.244733:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00100000:3.0:1784192031.244911:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828057216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784192031.244920:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828057344 00000100:00100000:1.0:1784192031.244924:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828057344 00000100:00100000:1.0:1784192031.244971:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1784192031.244978:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1099fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828057344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784192031.245006:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784192031.245138:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1099fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828057344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 159us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192031.245145:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1784192031.246800:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828057344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784192031.759652:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784192031.759679:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828057472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784192031.759775:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192031.760156:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828057472 00000100:00100000:0.0:1784192031.760177:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828057472 00000100:00100000:0.0:1784192031.760243:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1784192031.760254:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828057472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784192031.760280:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:0.0:1784192031.760346:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828057472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192031.760354:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1784192031.765811:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828057472:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784192031.823375:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784192032.609756:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784192032.611328:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812504064 00000100:00100000:0.0:1784192032.611915:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812504064 00000100:00100000:0.0:1784192032.612015:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 141 00000100:00100000:0.0:1784192032.612028:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af110f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812504064:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784192032.612219:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af110f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812504064:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 192us (2534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192032.612228:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 141 00000100:00100000:3.0:1784192032.613330:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784192032.613526:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812504320 00000100:00100000:0.0:1784192032.613536:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812504320 00000100:00100000:0.0:1784192032.613621:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 550 00000100:00100000:0.0:1784192032.613632:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812504320:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784192032.613813:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812504320:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 181us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192032.613821:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 550 00000100:00080000:1.0:1784192032.613956:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784192032.622125:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784192032.622663:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812504192 00000100:00100000:3.0:1784192032.622685:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812504192 00000100:00100000:3.0:1784192032.622813:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 551 00000100:00100000:3.0:1784192032.622829:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69110:x1870858812504192:12345-192.168.204.16@tcp:400:kworker.0 00000100:00080000:1.0:1784192032.623129:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784192032.623596:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69110:x1870858812504192:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 766us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192032.623608:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 551 00010000:00010000:3.0:1784192032.846558:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784192033.870837:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784192034.316104:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784192034.316144:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828057600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784192034.316245:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192034.316441:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828057600 00000100:00100000:1.0:1784192034.316452:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828057600 00000100:00100000:1.0:1784192034.316537:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1784192034.316551:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828057600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784192034.316593:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:1.0:1784192034.316651:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828057600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192034.316660:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:0.0:1784192034.316849:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784192034.316908:0:106500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af104c78000 x1870858828057600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192034.316953:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828057600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784192034.317430:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828057728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784192034.317476:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192034.317566:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828057728 00000100:00100000:2.0:1784192034.317573:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828057728 00000100:00100000:2.0:1784192034.317633:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1784192034.317650:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828057728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784192034.317670:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:2.0:1784192034.317743:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828057728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192034.317750:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:0.0:1784192034.317813:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784192034.317839:0:106500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af20d789f80 x1870858828057728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192034.317854:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828057728:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784192034.891886:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784192035.852029:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828057856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784192035.852116:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828057984:0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.852126:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828058240:0@lo:400:kworker.0 00000100:00100000:1.0:1784192035.852140:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192035.852184:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858828058112:0@lo:400:kworker.0 00000100:00100000:2.0:1784192035.852245:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192035.852304:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828058496:0@lo:400:kworker.0 00000100:00100000:2.0:1784192035.852333:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192035.852356:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828059008:0@lo:400:kworker.0 00000100:00100000:2.0:1784192035.852385:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192035.852406:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af2331d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828058368:0@lo:400:kworker.0 00000100:00100000:1.0:1784192035.852436:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192035.852456:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828058880:0@lo:400:kworker.0 00000100:00100000:1.0:1784192035.852476:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192035.852494:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858828059392:0@lo:400:kworker.0 00000100:00100000:1.0:1784192035.852519:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192035.852586:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192035.852607:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858828058752:0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.852622:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192035.852634:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:106500:1870858828059264:0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.852648:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192035.852654:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828059520:0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.852677:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828057984 00000100:00100000:0.0:1784192035.852685:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828057984 00000100:00100000:0.0:1784192035.852906:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784192035.852919:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1074b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828057984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.852978:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1074b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828057984:12345-0@lo:400:kworker.0 Request processed in 62us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192035.852985:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784192035.853035:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828059392 00000100:00100000:0.0:1784192035.853039:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828059392 00000100:00100000:2.0:1784192035.853049:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192035.853074:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828058240 00000100:00100000:0.0:1784192035.853096:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828058240 00000100:00100000:2.0:1784192035.853100:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828057984:0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.853120:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828058752 00000100:00100000:0.0:1784192035.853124:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828058752 00000100:00100000:0.0:1784192035.853265:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828059264 00000100:00100000:0.0:1784192035.853269:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828059264 00000100:00100000:0.0:1784192035.853286:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828059520 00000100:00100000:0.0:1784192035.853288:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828059520 00000100:00100000:0.0:1784192035.853304:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:0.0:1784192035.853381:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858828059392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.853429:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:106501:x1870858828059392:12345-0@lo:400:kworker.0 Request processed in 53us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192035.853435:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:0.0:1784192035.853449:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:0.0:1784192035.853456:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828058240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.853494:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828058240:12345-0@lo:400:kworker.0 Request processed in 39us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192035.853503:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:2.0:1784192035.853510:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828058496 00000100:00100000:2.0:1784192035.853516:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828058496 00000100:00100000:1.0:1784192035.853521:0:162394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828059008 00000100:00100000:0.0:1784192035.853522:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1784192035.853532:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858828058752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192035.853535:0:162394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828059008 00000100:00100000:0.0:1784192035.853577:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858828058752:12345-0@lo:400:kworker.0 Request processed in 48us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192035.853582:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1784192035.853591:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:0.0:1784192035.853595:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106500:x1870858828059264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.853612:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:106500:x1870858828059264:12345-0@lo:400:kworker.0 Request processed in 17us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192035.853615:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:0.0:1784192035.853629:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:0.0:1784192035.853633:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828059520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.853656:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828059520:12345-0@lo:400:kworker.0 Request processed in 23us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192035.853660:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00080000:0.0:1784192035.853680:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784192035.853683:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784192035.853855:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828058240:0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.853869:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858828058752:0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.853881:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:106500:1870858828059264:0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.853930:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828057856 00000100:00100000:0.0:1784192035.853935:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828057856 00000100:00100000:0.0:1784192035.853962:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828058368 00000100:00100000:0.0:1784192035.853965:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828058368 00000100:00100000:0.0:1784192035.853976:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828058880 00000100:00100000:0.0:1784192035.853978:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828058880 00000100:00100000:0.0:1784192035.853990:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00100000:0.0:1784192035.853996:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:106501:x1870858828057856:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784192035.854000:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1784192035.854014:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828058496:12345-0@lo:400:kworker.0 00000004:00000024:0.0:1784192035.854035:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:2.0:1784192035.854063:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828058496:12345-0@lo:400:kworker.0 Request processed in 53us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192035.854070:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1784192035.854088:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:106501:x1870858828057856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192035.854096:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00100000:0.0:1784192035.854113:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:0.0:1784192035.854120:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828058368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192035.854125:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828059520:0@lo:400:kworker.0 00010000:00080000:2.0:1784192035.854144:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22de47b80 x1870858828058496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192035.854156:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828058368:12345-0@lo:400:kworker.0 Request processed in 34us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192035.854185:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828058496:0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.854185:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00100000:0.0:1784192035.854206:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 813 00000100:00100000:0.0:1784192035.854213:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828058880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.854253:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828058880:12345-0@lo:400:kworker.0 Request processed in 41us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192035.854260:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 813 00000100:00100000:2.0:1784192035.854273:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828058368:0@lo:400:kworker.0 00000100:00100000:2.0:1784192035.854286:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828058880:0@lo:400:kworker.0 00000100:00100000:2.0:1784192035.854297:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:106501:1870858828059392:0@lo:400:kworker.0 00000100:00100000:2.0:1784192035.854312:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828057856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784192035.854447:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192035.854484:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828058624:0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.854489:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828058112 00000100:00100000:0.0:1784192035.854494:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828058112 00000100:00100000:3.0:1784192035.854518:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192035.854535:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1784192035.854541:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858828058112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192035.854547:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828059136:0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.854572:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858828058112:12345-0@lo:400:kworker.0 Request processed in 32us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192035.854578:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1784192035.854601:0:162339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828058624 00000100:00100000:0.0:1784192035.854603:0:162339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828058624 00000100:00100000:0.0:1784192035.854624:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1784192035.854629:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828059008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.854657:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828059008:12345-0@lo:400:kworker.0 Request processed in 28us (2273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192035.854661:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1784192035.854671:0:162339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1784192035.854674:0:162339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828058624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.854718:0:162339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828058624:12345-0@lo:400:kworker.0 Request processed in 32us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192035.854725:0:162339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00010000:00080000:0.0:1784192035.854765:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22de45880 x1870858828059008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192035.854776:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828059008:0@lo:400:kworker.0 00000100:00080000:2.0:1784192035.855543:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784192035.855551:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784192035.856212:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192035.856307:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af2331d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858828058112:0@lo:400:kworker.0 00000100:00100000:3.0:1784192035.856324:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828058624:0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.856760:0:160166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828059136 00000100:00100000:0.0:1784192035.856772:0:160166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828059136 00000100:00100000:0.0:1784192035.856860:0:160166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1784192035.856870:0:160166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828059136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192035.856985:0:160166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828059136:12345-0@lo:400:kworker.0 Request processed in 116us (2393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192035.856994:0:160166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00080000:2.0:1784192035.857163:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784192035.857245:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828059136:0@lo:400:kworker.0 00010000:00010000:2.0:1784192035.921780:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784192036.364085:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828059648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784192036.364459:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192036.364672:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828059648 00000100:00100000:3.0:1784192036.364683:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828059648 00000100:00100000:3.0:1784192036.364781:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1784192036.364792:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828059648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784192036.364865:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:3.0:1784192036.364937:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828059648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 146us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192036.364946:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1784192036.365165:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828059776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784192036.365219:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192036.365721:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828059648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784192036.365854:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828059776 00000100:00100000:3.0:1784192036.365860:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828059776 00000100:00100000:3.0:1784192036.365948:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:3.0:1784192036.365957:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828059776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784192036.365999:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:3.0:1784192036.366068:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828059776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192036.366075:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00000100:00100000:0.0:1784192036.366149:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828059776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784192036.876381:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828059904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784192036.876487:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192036.876810:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828059904 00000100:00100000:1.0:1784192036.876821:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828059904 00000100:00100000:1.0:1784192036.877319:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1784192036.877332:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828059904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784192036.877365:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784192036.877884:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828059904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 553us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192036.877895:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1784192036.878364:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828059904:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784192036.941628:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784192037.724476:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784192037.724635:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784192037.724720:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784192037.724740:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812504576 00000100:00100000:3.0:1784192037.724755:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812504576 00000100:00100000:3.0:1784192037.724869:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812504704 00000100:00100000:3.0:1784192037.724873:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812504704 00000100:00100000:3.0:1784192037.724902:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 558 00000100:00100000:3.0:1784192037.724915:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69109:x1870858812504576:12345-192.168.204.16@tcp:400:kworker.0 00000100:00080000:2.0:1784192037.724957:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784192037.724962:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784192037.724979:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 559 00000100:00100000:2.0:1784192037.724988:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812504704:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784192037.725025:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812504704:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 41us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192037.725054:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 559 00000100:00100000:3.0:1784192037.725100:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69109:x1870858812504576:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 107us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192037.725109:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 558 00000100:00100000:1.0:1784192037.727410:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812504448 00000100:00100000:1.0:1784192037.727434:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812504448 00000100:00100000:1.0:1784192037.727544:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 143 00000100:00100000:1.0:1784192037.727556:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1074b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69111:x1870858812504448:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784192037.728028:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1074b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69111:x1870858812504448:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 473us (3306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192037.728037:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 143 00010000:00010000:3.0:1784192037.966752:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784192038.990119:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784192039.436535:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828060032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784192039.436664:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192039.436764:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af104c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828060160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784192039.436821:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192039.436987:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828060032 00000100:00100000:1.0:1784192039.436999:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828060032 00000100:00080000:0.0:1784192039.437073:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784192039.437091:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828060160 00000100:00100000:1.0:1784192039.437096:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828060160 00000100:00100000:3.0:1784192039.437126:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00080000:0.0:1784192039.437233:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784192039.437436:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828060032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784192039.437477:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:3.0:1784192039.439652:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828060032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2266us (2975us total) trans 0 rc 0/0 00010000:00080000:0.0:1784192039.444642:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af20d78aa00 x1870858828060032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192039.444686:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828060032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784192039.445572:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1784192039.445599:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828060160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784192039.445656:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:1.0:1784192039.445797:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828060160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 211us (8975us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192039.445806:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00010000:00080000:0.0:1784192039.447594:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af104c79880 x1870858828060160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192039.447626:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af104c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828060160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784192039.449114:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00010000:00010000:2.0:1784192040.012129:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784192040.974014:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828060672:0@lo:400:kworker.0 00000100:00100000:0.0:1784192040.974054:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858828060288:0@lo:400:kworker.0 00000100:00100000:2.0:1784192040.974177:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858828060416:0@lo:400:kworker.0 00000100:00100000:1.0:1784192040.974273:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858828060544:0@lo:400:kworker.0 00000100:00100000:0.0:1784192040.981464:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192040.981595:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828060800:0@lo:400:kworker.0 00000100:00100000:0.0:1784192040.981658:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192040.981713:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828061312:0@lo:400:kworker.0 00000100:00100000:3.0:1784192040.981722:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192040.981741:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192040.984929:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858828061824:0@lo:400:kworker.0 00000100:00100000:0.0:1784192040.985038:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192040.985411:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828060288 00000100:00100000:0.0:1784192040.985422:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828060288 00000100:00100000:0.0:1784192040.985483:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784192040.985494:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1074b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106500:x1870858828060288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192040.985523:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828061184:0@lo:400:kworker.0 00000100:00100000:0.0:1784192040.985564:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1074b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106500:x1870858828060288:12345-0@lo:400:kworker.0 Request processed in 70us (4111us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192040.985572:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192040.985576:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1784192040.985622:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858828061696:0@lo:400:kworker.0 00000100:00100000:0.0:1784192040.985625:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828060800 00000100:00100000:0.0:1784192040.985630:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828060800 00000100:00100000:3.0:1784192040.985657:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192040.985664:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828061312 00000100:00100000:0.0:1784192040.985668:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828061312 00000100:00100000:0.0:1784192040.985711:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1784192040.985719:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828060800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192040.985724:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828060672 00000100:00100000:3.0:1784192040.985731:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828060672 00000100:00100000:0.0:1784192040.985769:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828060800:12345-0@lo:400:kworker.0 Request processed in 51us (4109us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192040.985778:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1784192040.985786:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828061184 00000100:00100000:3.0:1784192040.985791:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828061184 00000100:00100000:0.0:1784192040.985796:0:162395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1784192040.985804:0:162395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828061312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192040.985822:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:3.0:1784192040.985832:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828060672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192040.985838:0:162395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828061312:12345-0@lo:400:kworker.0 Request processed in 33us (4095us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192040.985866:0:162395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1784192040.985894:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828061824 00000100:00100000:0.0:1784192040.985897:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828061824 00000100:00100000:3.0:1784192040.985906:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828060672:12345-0@lo:400:kworker.0 Request processed in 75us (4184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192040.985934:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828061696 00000100:00100000:0.0:1784192040.985937:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828061696 00000100:00100000:0.0:1784192040.985953:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1784192040.985959:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858828061824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192040.985988:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858828061824:12345-0@lo:400:kworker.0 Request processed in 30us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192040.985994:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1784192040.986003:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:0.0:1784192040.986007:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858828061696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192040.986027:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858828061696:12345-0@lo:400:kworker.0 Request processed in 20us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192040.986033:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00080000:0.0:1784192040.986062:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784192040.986066:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784192040.986076:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:3.0:1784192040.986096:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:0.0:1784192040.986101:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d78aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106500:1870858828060288:0@lo:400:kworker.0 00000100:00100000:3.0:1784192040.986106:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828061184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192040.986146:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828061184:12345-0@lo:400:kworker.0 Request processed in 44us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192040.986153:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:3.0:1784192040.986200:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828060672:0@lo:400:kworker.0 00000100:00100000:3.0:1784192040.986221:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828061184:0@lo:400:kworker.0 00000100:00100000:3.0:1784192040.986233:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858828061696:0@lo:400:kworker.0 00000100:00100000:2.0:1784192040.986243:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192040.986274:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828060928:0@lo:400:kworker.0 00000100:00100000:2.0:1784192040.986301:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192040.986318:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828061440:0@lo:400:kworker.0 00000100:00100000:2.0:1784192040.986336:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192040.986357:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828061952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784192040.986377:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192040.986413:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828060928 00000100:00100000:3.0:1784192040.986419:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828060928 00000100:00100000:2.0:1784192040.986421:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828060416 00000100:00100000:2.0:1784192040.986426:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828060416 00000100:00100000:2.0:1784192040.986468:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:3.0:1784192040.986469:0:162387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828061440 00000100:00100000:3.0:1784192040.986475:0:162387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828061440 00000100:00100000:2.0:1784192040.986477:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858828060416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192040.986504:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1784192040.986515:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af104c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828060928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192040.986521:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858828060416:12345-0@lo:400:kworker.0 Request processed in 43us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192040.986528:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:2.0:1784192040.986563:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858828060416:0@lo:400:kworker.0 00000100:00080000:2.0:1784192040.986584:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784192040.986588:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784192040.986594:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828061952 00000100:00100000:2.0:1784192040.986596:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828061952 00000100:00100000:2.0:1784192040.986613:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:2.0:1784192040.986618:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828061952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784192040.986644:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00010000:00080000:0.0:1784192040.986711:0:106500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af210303100 x1870858828060800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192040.986723:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828060800:0@lo:400:kworker.0 00000100:00100000:3.0:1784192040.987173:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af104c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828060928:12345-0@lo:400:kworker.0 Request processed in 659us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192040.987181:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1784192040.987197:0:162387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1784192040.987204:0:162387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828061440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192040.987235:0:162387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828061440:12345-0@lo:400:kworker.0 Request processed in 34us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192040.987241:0:162387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1784192040.987292:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828060928:0@lo:400:kworker.0 00000100:00100000:3.0:1784192040.987303:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828061440:0@lo:400:kworker.0 00000100:00100000:2.0:1784192040.989848:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828061952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3213us (3453us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192040.989868:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00100000:3.0:1784192040.989988:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828061952:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1784192040.992319:0:106500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af210301500 x1870858828061312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192040.992358:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828061312:0@lo:400:kworker.0 00000100:00100000:0.0:1784192040.992382:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858828061824:0@lo:400:kworker.0 00000100:00100000:1.0:1784192040.992656:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192040.992735:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af210302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858828061056:0@lo:400:kworker.0 00000100:00100000:1.0:1784192040.992799:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192040.992828:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828061568:0@lo:400:kworker.0 00000100:00100000:1.0:1784192040.992852:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192040.995510:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828060544 00000100:00100000:3.0:1784192040.995529:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828060544 00000100:00100000:3.0:1784192040.995633:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828061056 00000100:00100000:3.0:1784192040.995636:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828061056 00000100:00100000:3.0:1784192040.995664:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1784192040.995677:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858828060544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192040.995858:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106502:x1870858828060544:12345-0@lo:400:kworker.0 Request processed in 183us (3201us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192040.995867:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1784192040.995898:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828061568 00000100:00100000:3.0:1784192040.995902:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828061568 00000100:00100000:3.0:1784192040.995986:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1784192040.995994:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858828061056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192040.996028:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858828061056:12345-0@lo:400:kworker.0 Request processed in 35us (3228us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192040.996034:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1784192040.996046:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:3.0:1784192040.996052:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828061568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192040.996081:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828061568:12345-0@lo:400:kworker.0 Request processed in 29us (3228us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192040.996088:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00080000:1.0:1784192040.996300:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784192040.996353:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:106502:1870858828060544:0@lo:400:kworker.0 00000100:00100000:1.0:1784192040.996370:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af210302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858828061056:0@lo:400:kworker.0 00000100:00100000:1.0:1784192040.996382:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828061568:0@lo:400:kworker.0 00010000:00010000:3.0:1784192041.039231:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784192041.484155:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784192041.484194:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af227e63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828062208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784192041.484300:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192041.484375:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828062080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784192041.484421:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192041.487616:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828062208 00000100:00100000:3.0:1784192041.487644:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828062208 00000100:00100000:3.0:1784192041.487818:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1784192041.487834:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828062208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784192041.487890:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:3.0:1784192041.488023:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828062208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 192us (3721us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192041.488030:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1784192041.488420:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828062080 00000100:00100000:0.0:1784192041.488428:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828062080 00000100:00100000:0.0:1784192041.488480:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:0.0:1784192041.488488:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828062080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784192041.488525:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:0.0:1784192041.488583:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828062080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (4161us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192041.488589:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00100000:0.0:1784192041.488675:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af227e63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828062208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784192041.488885:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828062080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784192041.997045:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828062336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784192041.997155:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192041.997524:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828062336 00000100:00100000:1.0:1784192041.997537:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828062336 00000100:00100000:1.0:1784192041.997619:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1784192041.997632:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828062336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784192041.997677:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784192041.999045:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828062336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1405us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192041.999062:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1784192041.999807:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828062336:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784192042.066139:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784192042.835671:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784192042.835857:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784192042.836045:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812504832 00000100:00100000:0.0:1784192042.836056:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812504832 00000100:00100000:0.0:1784192042.836162:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 145 00000100:00100000:0.0:1784192042.836175:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69111:x1870858812504832:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784192042.836259:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69111:x1870858812504832:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 86us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192042.836267:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 145 00000100:00100000:3.0:1784192042.842204:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812504960 00000100:00100000:3.0:1784192042.842233:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812504960 00000100:00100000:0.0:1784192042.842980:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 566 00000100:00100000:0.0:1784192042.842997:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af2331d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812504960:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784192042.843109:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af2331d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812504960:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 117us (7601us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192042.843117:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 566 00000100:00080000:1.0:1784192042.845035:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784192042.851386:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784192042.851517:0:158667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812505088 00000100:00100000:3.0:1784192042.851526:0:158667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812505088 00000100:00100000:3.0:1784192042.851592:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 567 00000100:00100000:3.0:1784192042.851603:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812505088:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784192042.851728:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812505088:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 88us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192042.851736:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 567 00000100:00080000:1.0:1784192042.852448:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784192043.083874:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784192044.110486:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784192044.557403:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828062464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784192044.557486:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192044.557532:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784192044.557538:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828062592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784192044.557560:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192044.557641:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828062464 00000100:00100000:2.0:1784192044.557649:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828062464 00000100:00100000:2.0:1784192044.557744:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828062592 00000100:00100000:2.0:1784192044.557749:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828062592 00000100:00100000:2.0:1784192044.557773:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1784192044.557781:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828062464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784192044.557809:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:2.0:1784192044.557864:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828062464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192044.557870:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1784192044.557887:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1784192044.557893:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22de47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828062592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784192044.557902:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:2.0:1784192044.557928:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22de47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828062592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192044.557935:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00010000:00080000:3.0:1784192044.557960:0:106501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10db4f480 x1870858828062592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784192044.557981:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828062592:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1784192044.557993:0:106501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af111b7c000 x1870858828062464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784192044.558005:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828062464:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784192044.558132:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784192045.131893:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784192046.092032:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858828062976:0@lo:400:kworker.0 00000100:00100000:3.0:1784192046.092077:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858828062720:0@lo:400:kworker.0 00000100:00100000:1.0:1784192046.092165:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858828062848:0@lo:400:kworker.0 00000100:00100000:0.0:1784192046.092283:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22de45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828063104:0@lo:400:kworker.0 00000100:00100000:2.0:1784192046.095723:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192046.095822:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858828063488:0@lo:400:kworker.0 00000100:00100000:2.0:1784192046.095878:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192046.095898:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858828064000:0@lo:400:kworker.0 00000100:00100000:2.0:1784192046.095917:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192046.095955:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828062976 00000100:00100000:2.0:1784192046.095962:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828062976 00000100:00100000:2.0:1784192046.096020:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828063488 00000100:00100000:2.0:1784192046.096024:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828063488 00000100:00100000:2.0:1784192046.096044:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828064000 00000100:00100000:2.0:1784192046.096047:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828064000 00000100:00100000:2.0:1784192046.096063:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1784192046.096071:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858828062976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192046.096127:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106501:x1870858828062976:12345-0@lo:400:kworker.0 Request processed in 56us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192046.096134:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1784192046.096151:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1784192046.096157:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858828063488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192046.096185:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106501:x1870858828063488:12345-0@lo:400:kworker.0 Request processed in 28us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192046.096191:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1784192046.096202:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:2.0:1784192046.096207:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858828064000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192046.096231:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858828064000:12345-0@lo:400:kworker.0 Request processed in 25us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192046.096255:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00080000:2.0:1784192046.096275:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784192046.096313:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:106501:1870858828063488:0@lo:400:kworker.0 00000100:00100000:2.0:1784192046.096323:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858828064000:0@lo:400:kworker.0 00000100:00100000:2.0:1784192046.096333:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:106501:1870858828062976:0@lo:400:kworker.0 00000100:00100000:3.0:1784192046.097044:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192046.097091:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828063232:0@lo:400:kworker.0 00000100:00100000:3.0:1784192046.097129:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192046.097156:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828063232 00000100:00100000:3.0:1784192046.097161:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828063232 00000100:00100000:3.0:1784192046.097197:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1784192046.097205:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828063232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192046.098079:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828063232:12345-0@lo:400:kworker.0 Request processed in 873us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192046.098103:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00080000:3.0:1784192046.098131:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784192046.098157:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10fb63800 x1870858828063232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784192046.098169:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828063232:0@lo:400:kworker.0 00000100:00100000:3.0:1784192046.098177:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828063744:0@lo:400:kworker.0 00000100:00100000:3.0:1784192046.098200:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192046.098358:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192046.098398:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828062848 00000100:00100000:1.0:1784192046.098414:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828062848 00000100:00100000:2.0:1784192046.098485:0:167178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828062720 00000100:00100000:2.0:1784192046.098490:0:167178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828062720 00000100:00100000:2.0:1784192046.098523:0:167178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784192046.098531:0:167178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858828062720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192046.098571:0:167178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106499:x1870858828062720:12345-0@lo:400:kworker.0 Request processed in 41us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192046.098579:0:167178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784192046.098599:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192046.098630:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828063104 00000100:00100000:0.0:1784192046.098635:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828063104 00000100:00100000:0.0:1784192046.098683:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 819 00000100:00100000:0.0:1784192046.098704:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828063104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192046.098740:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828063104:12345-0@lo:400:kworker.0 Request processed in 50us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192046.098747:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 819 00000100:00100000:0.0:1784192046.098776:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828063104:0@lo:400:kworker.0 00000100:00100000:0.0:1784192046.098784:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828063616:0@lo:400:kworker.0 00000100:00100000:0.0:1784192046.098805:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192046.098825:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828063616 00000100:00100000:0.0:1784192046.098828:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828063616 00000100:00100000:0.0:1784192046.098851:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:0.0:1784192046.098864:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828063616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192046.098893:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828063616:12345-0@lo:400:kworker.0 Request processed in 30us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192046.098899:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000100:00100000:0.0:1784192046.098924:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828063616:0@lo:400:kworker.0 00000100:00100000:0.0:1784192046.098931:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858828064128:0@lo:400:kworker.0 00000100:00100000:0.0:1784192046.098953:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192046.098976:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828064128 00000100:00100000:0.0:1784192046.098979:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828064128 00000100:00100000:1.0:1784192046.104777:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:1.0:1784192046.104802:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858828062848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192046.104915:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858828062848:12345-0@lo:400:kworker.0 Request processed in 124us (6556us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192046.104922:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:1.0:1784192046.105010:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858828062848:0@lo:400:kworker.0 00000100:00100000:1.0:1784192046.105048:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828063360:0@lo:400:kworker.0 00000100:00100000:1.0:1784192046.105091:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192046.105118:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828063872:0@lo:400:kworker.0 00000100:00100000:1.0:1784192046.105140:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192046.105158:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828064384:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784192046.105182:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192046.105236:0:162396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828063744 00000100:00100000:1.0:1784192046.105243:0:162396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828063744 00000100:00100000:0.0:1784192046.107031:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:0.0:1784192046.107044:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858828064128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192046.107118:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858828064128:12345-0@lo:400:kworker.0 Request processed in 77us (8163us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192046.107126:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:0.0:1784192046.107157:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828063360 00000100:00100000:0.0:1784192046.107163:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828063360 00000100:00100000:0.0:1784192046.107196:0:161232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828063872 00000100:00100000:0.0:1784192046.107199:0:161232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828063872 00000100:00100000:0.0:1784192046.107225:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1784192046.107232:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af111b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828063360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192046.107270:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af111b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828063360:12345-0@lo:400:kworker.0 Request processed in 38us (2178us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192046.107277:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1784192046.107289:0:161232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1784192046.107294:0:161232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828063872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192046.107320:0:161232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828063872:12345-0@lo:400:kworker.0 Request processed in 26us (2179us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192046.107339:0:161232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1784192046.107358:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828064384 00000100:00100000:0.0:1784192046.107362:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828064384 00000100:00100000:0.0:1784192046.107385:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:0.0:1784192046.107390:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828064384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784192046.107434:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:0.0:1784192046.107585:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828064384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 193us (2401us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192046.107592:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00100000:0.0:1784192046.107643:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828063360:0@lo:400:kworker.0 00000100:00100000:0.0:1784192046.107686:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828063872:0@lo:400:kworker.0 00000100:00100000:0.0:1784192046.107721:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828064384:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784192046.107781:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858828064128:0@lo:400:kworker.0 00000100:00080000:2.0:1784192046.108933:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784192046.108942:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784192046.108946:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784192046.112665:0:162396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1784192046.112683:0:162396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828063744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192046.112805:0:162396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828063744:12345-0@lo:400:kworker.0 Request processed in 127us (14601us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192046.112815:0:162396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00010000:00080000:3.0:1784192046.114374:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10fb61500 x1870858828063744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784192046.114394:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828063744:0@lo:400:kworker.0 00000100:00100000:3.0:1784192046.114407:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858828064256:0@lo:400:kworker.0 00000100:00100000:3.0:1784192046.114466:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192046.114499:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22de45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106499:1870858828062720:0@lo:400:kworker.0 00000100:00100000:0.0:1784192046.114593:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828064256 00000100:00100000:0.0:1784192046.114600:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828064256 00000100:00100000:0.0:1784192046.114681:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:0.0:1784192046.114710:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858828064256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192046.114775:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:106499:x1870858828064256:12345-0@lo:400:kworker.0 Request processed in 86us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192046.114783:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:3.0:1784192046.115026:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:106499:1870858828064256:0@lo:400:kworker.0 00000100:00080000:1.0:1784192046.116502:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1784192046.156152:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784192046.605873:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828064512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784192046.605949:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192046.606071:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828064512 00000100:00100000:1.0:1784192046.606079:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828064512 00000100:00100000:1.0:1784192046.606164:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:1.0:1784192046.606174:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828064512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784192046.606211:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:1.0:1784192046.606267:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828064512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192046.606274:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:2.0:1784192046.606360:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828064512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784192046.606601:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828064640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784192046.606635:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192046.606710:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828064640 00000100:00100000:2.0:1784192046.606714:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828064640 00000100:00100000:2.0:1784192046.606758:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1784192046.606766:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828064640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784192046.606786:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:2.0:1784192046.606829:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828064640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192046.606843:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1784192046.606869:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828064640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784192047.115952:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784192047.115978:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828064768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784192047.116062:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192047.116296:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828064768 00000100:00100000:1.0:1784192047.116306:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828064768 00000100:00100000:1.0:1784192047.116364:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1784192047.116374:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828064768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784192047.116401:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784192047.116462:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828064768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192047.116470:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1784192047.116734:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828064768:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784192047.179993:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784192047.956241:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784192047.956288:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784192047.956317:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812505216 00000100:00100000:0.0:1784192047.956334:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784192047.956336:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812505216 00000100:00100000:1.0:1784192047.956438:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 147 00000100:00100000:1.0:1784192047.956451:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812505216:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784192047.956533:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812505472 00000100:00100000:2.0:1784192047.956546:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812505472 00000100:00100000:1.0:1784192047.956588:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812505216:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 138us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192047.956598:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 147 00000100:00100000:2.0:1784192047.956644:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812505344 00000100:00100000:2.0:1784192047.956650:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812505344 00000100:00100000:2.0:1784192047.956735:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 574 00000100:00100000:2.0:1784192047.956749:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812505472:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784192047.956825:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812505472:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 79us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192047.956832:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 574 00000100:00100000:2.0:1784192047.956858:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 575 00000100:00100000:2.0:1784192047.956868:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812505344:12345-192.168.204.16@tcp:400:kworker.0 00000100:00080000:0.0:1784192047.961427:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784192047.961447:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784192047.964769:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812505344:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 7887us (8419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192047.964786:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 575 00010000:00010000:2.0:1784192048.204291:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784192049.228418:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784192049.676077:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784192049.676111:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828064896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784192049.676206:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192049.676379:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828064896 00000100:00100000:1.0:1784192049.676389:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828064896 00000100:00100000:1.0:1784192049.676458:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1784192049.676470:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828064896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784192049.676510:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:1.0:1784192049.676591:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828064896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192049.676600:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:1.0:1784192049.676629:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784192049.677036:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10db4ce00 x1870858828064896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784192049.677062:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828064896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784192049.677225:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828065024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784192049.677394:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192049.677452:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828065024 00000100:00100000:0.0:1784192049.677459:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828065024 00000100:00100000:0.0:1784192049.677514:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1784192049.677522:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828065024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784192049.677542:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00080000:3.0:1784192049.677547:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784192049.677600:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828065024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192049.677607:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00010000:00080000:0.0:1784192049.677639:0:106501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22dcfe680 x1870858828065024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192049.677653:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828065024:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784192050.252629:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784192051.214648:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828065408:0@lo:400:kworker.0 00000100:00100000:1.0:1784192051.214802:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192051.214894:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784192051.214901:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858828065280:0@lo:400:kworker.0 00000100:00100000:1.0:1784192051.214929:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192051.214957:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784192051.214967:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858828065152:0@lo:400:kworker.0 00000100:00100000:1.0:1784192051.215009:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192051.215052:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828065408 00000100:00100000:1.0:1784192051.215061:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828065408 00000100:00100000:1.0:1784192051.215129:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828065280 00000100:00100000:1.0:1784192051.215133:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828065280 00000100:00100000:1.0:1784192051.215160:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:1.0:1784192051.215171:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828065408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192051.215237:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828065408:12345-0@lo:400:kworker.0 Request processed in 67us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192051.215247:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:1.0:1784192051.215271:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1784192051.215278:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858828065280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192051.215308:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858828065280:12345-0@lo:400:kworker.0 Request processed in 30us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192051.215314:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1784192051.215338:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828065152 00000100:00100000:1.0:1784192051.215361:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828065152 00000100:00100000:1.0:1784192051.215392:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1784192051.215399:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858828065152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192051.215434:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858828065152:12345-0@lo:400:kworker.0 Request processed in 36us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192051.215440:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784192051.216061:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828065920:0@lo:400:kworker.0 00000100:00100000:0.0:1784192051.216108:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192051.216134:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828066432:0@lo:400:kworker.0 00000100:00100000:0.0:1784192051.216154:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192051.216209:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858828065280:0@lo:400:kworker.0 00000100:00100000:0.0:1784192051.216224:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828065408:0@lo:400:kworker.0 00000100:00100000:0.0:1784192051.216254:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784192051.216259:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828065792:0@lo:400:kworker.0 00000100:00100000:0.0:1784192051.216285:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192051.216303:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828066304:0@lo:400:kworker.0 00000100:00100000:0.0:1784192051.216324:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192051.216340:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858828066816:0@lo:400:kworker.0 00000100:00100000:0.0:1784192051.216365:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192051.216396:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828065920 00000100:00100000:0.0:1784192051.216401:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828065920 00000100:00100000:0.0:1784192051.216446:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828066432 00000100:00100000:0.0:1784192051.216449:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828066432 00000100:00100000:0.0:1784192051.216466:0:162395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828065792 00000100:00100000:0.0:1784192051.216469:0:162395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828065792 00000100:00100000:3.0:1784192051.216904:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828065664:0@lo:400:kworker.0 00000100:00100000:3.0:1784192051.216954:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192051.216984:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828066176:0@lo:400:kworker.0 00000100:00100000:3.0:1784192051.217019:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192051.217040:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858828066688:0@lo:400:kworker.0 00000100:00100000:3.0:1784192051.217065:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192051.217091:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1784192051.217099:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828065536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784192051.217121:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192051.217142:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10fb61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858828066048:0@lo:400:kworker.0 00000100:00100000:3.0:1784192051.217161:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192051.217180:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af106b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828066560:0@lo:400:kworker.0 00000100:00100000:3.0:1784192051.217202:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784192051.217225:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784192051.217230:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784192051.217234:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784192051.217237:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784192051.217253:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828066816 00000100:00100000:3.0:1784192051.217258:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828066816 00000100:00100000:3.0:1784192051.217300:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828066688 00000100:00100000:3.0:1784192051.217303:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828066688 00000100:00100000:3.0:1784192051.217319:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828066048 00000100:00100000:3.0:1784192051.217322:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828066048 00000100:00100000:3.0:1784192051.217333:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828066560 00000100:00100000:3.0:1784192051.217336:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828066560 00000100:00100000:3.0:1784192051.217351:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:3.0:1784192051.217360:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858828066816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192051.217423:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858828066816:12345-0@lo:400:kworker.0 Request processed in 64us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192051.217431:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:3.0:1784192051.217449:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:3.0:1784192051.217464:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858828066688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192051.221879:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858828065152:0@lo:400:kworker.0 00000100:00100000:1.0:1784192051.222016:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828066304 00000100:00100000:1.0:1784192051.222027:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828066304 00000100:00100000:1.0:1784192051.222124:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1784192051.222136:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828065920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192051.222289:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1784192051.222305:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af106b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828066432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192051.222411:0:162390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1784192051.222423:0:162390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828065792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192051.222525:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1784192051.222537:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858828066048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192051.222664:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828065920:12345-0@lo:400:kworker.0 Request processed in 530us (6555us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192051.222674:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1784192051.222721:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1784192051.222728:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fb63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828066304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192051.222761:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828066304:12345-0@lo:400:kworker.0 Request processed in 34us (6435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192051.222767:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1784192051.222967:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1784192051.222977:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828066560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192051.223026:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106502:x1870858828066560:12345-0@lo:400:kworker.0 Request processed in 51us (5823us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192051.223033:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1784192051.223064:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828065664 00000100:00100000:1.0:1784192051.223079:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828065664 00000100:00100000:1.0:1784192051.223114:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828066176 00000100:00100000:1.0:1784192051.223117:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828066176 00000100:00100000:1.0:1784192051.223130:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828065536 00000100:00100000:1.0:1784192051.223132:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828065536 00000100:00100000:1.0:1784192051.223144:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:1.0:1784192051.223149:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828065664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192051.223187:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828065664:12345-0@lo:400:kworker.0 Request processed in 37us (6232us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192051.223193:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:1.0:1784192051.223206:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:1.0:1784192051.223212:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af227e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:106502:x1870858828066176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192051.223241:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af227e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:106502:x1870858828066176:12345-0@lo:400:kworker.0 Request processed in 30us (6221us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192051.223247:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:1.0:1784192051.223258:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:1.0:1784192051.223264:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828065536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784192051.223297:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:1.0:1784192051.223332:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828065536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (6209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192051.223338:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00080000:1.0:1784192051.223400:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784192051.223406:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784192051.223410:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1784192051.223459:0:106500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10fb62300 x1870858828066304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784192051.223476:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828066304:0@lo:400:kworker.0 00000100:00100000:1.0:1784192051.223504:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858828066816:0@lo:400:kworker.0 00000100:00100000:1.0:1784192051.223518:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828065920:0@lo:400:kworker.0 00000100:00100000:1.0:1784192051.223605:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828065536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784192051.223621:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:106502:1870858828066560:0@lo:400:kworker.0 00000100:00100000:1.0:1784192051.223634:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828065664:0@lo:400:kworker.0 00000100:00100000:1.0:1784192051.223644:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828066176:0@lo:400:kworker.0 00000100:00100000:1.0:1784192051.229329:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858828066688:12345-0@lo:400:kworker.0 Request processed in 11845us (12241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192051.229354:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:1.0:1784192051.229450:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af106b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858828066688:0@lo:400:kworker.0 00000100:00100000:3.0:1784192051.229635:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af106b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828066432:12345-0@lo:400:kworker.0 Request processed in 7334us (13476us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192051.229648:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1784192051.230171:0:162390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828065792:12345-0@lo:400:kworker.0 Request processed in 7748us (13881us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192051.230182:0:162390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00010000:00080000:3.0:1784192051.230342:0:106500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10fb61c00 x1870858828065792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784192051.230356:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828065792:0@lo:400:kworker.0 00000100:00100000:3.0:1784192051.230371:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828066432:0@lo:400:kworker.0 00000100:00100000:2.0:1784192051.230456:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106502:x1870858828066048:12345-0@lo:400:kworker.0 Request processed in 7920us (13291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192051.230466:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:1.0:1784192051.230912:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10fb61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:106502:1870858828066048:0@lo:400:kworker.0 00010000:00010000:0.0:1784192051.275958:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784192051.724159:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784192051.724195:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828066944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784192051.724310:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192051.724859:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828067072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784192051.724906:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192051.725090:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828067072 00000100:00100000:2.0:1784192051.725101:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828067072 00000100:00100000:2.0:1784192051.725181:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1784192051.725193:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828067072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784192051.725247:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:0.0:1784192051.725302:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828066944 00000100:00100000:0.0:1784192051.725308:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828066944 00000100:00100000:2.0:1784192051.725317:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828067072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192051.725327:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1784192051.725353:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:0.0:1784192051.725364:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828066944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784192051.725398:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:0.0:1784192051.725459:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828066944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192051.725490:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:3.0:1784192051.725521:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828067072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784192051.726034:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828066944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784192052.236092:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828067200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784192052.236204:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192052.236344:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828067200 00000100:00100000:1.0:1784192052.236356:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828067200 00000100:00100000:1.0:1784192052.236433:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1784192052.236445:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828067200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784192052.236573:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784192052.236912:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828067200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 468us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192052.236922:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1784192052.237412:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828067200:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784192052.302162:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784192053.082424:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784192053.082574:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812505856 00000100:00100000:2.0:1784192053.082589:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812505856 00000100:00100000:2.0:1784192053.082740:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 582 00000100:00100000:2.0:1784192053.082756:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10f4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812505856:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784192053.082865:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10f4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812505856:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 113us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192053.082874:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 582 00000100:00080000:1.0:1784192053.083058:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784192053.084613:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784192053.084728:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812505728 00000100:00100000:1.0:1784192053.084740:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812505728 00000100:00100000:1.0:1784192053.085014:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 583 00000100:00100000:1.0:1784192053.085027:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69110:x1870858812505728:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784192053.085134:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69110:x1870858812505728:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 110us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192053.085144:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 583 00000100:00080000:3.0:1784192053.087378:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784192053.088305:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784192053.090331:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812505600 00000100:00100000:1.0:1784192053.090353:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812505600 00000100:00100000:1.0:1784192053.090448:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 149 00000100:00100000:1.0:1784192053.090461:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812505600:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784192053.090592:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812505600:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 133us (2296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192053.090603:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 149 00010000:00010000:3.0:1784192053.324781:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784192054.349750:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784192054.797404:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828067328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784192054.797533:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192054.797592:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784192054.797601:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828067456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784192054.797627:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192054.797881:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828067328 00000100:00100000:0.0:1784192054.797893:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828067328 00000100:00100000:0.0:1784192054.797970:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828067456 00000100:00100000:0.0:1784192054.797974:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828067456 00000100:00100000:0.0:1784192054.797994:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1784192054.798004:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828067328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784192054.798048:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:0.0:1784192054.798104:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828067328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192054.798111:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1784192054.798129:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1784192054.798135:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828067456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784192054.798145:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:0.0:1784192054.798181:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828067456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192054.798187:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00010000:00080000:0.0:1784192054.798243:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10f4eca80 x1870858828067456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192054.798265:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828067456:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1784192054.798277:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10db4e680 x1870858828067328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192054.798289:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828067328:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784192054.798887:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784192055.372000:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784192056.332085:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858828067840:0@lo:400:kworker.0 00000100:00100000:1.0:1784192056.332158:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828067712:0@lo:400:kworker.0 00000100:00100000:0.0:1784192056.332196:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192056.332240:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192056.332279:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858828068352:0@lo:400:kworker.0 00000100:00100000:0.0:1784192056.332309:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192056.332330:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858828068864:0@lo:400:kworker.0 00000100:00100000:0.0:1784192056.332355:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192056.332399:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784192056.332408:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828067968:0@lo:400:kworker.0 00000100:00100000:0.0:1784192056.332441:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192056.332486:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828068480:0@lo:400:kworker.0 00000100:00100000:2.0:1784192056.332492:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828067840 00000100:00100000:2.0:1784192056.332502:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828067840 00000100:00100000:0.0:1784192056.332514:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192056.332534:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858828068992:0@lo:400:kworker.0 00000100:00100000:0.0:1784192056.332558:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192056.332628:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10f4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858828067584:0@lo:400:kworker.0 00000100:00100000:3.0:1784192056.332673:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192056.332730:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828068096:0@lo:400:kworker.0 00000100:00100000:3.0:1784192056.332757:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192056.332776:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828068608:0@lo:400:kworker.0 00000100:00100000:3.0:1784192056.332869:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192056.332889:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:106501:1870858828069120:0@lo:400:kworker.0 00000100:00100000:3.0:1784192056.332935:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192056.333009:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828067968 00000100:00100000:0.0:1784192056.333015:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828067968 00000100:00100000:0.0:1784192056.333052:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828068480 00000100:00100000:0.0:1784192056.333055:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828068480 00000100:00100000:0.0:1784192056.333076:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:0.0:1784192056.333085:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828067968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192056.333153:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828067968:12345-0@lo:400:kworker.0 Request processed in 68us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192056.333162:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00100000:0.0:1784192056.333181:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:0.0:1784192056.333187:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828068480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192056.333228:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828068480:12345-0@lo:400:kworker.0 Request processed in 41us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192056.333234:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:1.0:1784192056.336253:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828068224:0@lo:400:kworker.0 00000100:00100000:1.0:1784192056.336370:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192056.336418:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828068736:0@lo:400:kworker.0 00000100:00100000:1.0:1784192056.336482:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192056.336520:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828069248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784192056.336563:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784192056.336615:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784192056.347094:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828067712 00000100:00100000:2.0:1784192056.347120:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828067712 00000100:00100000:2.0:1784192056.347241:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828068352 00000100:00100000:2.0:1784192056.347245:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828068352 00000100:00100000:2.0:1784192056.347266:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828068864 00000100:00100000:2.0:1784192056.347270:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828068864 00000100:00100000:2.0:1784192056.347283:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828068992 00000100:00100000:2.0:1784192056.347286:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828068992 00000100:00100000:2.0:1784192056.347303:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828069120 00000100:00100000:2.0:1784192056.347306:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828069120 00000100:00100000:2.0:1784192056.347334:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1784192056.347347:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858828067840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192056.347486:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858828067840:12345-0@lo:400:kworker.0 Request processed in 141us (15291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192056.347495:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1784192056.347520:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:2.0:1784192056.347525:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828067712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192056.347567:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:106502:x1870858828067712:12345-0@lo:400:kworker.0 Request processed in 41us (15328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192056.347572:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:2.0:1784192056.347584:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1784192056.347589:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858828068352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192056.347617:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858828068352:12345-0@lo:400:kworker.0 Request processed in 28us (15308us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192056.347623:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1784192056.347632:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:2.0:1784192056.347638:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858828068864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192056.348887:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858828068864:12345-0@lo:400:kworker.0 Request processed in 47us (15330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192056.348903:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:2.0:1784192056.349080:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:2.0:1784192056.349094:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858828068992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192056.349178:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106499:x1870858828068992:12345-0@lo:400:kworker.0 Request processed in 90us (16619us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192056.349184:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:2.0:1784192056.349199:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:2.0:1784192056.349207:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106501:x1870858828069120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192056.349244:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106501:x1870858828069120:12345-0@lo:400:kworker.0 Request processed in 38us (16308us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192056.349250:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00080000:2.0:1784192056.349289:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784192056.349296:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784192056.349355:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:106502:1870858828067712:0@lo:400:kworker.0 00000100:00100000:2.0:1784192056.349445:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828067584 00000100:00100000:2.0:1784192056.349453:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828067584 00000100:00100000:2.0:1784192056.349514:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1784192056.349521:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858828067584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192056.349558:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858828067584:12345-0@lo:400:kworker.0 Request processed in 37us (16884us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192056.349565:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1784192056.349632:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828068096 00000100:00100000:2.0:1784192056.349637:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828068096 00000100:00100000:1.0:1784192056.351091:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828069248 00000100:00100000:1.0:1784192056.351110:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828069248 00000100:00100000:1.0:1784192056.351191:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:1.0:1784192056.351204:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af205713850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828069248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784192056.351257:0:158671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:1.0:1784192056.351377:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af205713850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828069248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 176us (14811us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192056.351384:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:2.0:1784192056.352116:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828068608 00000100:00100000:2.0:1784192056.352123:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828068608 00000100:00100000:2.0:1784192056.352150:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828068224 00000100:00100000:2.0:1784192056.352154:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828068224 00000100:00100000:2.0:1784192056.352178:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828068736 00000100:00100000:2.0:1784192056.352182:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828068736 00000100:00100000:2.0:1784192056.352208:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1784192056.352217:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828068096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192056.352288:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828068096:12345-0@lo:400:kworker.0 Request processed in 73us (19530us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192056.352297:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1784192056.352315:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1784192056.352322:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af210302680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828068608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192056.352357:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af210302680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828068608:12345-0@lo:400:kworker.0 Request processed in 36us (19487us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192056.352363:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1784192056.352375:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1784192056.352382:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828068224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192056.352415:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828068224:12345-0@lo:400:kworker.0 Request processed in 34us (16046us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192056.352421:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1784192056.352433:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1784192056.352439:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828068736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192056.352485:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828068736:12345-0@lo:400:kworker.0 Request processed in 45us (16002us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192056.352490:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00080000:2.0:1784192056.352520:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784192056.352546:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784192056.353168:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828067968:0@lo:400:kworker.0 00000100:00100000:1.0:1784192056.353186:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828068480:0@lo:400:kworker.0 00000100:00100000:1.0:1784192056.353204:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:106499:1870858828068992:0@lo:400:kworker.0 00000100:00100000:1.0:1784192056.353220:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858828067840:0@lo:400:kworker.0 00000100:00100000:1.0:1784192056.353234:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858828068352:0@lo:400:kworker.0 00000100:00100000:1.0:1784192056.353248:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858828068864:0@lo:400:kworker.0 00000100:00100000:2.0:1784192056.355645:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828069248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784192056.356298:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828068224:0@lo:400:kworker.0 00000100:00100000:2.0:1784192056.356318:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828068736:0@lo:400:kworker.0 00000100:00100000:3.0:1784192056.364713:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:106501:1870858828069120:0@lo:400:kworker.0 00000100:00100000:3.0:1784192056.364785:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10f4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858828067584:0@lo:400:kworker.0 00010000:00080000:3.0:1784192056.364805:0:106501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af23310bb80 x1870858828068096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784192056.364818:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828068096:0@lo:400:kworker.0 00010000:00080000:3.0:1784192056.364833:0:106501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af23310b100 x1870858828068608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784192056.364843:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828068608:0@lo:400:kworker.0 00010000:00010000:2.0:1784192056.396252:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784192056.844068:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828069376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784192056.844085:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828069504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784192056.851565:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192056.851865:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828069376 00000100:00100000:2.0:1784192056.851876:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828069376 00000100:00100000:2.0:1784192056.851933:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:2.0:1784192056.851944:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dcfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828069376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784192056.851985:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:2.0:1784192056.852065:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dcfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106499:x1870858828069376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192056.852073:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00100000:3.0:1784192056.852494:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828069376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784192056.852822:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192056.853087:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828069504 00000100:00100000:1.0:1784192056.853098:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828069504 00000100:00100000:1.0:1784192056.853159:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1784192056.853190:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828069504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784192056.853232:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784192056.853305:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828069504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192056.853312:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1784192056.857421:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828069504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784192057.356734:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784192057.356759:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828069632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784192057.356831:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192057.357535:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828069632 00000100:00100000:1.0:1784192057.357545:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828069632 00000100:00100000:1.0:1784192057.357602:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1784192057.357613:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828069632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784192057.357638:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784192057.357726:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828069632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192057.357733:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1784192057.358071:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828069632:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784192057.422036:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784192058.204176:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784192058.204215:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784192058.204252:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1784192058.204355:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812506112 00000100:00100000:0.0:1784192058.204376:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812506112 00000100:00100000:0.0:1784192058.204504:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812506240 00000100:00100000:0.0:1784192058.204507:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812506240 00000100:00100000:0.0:1784192058.204543:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 590 00000100:00100000:0.0:1784192058.204559:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69109:x1870858812506112:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784192058.204589:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 591 00000100:00100000:2.0:1784192058.204612:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812506240:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784192058.204649:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812505984 00000100:00100000:1.0:1784192058.204660:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812505984 00000100:00100000:0.0:1784192058.204748:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69109:x1870858812506112:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 189us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192058.204768:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 151 00000100:00100000:0.0:1784192058.204770:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 590 00000100:00100000:2.0:1784192058.204772:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69109:x1870858812506240:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 160us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192058.204788:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 591 00000100:00100000:1.0:1784192058.204788:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69112:x1870858812505984:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784192058.204835:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69112:x1870858812505984:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 50us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192058.204843:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 151 00000100:00080000:3.0:1784192058.204988:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784192058.204994:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784192058.444021:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784192059.467894:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784192059.916084:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af109198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828069760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784192059.916207:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192059.916248:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784192059.916287:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828069888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784192059.916361:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192059.916650:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828069760 00000100:00100000:0.0:1784192059.916662:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828069760 00000100:00100000:0.0:1784192059.916792:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828069888 00000100:00100000:0.0:1784192059.916796:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828069888 00000100:00100000:0.0:1784192059.916820:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1784192059.916831:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828069760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784192059.916881:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:0.0:1784192059.916957:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828069760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192059.916965:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1784192059.916993:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1784192059.917001:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828069888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784192059.917031:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00010000:00080000:3.0:1784192059.917072:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af109198700 x1870858828069760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784192059.917095:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af109198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828069760:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784192059.918353:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784192059.919399:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828069888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2376us (3015us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192059.919418:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00010000:00080000:3.0:1784192059.944097:0:106500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10db4c380 x1870858828069888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784192059.944179:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828069888:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784192060.492048:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784192061.453452:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784192061.453498:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828070016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784192061.453607:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192061.454767:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828070016 00000100:00100000:2.0:1784192061.454787:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828070016 00000100:00100000:2.0:1784192061.454880:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:2.0:1784192061.454895:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828070016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784192061.454953:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:2.0:1784192061.455059:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828070016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 167us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192061.455067:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:1.0:1784192061.455352:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858828070144:0@lo:400:kworker.0 00000100:00100000:1.0:1784192061.455418:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192061.455477:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828070656:0@lo:400:kworker.0 00000100:00100000:1.0:1784192061.455508:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192061.455541:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828070656 00000100:00100000:1.0:1784192061.455566:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828070656 00000100:00100000:1.0:1784192061.455622:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1784192061.455629:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828070656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192061.455685:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828070656:12345-0@lo:400:kworker.0 Request processed in 56us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192061.455719:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:1.0:1784192061.455743:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784192061.455783:0:106501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22dcfce00 x1870858828070656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784192061.455802:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828070656:0@lo:400:kworker.0 00000100:00100000:1.0:1784192061.455809:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828071168:0@lo:400:kworker.0 00000100:00100000:1.0:1784192061.455833:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192061.455858:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828071168 00000100:00100000:1.0:1784192061.455862:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828071168 00000100:00100000:1.0:1784192061.455895:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1784192061.455902:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828071168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192061.455935:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:106501:x1870858828071168:12345-0@lo:400:kworker.0 Request processed in 33us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192061.455942:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:1.0:1784192061.455960:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784192061.455975:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:106501:1870858828071168:0@lo:400:kworker.0 00000100:00100000:1.0:1784192061.456001:0:106501:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784192061.456006:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858828070272:0@lo:400:kworker.0 00000100:00100000:1.0:1784192061.456031:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192061.456047:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828070784:0@lo:400:kworker.0 00000100:00100000:1.0:1784192061.456075:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192061.456094:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828070784 00000100:00100000:1.0:1784192061.456097:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828070784 00000100:00100000:1.0:1784192061.456122:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1784192061.456127:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828070784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192061.456157:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828070784:12345-0@lo:400:kworker.0 Request processed in 29us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192061.456164:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00080000:1.0:1784192061.456182:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784192061.456198:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828070784:0@lo:400:kworker.0 00000100:00100000:1.0:1784192061.456204:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858828071296:0@lo:400:kworker.0 00000100:00100000:1.0:1784192061.456225:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192061.456420:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828070528:0@lo:400:kworker.0 00000100:00100000:3.0:1784192061.456457:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192061.456509:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828071040:0@lo:400:kworker.0 00000100:00100000:3.0:1784192061.456532:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192061.456552:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858828071552:0@lo:400:kworker.0 00000100:00100000:3.0:1784192061.456574:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192061.456596:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784192061.456602:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828070400:0@lo:400:kworker.0 00000100:00100000:3.0:1784192061.456639:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192061.456664:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858828070912:0@lo:400:kworker.0 00000100:00100000:3.0:1784192061.456685:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192061.456731:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af111a8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858828071424:0@lo:400:kworker.0 00000100:00100000:3.0:1784192061.456753:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192061.456776:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828071040 00000100:00100000:3.0:1784192061.456781:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828071040 00000100:00100000:3.0:1784192061.456821:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1784192061.456828:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828071040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192061.456871:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828071040:12345-0@lo:400:kworker.0 Request processed in 43us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192061.456878:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1784192061.456900:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828070272 00000100:00100000:3.0:1784192061.456904:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828070272 00000100:00100000:3.0:1784192061.456941:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828071296 00000100:00100000:3.0:1784192061.456954:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828071296 00000100:00100000:3.0:1784192061.456980:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828071552 00000100:00100000:3.0:1784192061.456983:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828071552 00000100:00100000:3.0:1784192061.456997:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828070400 00000100:00100000:3.0:1784192061.456999:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828070400 00000100:00100000:3.0:1784192061.457012:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828070912 00000100:00100000:3.0:1784192061.457014:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828070912 00000100:00100000:3.0:1784192061.457024:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828071424 00000100:00100000:3.0:1784192061.457026:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828071424 00000100:00100000:3.0:1784192061.457041:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:3.0:1784192061.457047:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858828070272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192061.457089:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:106501:x1870858828070272:12345-0@lo:400:kworker.0 Request processed in 42us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192061.457096:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:3.0:1784192061.457108:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:3.0:1784192061.457115:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858828071296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192061.457143:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:106501:x1870858828071296:12345-0@lo:400:kworker.0 Request processed in 29us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192061.457149:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:3.0:1784192061.457161:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:3.0:1784192061.457167:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858828071552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192061.457194:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:106500:x1870858828071552:12345-0@lo:400:kworker.0 Request processed in 27us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192061.457199:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:3.0:1784192061.457211:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:3.0:1784192061.457216:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828070400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192061.457245:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828070400:12345-0@lo:400:kworker.0 Request processed in 28us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192061.457258:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:3.0:1784192061.457270:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:3.0:1784192061.457277:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858828070912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192061.457307:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858828070912:12345-0@lo:400:kworker.0 Request processed in 31us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192061.457312:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:3.0:1784192061.457325:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:3.0:1784192061.457331:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858828071424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192061.457373:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858828071424:12345-0@lo:400:kworker.0 Request processed in 30us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192061.457379:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00080000:3.0:1784192061.457402:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784192061.457405:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784192061.457408:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784192061.457431:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828070400:0@lo:400:kworker.0 00000100:00100000:3.0:1784192061.457441:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858828070912:0@lo:400:kworker.0 00000100:00100000:3.0:1784192061.457448:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858828071424:0@lo:400:kworker.0 00010000:00080000:3.0:1784192061.457460:0:106500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af111a8d880 x1870858828071040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784192061.457470:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828071040:0@lo:400:kworker.0 00000100:00100000:3.0:1784192061.457478:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:106500:1870858828071552:0@lo:400:kworker.0 00000100:00100000:3.0:1784192061.457526:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828070016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784192061.457585:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:106501:1870858828070272:0@lo:400:kworker.0 00000100:00100000:3.0:1784192061.457597:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af111a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:106501:1870858828071296:0@lo:400:kworker.0 00000100:00100000:0.0:1784192061.457942:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828070528 00000100:00100000:0.0:1784192061.457949:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828070528 00000100:00100000:0.0:1784192061.458005:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:0.0:1784192061.458014:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828070528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192061.458070:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828070528:12345-0@lo:400:kworker.0 Request processed in 58us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192061.458077:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:0.0:1784192061.458126:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828070528:0@lo:400:kworker.0 00000100:00100000:2.0:1784192061.458413:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828070144 00000100:00100000:2.0:1784192061.458419:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828070144 00000100:00100000:2.0:1784192061.458467:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784192061.458476:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858828070144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192061.458530:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858828070144:12345-0@lo:400:kworker.0 Request processed in 56us (3112us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192061.458537:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784192061.460775:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dcfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858828070144:0@lo:400:kworker.0 00010000:00010000:3.0:1784192061.521641:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784192061.964466:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784192061.964516:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828071680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784192061.964650:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192061.964940:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828071680 00000100:00100000:1.0:1784192061.964951:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828071680 00000100:00100000:1.0:1784192061.965031:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:1.0:1784192061.965045:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828071680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784192061.965099:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:1.0:1784192061.965176:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828071680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192061.965185:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00100000:2.0:1784192061.965472:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828071680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784192061.965887:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828071808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784192061.965983:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192061.966072:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828071808 00000100:00100000:3.0:1784192061.966080:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828071808 00000100:00100000:1.0:1784192061.966256:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1784192061.966268:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828071808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784192061.966309:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:1.0:1784192061.966377:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828071808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192061.966385:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1784192061.966646:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828071808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784192062.478477:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784192062.478530:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828071936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784192062.478637:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192062.478843:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828071936 00000100:00100000:2.0:1784192062.478855:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828071936 00000100:00100000:2.0:1784192062.478929:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1784192062.478941:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828071936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784192062.478972:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:2.0:1784192062.479039:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828071936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192062.479048:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1784192062.479188:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828071936:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784192062.540221:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784192063.323488:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784192063.323820:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812506496 00000100:00100000:2.0:1784192063.323833:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812506496 00000100:00100000:2.0:1784192063.323949:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 598 00000100:00100000:2.0:1784192063.323961:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812506496:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784192063.324064:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69112:x1870858812506496:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 105us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192063.324073:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 598 00000100:00080000:1.0:1784192063.324129:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784192063.324510:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1784192063.324739:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812506368 00000100:00100000:1.0:1784192063.324746:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812506368 00000100:00100000:1.0:1784192063.324783:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 153 00000100:00100000:1.0:1784192063.324791:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10fbc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69112:x1870858812506368:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784192063.324857:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10fbc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69112:x1870858812506368:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 66us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192063.324864:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 153 00000100:00100000:0.0:1784192063.330652:0:106493:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784192063.330803:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812506624 00000100:00100000:2.0:1784192063.330814:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812506624 00000100:00100000:2.0:1784192063.330908:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 599 00000100:00100000:2.0:1784192063.330922:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69110:x1870858812506624:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784192063.331016:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69110:x1870858812506624:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 97us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192063.331024:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 599 00000100:00080000:1.0:1784192063.332283:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784192063.564002:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784192064.588015:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784192065.038782:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828072192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784192065.038805:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784192065.038824:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828072064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784192065.038867:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192065.038902:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828072192 00000100:00100000:1.0:1784192065.038909:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828072192 00000100:00080000:2.0:1784192065.038957:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784192065.039074:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1784192065.039090:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af109198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828072192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784192065.039125:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:3.0:1784192065.043316:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192065.043410:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828072064 00000100:00100000:3.0:1784192065.043427:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828072064 00000100:00080000:2.0:1784192065.044407:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784192065.044615:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1784192065.044632:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828072064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784192065.044660:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:1.0:1784192065.044896:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af109198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106501:x1870858828072192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5808us (6027us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192065.044907:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1784192065.046999:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828072064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2364us (3698us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192065.047013:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00010000:00080000:1.0:1784192065.047857:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10919b100 x1870858828072064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784192065.047883:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828072064:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1784192065.048270:0:106501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10db4e300 x1870858828072192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192065.048529:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828072192:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784192065.612792:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784192066.572430:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828072320:0@lo:400:kworker.0 00000100:00100000:2.0:1784192066.572547:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192066.572601:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828072832:0@lo:400:kworker.0 00000100:00100000:2.0:1784192066.572630:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192066.572653:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828073344:0@lo:400:kworker.0 00000100:00100000:2.0:1784192066.572674:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192066.572721:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828073856:0@lo:400:kworker.0 00000100:00100000:2.0:1784192066.572748:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192066.572776:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784192066.572783:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828072704:0@lo:400:kworker.0 00000100:00100000:1.0:1784192066.572873:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828072832 00000100:00100000:1.0:1784192066.572881:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828072832 00000100:00100000:1.0:1784192066.572925:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828073344 00000100:00100000:1.0:1784192066.572929:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828073344 00000100:00100000:1.0:1784192066.572953:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1784192066.572971:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828072832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192066.572998:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192066.573029:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828073216:0@lo:400:kworker.0 00000100:00100000:1.0:1784192066.573039:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828072832:12345-0@lo:400:kworker.0 Request processed in 69us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192066.573048:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1784192066.573060:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192066.573071:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1784192066.573080:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858828073728:0@lo:400:kworker.0 00000100:00100000:2.0:1784192066.573103:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1784192066.573136:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10ec84380 x1870858828072832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784192066.573150:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828072832:0@lo:400:kworker.0 00000100:00100000:0.0:1784192066.573231:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828072320 00000100:00100000:0.0:1784192066.573237:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828072320 00000100:00100000:1.0:1784192066.573245:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828073344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192066.573286:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784192066.573296:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1098c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828072320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192066.573305:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828073344:12345-0@lo:400:kworker.0 Request processed in 64us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192066.573342:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1098c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106502:x1870858828072320:12345-0@lo:400:kworker.0 Request processed in 48us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192066.573349:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784192066.573382:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828073856 00000100:00100000:0.0:1784192066.573386:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828073856 00000100:00100000:3.0:1784192066.573401:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858828072448:0@lo:400:kworker.0 00000100:00100000:0.0:1784192066.573426:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828073728 00000100:00100000:0.0:1784192066.573431:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828073728 00000100:00100000:3.0:1784192066.573441:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192066.573471:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828072960:0@lo:400:kworker.0 00000100:00100000:3.0:1784192066.573496:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192066.573533:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828073472:0@lo:400:kworker.0 00000100:00100000:3.0:1784192066.573556:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192066.573588:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784192066.573595:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10919b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858828072576:0@lo:400:kworker.0 00000100:00100000:3.0:1784192066.573621:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192066.580174:0:162392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828072960 00000100:00100000:2.0:1784192066.580196:0:162392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828072960 00000100:00100000:1.0:1784192066.580217:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1784192066.580250:0:162391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828073472 00000100:00100000:1.0:1784192066.580254:0:162391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828073472 00000100:00100000:2.0:1784192066.580280:0:162392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1784192066.580294:0:162392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828072960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192066.580306:0:162391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1784192066.580316:0:162391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828073472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192066.580430:0:162392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:106499:x1870858828072960:12345-0@lo:400:kworker.0 Request processed in 141us (6932us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192066.580437:0:162392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1784192066.580469:0:162391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828073472:12345-0@lo:400:kworker.0 Request processed in 154us (6909us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192066.580476:0:162391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1784192066.581477:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828072704 00000100:00100000:2.0:1784192066.581485:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828072704 00000100:00100000:2.0:1784192066.581522:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828073216 00000100:00100000:2.0:1784192066.581525:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828073216 00000100:00100000:2.0:1784192066.581543:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:2.0:1784192066.581549:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828072704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192066.581598:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:106502:x1870858828072704:12345-0@lo:400:kworker.0 Request processed in 49us (8601us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192066.581604:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00100000:2.0:1784192066.581617:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:2.0:1784192066.581623:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828073216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192066.581647:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828073216:12345-0@lo:400:kworker.0 Request processed in 25us (8590us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192066.581653:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00080000:2.0:1784192066.581668:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784192066.581673:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784192066.581676:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784192066.581797:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858828073088:0@lo:400:kworker.0 00000100:00100000:2.0:1784192066.584780:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828072704:0@lo:400:kworker.0 00000100:00100000:0.0:1784192066.585401:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828072448 00000100:00100000:0.0:1784192066.585411:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828072448 00000100:00100000:0.0:1784192066.585503:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828072576 00000100:00100000:0.0:1784192066.585506:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828072576 00000100:00100000:0.0:1784192066.585529:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:0.0:1784192066.585538:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828073856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192066.585629:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828073856:12345-0@lo:400:kworker.0 Request processed in 91us (12880us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192066.585637:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1784192066.585660:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1784192066.585671:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858828073728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192066.585726:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:106502:x1870858828073728:12345-0@lo:400:kworker.0 Request processed in 59us (12623us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192066.585772:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828073216:0@lo:400:kworker.0 00000100:00100000:2.0:1784192066.585809:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:106502:1870858828073728:0@lo:400:kworker.0 00000100:00100000:2.0:1784192066.585821:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106502:1870858828072320:0@lo:400:kworker.0 00010000:00080000:2.0:1784192066.585837:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10ec85c00 x1870858828073344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784192066.585847:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828073344:0@lo:400:kworker.0 00000100:00100000:2.0:1784192066.585863:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828073856:0@lo:400:kworker.0 00000100:00080000:2.0:1784192066.585928:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784192066.585932:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784192066.586486:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:1.0:1784192066.586495:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:0.0:1784192066.586500:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20cf24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858828072448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192066.586518:0:158667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:1.0:1784192066.586527:0:158667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858828072576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784192066.586549:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20cf24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:106499:x1870858828072448:12345-0@lo:400:kworker.0 Request processed in 54us (13108us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192066.586557:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:1.0:1784192066.586628:0:158667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:106499:x1870858828072576:12345-0@lo:400:kworker.0 Request processed in 101us (13004us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192066.586645:0:158667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:0.0:1784192066.587132:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784192066.587234:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828073984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784192066.587285:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192066.587377:0:158670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828073984 00000100:00100000:1.0:1784192066.587383:0:158670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828073984 00000100:00100000:1.0:1784192066.587507:0:158670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:1.0:1784192066.587514:0:158670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828073984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784192066.587541:0:158670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:1.0:1784192066.587588:0:158670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:106500:x1870858828073984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192066.587594:0:158670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:0.0:1784192066.587721:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:106500:1870858828073984:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784192066.588393:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192066.588438:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858828073600:0@lo:400:kworker.0 00000100:00100000:3.0:1784192066.588461:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192066.588502:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:106499:1870858828072448:0@lo:400:kworker.0 00000100:00100000:3.0:1784192066.588573:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:106499:1870858828072960:0@lo:400:kworker.0 00000100:00100000:2.0:1784192066.588575:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828073088 00000100:00100000:2.0:1784192066.588582:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828073088 00000100:00100000:3.0:1784192066.588591:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828073472:0@lo:400:kworker.0 00000100:00100000:2.0:1784192066.588622:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828073600 00000100:00100000:2.0:1784192066.588627:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828073600 00000100:00100000:3.0:1784192066.588629:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10919b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:106499:1870858828072576:0@lo:400:kworker.0 00000100:00100000:1.0:1784192066.588631:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:1.0:1784192066.588645:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858828073088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784192066.588659:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:2.0:1784192066.588670:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858828073600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192066.588714:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:106499:x1870858828073088:12345-0@lo:400:kworker.0 Request processed in 73us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192066.588721:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:3.0:1784192066.588850:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:106499:1870858828073088:0@lo:400:kworker.0 00000100:00100000:2.0:1784192066.589128:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106499:x1870858828073600:12345-0@lo:400:kworker.0 Request processed in 460us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192066.589135:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:3.0:1784192066.589229:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:106499:1870858828073600:0@lo:400:kworker.0 00010000:00010000:3.0:1784192066.643868:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784192067.084342:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828074112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784192067.084435:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192067.084863:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828074112 00000100:00100000:0.0:1784192067.084874:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828074112 00000100:00100000:0.0:1784192067.084934:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1784192067.084953:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828074112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784192067.084986:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:0.0:1784192067.085035:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828074112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192067.085042:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1784192067.085080:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828074112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784192067.085419:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af23310b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828074240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784192067.085636:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192067.085755:0:161739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828074240 00000100:00100000:2.0:1784192067.085760:0:161739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828074240 00000100:00100000:2.0:1784192067.085835:0:161739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:2.0:1784192067.085843:0:161739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828074240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784192067.085869:0:161739:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:2.0:1784192067.085915:0:161739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828074240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192067.085921:0:161739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:1.0:1784192067.085988:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af23310b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828074240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784192067.595981:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828074368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784192067.596064:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192067.596641:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828074368 00000100:00100000:3.0:1784192067.596650:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828074368 00000100:00100000:3.0:1784192067.596784:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1784192067.596795:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828074368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784192067.596817:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:3.0:1784192067.596881:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828074368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192067.596888:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1784192067.596984:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828074368:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784192067.659947:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784192068.436498:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784192068.436544:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784192068.436576:0:106492:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1784192068.437650:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812507008 00000100:00100000:1.0:1784192068.437650:0:167176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812506752 00000100:00100000:2.0:1784192068.437661:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812507008 00000100:00100000:1.0:1784192068.437661:0:167176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812506752 00000100:00100000:1.0:1784192068.437757:0:167176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 155 00000100:00100000:1.0:1784192068.437769:0:167176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1098c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812506752:12345-192.168.204.16@tcp:400:kworker.0 00000100:00080000:0.0:1784192068.437786:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784192068.437814:0:158665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812506880 00000100:00100000:0.0:1784192068.437818:0:158665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812506880 00000100:00100000:0.0:1784192068.437854:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 606 00000100:00100000:0.0:1784192068.437862:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812507008:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1784192068.437948:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69112:x1870858812507008:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 86us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192068.437955:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 606 00000100:00100000:0.0:1784192068.437975:0:158665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 607 00000100:00100000:0.0:1784192068.437982:0:158665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69111:x1870858812506880:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1784192068.442964:0:167176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1098c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812506752:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 5184us (6462us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192068.442981:0:167176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 155 00000100:00080000:1.0:1784192068.443974:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784192068.448322:0:158665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69111:x1870858812506880:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 10326us (11730us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192068.448365:0:158665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 607 00010000:00010000:2.0:1784192068.684109:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784192069.708493:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784192070.155998:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828074496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784192070.156076:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192070.156309:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828074496 00000100:00100000:0.0:1784192070.156320:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828074496 00000100:00100000:0.0:1784192070.156398:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1784192070.156408:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828074496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784192070.156441:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:0.0:1784192070.156496:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828074496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192070.156503:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00010000:00080000:0.0:1784192070.156544:0:106499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10ec87b80 x1870858828074496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784192070.156563:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828074496:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784192070.156736:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784192070.156944:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10db4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828074624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784192070.156997:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192070.157079:0:164518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828074624 00000100:00100000:3.0:1784192070.157084:0:164518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828074624 00000100:00100000:3.0:1784192070.157134:0:164518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1784192070.157142:0:164518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af23310b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828074624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784192070.157156:0:164518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 38084608 avail 30916608 00000100:00100000:3.0:1784192070.157194:0:164518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af23310b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828074624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192070.157211:0:164518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:1.0:1784192070.157298:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784192070.157322:0:106500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af10db4e300 x1870858828074624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784192086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784192070.157336:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10db4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828074624:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784192070.736347:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784192071.692517:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af233108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828074752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784192071.692564:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af20d5c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858828074880:0@lo:400:kworker.0 00000100:00100000:2.0:1784192071.692601:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192071.692614:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192071.692679:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828075392:0@lo:400:kworker.0 00000100:00100000:2.0:1784192071.692736:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192071.692869:0:167179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828074880 00000100:00100000:2.0:1784192071.692876:0:167179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828074880 00000100:00100000:2.0:1784192071.692917:0:167179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784192071.692926:0:167179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af1098c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858828074880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192071.694951:0:162386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828075392 00000100:00100000:1.0:1784192071.694966:0:162386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828075392 00000100:00100000:1.0:1784192071.695014:0:162386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1784192071.695023:0:162386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10919b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828075392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192071.695101:0:162386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10919b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828075392:12345-0@lo:400:kworker.0 Request processed in 78us (2364us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192071.695109:0:162386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1784192071.695157:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828075136:0@lo:400:kworker.0 00000100:00100000:1.0:1784192071.695203:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784192071.695230:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784192071.695237:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858828075008:0@lo:400:kworker.0 00000100:00100000:1.0:1784192071.695256:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784192071.696478:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22dc82a00 x1870858828075392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784192071.696495:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828075392:0@lo:400:kworker.0 00000100:00100000:1.0:1784192071.696564:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828074752 00000100:00100000:1.0:1784192071.696570:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828074752 00000100:00100000:1.0:1784192071.696614:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:1.0:1784192071.696622:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10db4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828074752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784192071.696673:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42717184 avail 36585472 00000100:00100000:1.0:1784192071.696764:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10db4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828074752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (4165us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192071.696772:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:1.0:1784192071.696822:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af233108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828074752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784192071.696854:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828075136 00000100:00100000:1.0:1784192071.696858:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828075136 00000100:00100000:1.0:1784192071.696894:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828075008 00000100:00100000:1.0:1784192071.696898:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828075008 00000100:00100000:1.0:1784192071.696919:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:1.0:1784192071.696925:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828075136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192071.696965:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:106500:x1870858828075136:12345-0@lo:400:kworker.0 Request processed in 41us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192071.696971:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:1.0:1784192071.696983:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:1.0:1784192071.696989:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af233109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858828075008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784192071.697018:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af233109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:106500:x1870858828075008:12345-0@lo:400:kworker.0 Request processed in 29us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1784192071.697025:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00080000:1.0:1784192071.697044:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784192071.697048:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784192071.697067:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:106500:1870858828075008:0@lo:400:kworker.0 00000100:00100000:1.0:1784192071.697078:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:106500:1870858828075136:0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.702896:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784192071.702919:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828075520:0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.702992:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192071.703056:0:162389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828075520 00000100:00100000:3.0:1784192071.703065:0:162389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828075520 00000100:00100000:3.0:1784192071.703124:0:162389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1784192071.703134:0:162389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828075520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.703199:0:162389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:106500:x1870858828075520:12345-0@lo:400:kworker.0 Request processed in 67us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192071.703207:0:162389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00080000:3.0:1784192071.703230:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784192071.703259:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828075520:0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.703318:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858828075648:0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.703344:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192071.703394:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784192071.703402:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828075776:0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.703424:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192071.703447:0:160165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828075776 00000100:00100000:3.0:1784192071.703451:0:160165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828075776 00000100:00100000:3.0:1784192071.703474:0:160165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1784192071.703480:0:160165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828075776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.703512:0:160165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828075776:12345-0@lo:400:kworker.0 Request processed in 32us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192071.703519:0:160165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00080000:3.0:1784192071.703543:0:106502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8af22dc81c00 x1870858828075776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784192087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784192071.703554:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828075776:0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.703584:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828075904:0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.703605:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192071.703631:0:160163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828075904 00000100:00100000:3.0:1784192071.703635:0:160163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828075904 00000100:00100000:3.0:1784192071.703664:0:160163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1784192071.703669:0:160163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828075904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.703724:0:160163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:106502:x1870858828075904:12345-0@lo:400:kworker.0 Request processed in 54us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192071.703731:0:160163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00080000:3.0:1784192071.703743:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784192071.703766:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:106502:1870858828075904:0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.703792:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784192071.703798:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:106500:1870858828076032:0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.703820:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192071.703845:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828075648 00000100:00100000:3.0:1784192071.703848:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828075648 00000100:00100000:3.0:1784192071.703871:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828076032 00000100:00100000:3.0:1784192071.703874:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828076032 00000100:00100000:3.0:1784192071.703889:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:3.0:1784192071.703894:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858828075648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.703924:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:106500:x1870858828075648:12345-0@lo:400:kworker.0 Request processed in 30us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192071.703931:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:3.0:1784192071.703942:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1784192071.703948:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106500:x1870858828076032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.703975:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:106500:x1870858828076032:12345-0@lo:400:kworker.0 Request processed in 27us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192071.703980:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1784192071.704007:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:106500:1870858828076032:0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.704016:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:106500:1870858828075648:0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.704046:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858828076160:0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.704068:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192071.704093:0:164531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828076160 00000100:00100000:3.0:1784192071.704097:0:164531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828076160 00000100:00100000:3.0:1784192071.704122:0:164531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:3.0:1784192071.704128:0:164531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858828076160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.704181:0:164531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:106500:x1870858828076160:12345-0@lo:400:kworker.0 Request processed in 41us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192071.704188:0:164531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00080000:3.0:1784192071.704203:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784192071.704218:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:106500:1870858828076160:0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.704244:0:106502:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784192071.704250:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828076288:0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.704271:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192071.704293:0:158666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828076288 00000100:00100000:3.0:1784192071.704296:0:158666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828076288 00000100:00100000:3.0:1784192071.704326:0:158666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1784192071.704333:0:158666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828076288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.704374:0:158666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:106502:x1870858828076288:12345-0@lo:400:kworker.0 Request processed in 41us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192071.704380:0:158666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00080000:3.0:1784192071.704396:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784192071.704409:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:106502:1870858828076288:0@lo:400:kworker.0 00000100:00100000:2.0:1784192071.706878:0:167179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af1098c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7a68c78-a3ad-4338-9a3e-dc550a0e9642+24:106501:x1870858828074880:12345-0@lo:400:kworker.0 Request processed in 13941us (14254us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192071.706894:0:167179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784192071.712802:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af20d5c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7a68c78-a3ad-4338-9a3e-dc550a0e9642:106501:1870858828074880:0@lo:400:kworker.0 00000100:00100000:0.0:1784192071.712827:0:106501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af22dc82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828075264:0@lo:400:kworker.0 00000100:00100000:0.0:1784192071.712913:0:106501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784192071.714020:0:158671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828075264 00000100:00100000:3.0:1784192071.714031:0:158671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828075264 00000100:00100000:3.0:1784192071.714097:0:158671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:3.0:1784192071.714107:0:158671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828075264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784192071.714208:0:158671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:106501:x1870858828075264:12345-0@lo:400:kworker.0 Request processed in 101us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192071.714216:0:158671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00100000:0.0:1784192071.715043:0:106501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af22dc82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:106501:1870858828075264:0@lo:400:kworker.0 00010000:00010000:0.0:1784192071.757062:0:160901:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784192072.203962:0:106502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828076416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784192072.204046:0:106502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192072.204143:0:160168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828076416 00000100:00100000:0.0:1784192072.204152:0:160168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828076416 00000100:00100000:0.0:1784192072.204215:0:160168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1784192072.204225:0:160168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828076416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784192072.204274:0:160168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:0.0:1784192072.204339:0:160168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:106502:x1870858828076416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192072.204347:0:160168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1784192072.204497:0:106502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:106502:1870858828076416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784192072.204972:0:106500:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784192072.204985:0:106500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828076544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784192072.205019:0:106500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784192072.205096:0:159636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828076544 00000100:00100000:0.0:1784192072.205100:0:159636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828076544 00000100:00100000:0.0:1784192072.205138:0:159636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:0.0:1784192072.205146:0:159636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828076544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784192072.205190:0:159636:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 42569728 avail 36438016 00000100:00100000:0.0:1784192072.205229:0:159636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:106500:x1870858828076544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1784192072.205235:0:159636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:3.0:1784192072.205375:0:106500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:106500:1870858828076544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784192072.717057:0:106499:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784192072.717090:0:106499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8af10ec85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828076672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784192072.717207:0:106499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784192072.717436:0:160167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858828076672 00000100:00100000:2.0:1784192072.717450:0:160167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858828076672 00000100:00100000:2.0:1784192072.717533:0:160167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1784192072.717546:0:160167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10ec86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828076672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784192072.717581:0:160167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 67768320 avail 60600320 00000100:00100000:2.0:1784192072.717644:0:160167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10ec86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:106499:x1870858828076672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192072.717653:0:160167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1784192072.718494:0:106499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8af10ec85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:106499:1870858828076672:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784192072.784973:0:158653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784192073.557664:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784192073.557719:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784192073.557797:0:106494:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1784192073.557831:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812507392 00000100:00100000:3.0:1784192073.557840:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812507392 00000100:00100000:3.0:1784192073.557896:0:161504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812507264 00000100:00100000:3.0:1784192073.557899:0:161504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812507264 00000100:00100000:3.0:1784192073.557922:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 614 00000100:00100000:3.0:1784192073.557932:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af22dc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812507392:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784192073.558059:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af22dc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+6:69111:x1870858812507392:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 128us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192073.558068:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 614 00000100:00100000:3.0:1784192073.558084:0:161504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 615 00000100:00100000:3.0:1784192073.558091:0:161504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af20d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69109:x1870858812507264:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1784192073.558114:0:161504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af20d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62ac9b09-d016-4ae6-b1b1-fe120a3abe0a+9:69109:x1870858812507264:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 23us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784192073.558120:0:161504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 615 00000100:00080000:3.0:1784192073.558147:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784192073.558151:0:158661:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784192073.558973:0:167181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870858812507136 00000100:00100000:2.0:1784192073.558981:0:167181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870858812507136 00000100:00100000:2.0:1784192073.559025:0:167181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 157 00000100:00100000:2.0:1784192073.559035:0:167181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8af10cfd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812507136:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1784192073.559087:0:167181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8af10cfd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9424fd8d-001c-4ed5-89e0-95e0bf2d2c97+10:69109:x1870858812507136:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 54us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784192073.559104:0:167181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 157 00000001:02000400:2.0:1784192073.612913:0:170790:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: rpc test_45: @@@@@@ FAIL: can't put import for osc.lustre-OST0000-osc-ffff9e79d8526800.ost_server_uuid into FULL state after 50 sec, have IDLE 00010000:00010000:3.0:1784192073.812439:0:158654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784192074.828142:0:167403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 57488 lines, 57488 kept, 0 dropped, 0 bad.